2024-09-21T21:50:40.515 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T21:50:40.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T21:50:40.625 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450 branch: squid description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read} email: ceph-qa@ceph.com first_in_suite: false job_id: '7914450' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: rbd cache: true rbd clone copy on read: true global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 1478 sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 sleep_before_teardown: 0 subset: 24/128 suite: rbd suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPEBPGJ7DKLQUwZwP5civddLpdRnKd+Zxz8wpOl518DLgj56bw3+Odd63nsbamw8oDmXJO9eB2PnYuDInwU9cSc= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCZrtHghgB1dqhXPBcYy7Q6inhiQ8rxu89tt4a8RggsDtKDWhsJlom3UavZFTZeQlgeKMGtRBL4DtY990vCuK2I= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_21:16:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T21:50:40.625 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-21T21:50:40.625 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-21T21:50:40.625 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T21:50:40.627 INFO:teuthology.task.internal:Checking packages... 2024-09-21T21:50:40.645 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4e45e6b490e6cbe082cdf155fea780438ec53fc7' 2024-09-21T21:50:40.646 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T21:50:40.646 INFO:teuthology.packaging:ref: None 2024-09-21T21:50:40.646 INFO:teuthology.packaging:tag: None 2024-09-21T21:50:40.646 INFO:teuthology.packaging:branch: squid 2024-09-21T21:50:40.646 INFO:teuthology.packaging:sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T21:50:40.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T21:50:40.917 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373.g4e45e6b4 2024-09-21T21:50:40.919 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T21:50:40.925 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T21:50:40.925 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T21:50:40.960 INFO:teuthology.task.internal:Saving configuration 2024-09-21T21:50:40.972 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T21:50:40.980 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T21:50:41.004 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 21:45:45.554982', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPEBPGJ7DKLQUwZwP5civddLpdRnKd+Zxz8wpOl518DLgj56bw3+Odd63nsbamw8oDmXJO9eB2PnYuDInwU9cSc='} 2024-09-21T21:50:41.027 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 21:45:45.553049', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCZrtHghgB1dqhXPBcYy7Q6inhiQ8rxu89tt4a8RggsDtKDWhsJlom3UavZFTZeQlgeKMGtRBL4DtY990vCuK2I='} 2024-09-21T21:50:41.027 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T21:50:41.036 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-21T21:50:41.036 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-21T21:50:41.036 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T21:50:41.091 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fae9532f880>, signals=[15]) 2024-09-21T21:50:41.091 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T21:50:41.099 INFO:teuthology.task.internal:Opening connections... 2024-09-21T21:50:41.099 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T21:50:41.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:50:41.175 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T21:50:41.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:50:41.248 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T21:50:41.259 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-21T21:50:41.277 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-21T21:50:41.277 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-21T21:50:41.334 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-09-21T21:50:41.334 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T21:50:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T21:50:41.336 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-21T21:50:41.358 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-09-21T21:50:41.377 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-09-21T21:50:41.377 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-09-21T21:50:41.435 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T21:50:41.436 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T21:50:41.437 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-09-21T21:50:41.458 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T21:50:41.468 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T21:50:41.480 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T21:50:41.481 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-21T21:50:41.483 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-09-21T21:50:41.500 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T21:50:41.519 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T21:50:41.519 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-21T21:50:41.539 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-09-21T21:50:41.643 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T21:50:41.699 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T21:50:41.716 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T21:50:41.716 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T21:50:41.716 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T21:50:41.717 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T21:50:41.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:50:41.733 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-21T21:50:41.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:50:41.734 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-09-21T21:50:41.790 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-503.el9.x86_64 2024-09-21T21:50:41.790 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-503.el9.x86_64 2024-09-21T21:50:41.791 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-09-21T21:50:41.792 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-503.el9.x86_64 2024-09-21T21:50:41.792 INFO:teuthology.task.kernel:Running kernel on smithi184: 5.14.0-503.el9.x86_64 2024-09-21T21:50:41.792 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum install -y kernel 2024-09-21T21:50:44.850 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.3 MB 00:01 2024-09-21T21:50:45.393 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-21T21:50:46.743 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-21T21:50:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-21T21:50:51.202 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T21:50:52.861 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-21T21:50:52.944 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-21T21:50:53.923 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T21:50:54.628 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-21T21:50:55.683 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T21:50:59.338 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T21:51:01.063 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T21:51:01.277 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T21:51:01.277 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T21:51:01.375 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:51:01.382 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:51:01.382 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-21T21:51:01.382 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:51:01.382 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:51:01.382 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T21:51:01.382 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T21:51:01.382 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T21:51:01.383 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T21:51:01.383 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T21:51:01.383 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:51:01.383 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:51:01.383 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:51:01.383 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-21T21:51:01.383 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:51:01.383 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 79 M 2024-09-21T21:51:01.384 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 126 M 2024-09-21T21:51:01.384 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:51:01.539 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 281 kB/s | 36 kB 00:00 2024-09-21T21:51:02.081 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 53 MB/s | 29 MB 00:00 2024-09-21T21:51:02.240 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-21T21:51:02.741 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 26 MB/s | 35 MB 00:01 2024-09-21T21:51:02.741 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:51:02.742 INFO:teuthology.orchestra.run.smithi102.stdout:Total 58 MB/s | 79 MB 00:01 2024-09-21T21:51:02.995 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T21:51:02.995 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T21:51:03.101 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:51:03.108 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:51:03.108 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout:Install 4 Packages 2024-09-21T21:51:03.109 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:51:03.110 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 79 M 2024-09-21T21:51:03.110 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 126 M 2024-09-21T21:51:03.110 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:51:03.422 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:51:03.481 INFO:teuthology.orchestra.run.smithi184.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 379 kB/s | 36 kB 00:00 2024-09-21T21:51:03.791 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:51:03.791 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:51:03.890 INFO:teuthology.orchestra.run.smithi184.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-21T21:51:04.315 INFO:teuthology.orchestra.run.smithi184.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-21T21:51:04.682 INFO:teuthology.orchestra.run.smithi184.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-21T21:51:04.682 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:51:04.683 INFO:teuthology.orchestra.run.smithi184.stdout:Total 50 MB/s | 79 MB 00:01 2024-09-21T21:51:04.751 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:51:04.751 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:51:05.372 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:51:05.719 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:51:05.720 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:51:06.679 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:51:06.679 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:51:07.175 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:51:07.845 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T21:51:07.933 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:51:09.116 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:51:09.754 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T21:51:09.852 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:51:10.691 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:51:10.829 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:51:12.622 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:51:12.754 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:51:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:51:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:51:17.558 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:51:17.697 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:51:20.632 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:51:22.541 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:51:58.785 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:51:58.825 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:51:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:51:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T21:51:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:51:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:51:59.998 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:51:59.998 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:51:59.998 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:51:59.998 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T21:51:59.998 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T21:51:59.998 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T21:51:59.998 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T21:51:59.999 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:51:59.999 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:52:00.389 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T21:52:00.459 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:52:00.464 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T21:52:00.464 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T21:52:00.464 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T21:52:00.464 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T21:52:00.464 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T21:52:00.464 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T21:52:00.464 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T21:52:00.464 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T21:52:00.499 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:52:00.522 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T21:52:00.523 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T21:52:00.523 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-09-21T21:52:00.565 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 82.el9 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8274670 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-09-21T21:52:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-09-21T21:52:00.567 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T21:52:00.567 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-09-21T21:52:00.567 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-09-21T21:52:00.567 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:52:00.567 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T21:52:00.567 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T21:52:00.567 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T21:52:00.567 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-09-21T21:52:00.567 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:52:00.567 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T21:52:00.568 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T21:52:00.568 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-508.el9.x86_64 2024-09-21T21:52:00.568 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T21:52:00.815 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:52:00.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T21:52:00.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:52:00.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:52:01.289 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-21T21:52:01.655 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:52:01.655 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:52:01.655 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:52:01.655 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T21:52:01.655 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T21:52:01.655 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T21:52:01.655 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T21:52:01.656 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:52:01.656 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:52:01.993 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T21:52:02.076 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T21:52:02.076 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T21:52:02.076 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T21:52:02.076 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T21:52:02.076 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T21:52:02.077 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T21:52:02.077 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T21:52:02.077 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T21:52:02.135 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T21:52:02.136 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T21:52:02.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2024-09-21T21:52:02.167 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2024-09-21T21:52:02.167 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2024-09-21T21:52:02.167 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.06 2024-09-21T21:52:02.167 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 82.el9 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Group : Unspecified 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 8274670 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : builder@centos.org 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : CentOS 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:52:02.168 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T21:52:02.169 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T21:52:02.169 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T21:52:02.169 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2024-09-21T21:52:02.169 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:52:02.169 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T21:52:02.169 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T21:52:02.170 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 5.14.0-508.el9.x86_64 2024-09-21T21:52:02.170 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T21:52:02.559 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T21:52:02.604 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-21T21:52:02.606 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-21T21:52:02.621 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.pcLSuArZcW 2024-09-21T21:52:02.622 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pcLSuArZcW 2024-09-21T21:52:02.698 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.pcLSuArZcW 2024-09-21T21:52:02.832 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.pcLSuArZcW is 6KB 2024-09-21T21:52:02.862 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2024-09-21T21:52:02.881 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.pcLSuArZcW 2024-09-21T21:52:02.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T21:52:02.962 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T21:52:02.963 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T21:52:02.963 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T21:52:02.963 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T21:52:02.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T21:52:03.122 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-09-21T21:52:04.104 INFO:teuthology.orchestra.run.smithi184.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T21:52:04.128 INFO:teuthology.orchestra.run.smithi184.stderr:done 2024-09-21T21:52:04.130 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-09-21T21:52:04.145 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.ghoKg8LQGS 2024-09-21T21:52:04.145 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ghoKg8LQGS 2024-09-21T21:52:04.213 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.ghoKg8LQGS 2024-09-21T21:52:04.356 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.ghoKg8LQGS is 6KB 2024-09-21T21:52:04.404 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.ghoKg8LQGS 2024-09-21T21:52:04.418 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T21:52:04.483 INFO:teuthology.orchestra.run.smithi184.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T21:52:04.483 INFO:teuthology.orchestra.run.smithi184.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T21:52:04.483 INFO:teuthology.orchestra.run.smithi184.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T21:52:04.484 INFO:teuthology.orchestra.run.smithi184.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T21:52:04.485 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T21:52:04.648 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2024-09-21T21:52:33.137 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T21:52:33.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T21:52:33.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:52:34.652 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T21:52:34.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-21T21:52:34.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:52:51.699 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-21T21:52:52.975 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-09-21T21:53:00.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T21:53:00.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:53:01.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-21T21:53:01.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:53:03.759 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-21T21:53:05.038 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-09-21T21:53:15.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T21:53:15.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:53:17.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-21T21:53:17.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:53:47.650 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-21T21:53:48.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T21:53:48.199 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T21:53:48.199 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-21T21:53:48.240 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-508.el9.x86_64 2024-09-21T21:53:48.240 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T21:53:48.240 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T21:53:48.241 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T21:53:48.854 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-09-21T21:53:49.241 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T21:53:49.241 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T21:53:49.300 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-09-21T21:53:49.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-21T21:53:49.322 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T21:53:49.322 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-09-21T21:53:49.336 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-508.el9.x86_64 2024-09-21T21:53:49.336 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T21:53:49.336 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T21:53:49.336 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T21:53:49.401 DEBUG:teuthology.parallel:result is None 2024-09-21T21:53:50.337 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T21:53:50.337 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T21:53:50.401 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2024-09-21T21:53:50.426 DEBUG:teuthology.parallel:result is None 2024-09-21T21:53:50.426 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T21:53:50.441 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T21:53:50.441 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T21:53:50.444 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T21:53:50.459 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T21:53:50.496 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T21:53:50.519 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T21:53:50.519 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T21:53:50.522 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T21:53:50.565 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T21:53:50.571 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T21:53:50.571 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T21:53:50.597 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T21:53:50.627 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T21:53:50.637 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T21:53:50.641 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T21:53:50.653 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T21:53:50.655 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T21:53:50.663 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T21:53:50.663 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T21:53:50.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T21:53:50.702 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T21:53:50.715 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T21:53:50.715 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T21:53:50.735 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T21:53:50.757 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T21:53:50.834 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T21:53:50.887 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T21:53:50.968 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T21:53:51.012 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:53:51.012 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T21:53:51.078 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T21:53:51.116 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T21:53:51.172 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T21:53:51.253 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T21:53:51.294 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T21:53:51.294 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T21:53:51.358 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-21T21:53:51.361 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-09-21T21:53:51.405 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T21:53:51.440 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T21:53:51.816 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T21:53:51.825 INFO:teuthology.task.internal:Starting timer... 2024-09-21T21:53:51.825 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T21:53:51.914 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T21:53:51.928 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-21T21:53:51.928 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-09-21T21:53:51.980 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-09-21T21:53:51.982 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2024-09-21T21:53:52.040 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2024-09-21T21:53:52.041 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T21:53:52.042 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-09-21T21:53:52.064 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-09-21T21:53:52.064 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2024-09-21T21:53:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2024-09-21T21:53:52.097 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi102.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2024-09-21T21:53:52.097 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T21:53:52.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:53:52.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T21:53:52.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:53:52.162 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T21:53:52.162 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-09-21T21:53:52.204 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2024-09-21T21:53:52.234 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T21:53:52.251 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T21:53:52.253 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T21:53:52.360 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T21:53:52.370 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T21:53:52.371 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi102.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T21:57:32.904 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-09-21T21:57:32.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T21:57:32.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:57:32.981 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-21T21:57:33.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T21:57:33.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-21T21:57:33.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:57:33.099 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-09-21T21:57:33.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-21T21:57:33.178 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T21:57:33.187 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T21:57:33.187 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T21:57:33.188 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T21:57:33.190 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T21:57:33.190 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T21:57:33.217 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T21:57:33.231 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T21:57:33.246 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T21:57:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-09-21T21:57:33.261 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T21:57:33.266 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-09-21T21:57:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T21:57:33.285 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2024-09-21T21:57:33.294 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T21:57:33.296 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2024-09-21T21:57:33.311 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T21:57:33.325 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T21:57:33.355 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-21T21:57:33.358 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T21:57:33.358 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-21T21:57:33.358 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:57:33.359 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:57:33.359 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:57:33.359 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:57:33.378 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-09-21T21:57:33.381 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T21:57:33.382 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-09-21T21:57:33.382 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:57:33.382 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:57:33.382 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:57:33.382 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:57:33.383 INFO:teuthology.run_tasks:Running task install... 2024-09-21T21:57:33.404 DEBUG:teuthology.task.install:project ceph 2024-09-21T21:57:33.405 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-21T21:57:33.405 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'} 2024-09-21T21:57:33.405 INFO:teuthology.task.install:Using flavor: default 2024-09-21T21:57:33.410 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T21:57:33.410 INFO:teuthology.task.install:extra packages: [] 2024-09-21T21:57:33.410 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'tag': None, 'wait_for_package': False} 2024-09-21T21:57:33.411 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T21:57:33.412 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'tag': None, 'wait_for_package': False} 2024-09-21T21:57:33.412 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T21:57:33.566 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T21:57:33.567 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T21:57:33.571 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T21:57:33.571 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T21:57:33.679 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T21:57:33.680 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T21:57:33.680 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T21:57:33.685 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T21:57:33.685 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:57:33.685 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T21:57:33.707 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T21:57:33.707 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e45e6b490e6cbe082cdf155fea780438ec53fc7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T21:57:33.712 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T21:57:33.712 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e45e6b490e6cbe082cdf155fea780438ec53fc7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T21:57:33.772 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T21:57:33.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T21:57:33.847 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T21:57:33.853 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T21:57:33.912 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2024-09-21T21:57:33.913 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2024-09-21T21:57:33.918 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-09-21T21:57:33.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-09-21T21:57:34.158 INFO:teuthology.orchestra.run.smithi102.stdout:45 files removed 2024-09-21T21:57:34.163 INFO:teuthology.orchestra.run.smithi184.stdout:45 files removed 2024-09-21T21:57:34.185 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw 2024-09-21T21:57:34.192 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw 2024-09-21T21:57:34.744 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-21T21:57:34.752 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-21T21:57:35.028 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-21T21:57:35.037 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-21T21:57:35.303 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T21:57:35.312 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T21:57:36.896 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.3 MB 00:01 2024-09-21T21:57:37.136 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-21T21:57:38.918 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T21:57:40.514 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-09-21T21:57:44.464 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-21T21:57:44.689 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T21:57:45.915 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 117 kB/s | 19 kB 00:00 2024-09-21T21:57:46.131 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 19 kB 00:00 2024-09-21T21:57:47.136 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-21T21:57:47.194 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T21:57:52.567 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T21:57:52.817 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T21:57:54.776 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T21:57:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T21:57:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T21:57:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:57:54.798 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:57:54.798 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:57:54.798 INFO:teuthology.orchestra.run.smithi102.stdout:Install 30 Packages 2024-09-21T21:57:54.798 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 2 Packages 2024-09-21T21:57:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:57:54.798 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 60 M 2024-09-21T21:57:54.798 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:57:55.042 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T21:57:55.063 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T21:57:55.064 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout:Installing weak dependencies: 2024-09-21T21:57:55.065 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T21:57:55.066 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:57:55.066 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:57:55.066 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:57:55.066 INFO:teuthology.orchestra.run.smithi184.stdout:Install 30 Packages 2024-09-21T21:57:55.066 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 2 Packages 2024-09-21T21:57:55.066 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:57:55.066 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 60 M 2024-09-21T21:57:55.066 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:57:55.726 INFO:teuthology.orchestra.run.smithi102.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 9.6 MB/s | 5.4 MB 00:00 2024-09-21T21:57:55.784 INFO:teuthology.orchestra.run.smithi102.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 433 kB/s | 25 kB 00:00 2024-09-21T21:57:55.951 INFO:teuthology.orchestra.run.smithi102.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 4.4 MB/s | 751 kB 00:00 2024-09-21T21:57:56.001 INFO:teuthology.orchestra.run.smithi184.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 11 MB/s | 5.4 MB 00:00 2024-09-21T21:57:56.027 INFO:teuthology.orchestra.run.smithi102.stdout:(4/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 6.6 MB/s | 507 kB 00:00 2024-09-21T21:57:56.068 INFO:teuthology.orchestra.run.smithi184.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 378 kB/s | 25 kB 00:00 2024-09-21T21:57:56.160 INFO:teuthology.orchestra.run.smithi184.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 8.0 MB/s | 751 kB 00:00 2024-09-21T21:57:56.177 INFO:teuthology.orchestra.run.smithi102.stdout:(5/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 10 MB/s | 11 MB 00:01 2024-09-21T21:57:56.252 INFO:teuthology.orchestra.run.smithi184.stdout:(4/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 5.4 MB/s | 507 kB 00:00 2024-09-21T21:57:56.252 INFO:teuthology.orchestra.run.smithi102.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 604 kB/s | 45 kB 00:00 2024-09-21T21:57:56.627 INFO:teuthology.orchestra.run.smithi184.stdout:(5/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 14 MB/s | 5.3 MB 00:00 2024-09-21T21:57:56.644 INFO:teuthology.orchestra.run.smithi102.stdout:(7/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 8.7 MB/s | 5.3 MB 00:00 2024-09-21T21:57:56.677 INFO:teuthology.orchestra.run.smithi184.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 907 kB/s | 45 kB 00:00 2024-09-21T21:57:56.794 INFO:teuthology.orchestra.run.smithi184.stdout:(7/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 8.2 MB/s | 11 MB 00:01 2024-09-21T21:57:56.819 INFO:teuthology.orchestra.run.smithi184.stdout:(8/32): python3-ceph-common-19.1.1-373.g4e45e6b 959 kB/s | 136 kB 00:00 2024-09-21T21:57:56.853 INFO:teuthology.orchestra.run.smithi184.stdout:(9/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 2.7 MB/s | 162 kB 00:00 2024-09-21T21:57:56.869 INFO:teuthology.orchestra.run.smithi102.stdout:(8/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x8 12 MB/s | 21 MB 00:01 2024-09-21T21:57:56.887 INFO:teuthology.orchestra.run.smithi184.stdout:(10/32): python3-rados-19.1.1-373.g4e45e6b4.el9 4.7 MB/s | 321 kB 00:00 2024-09-21T21:57:56.894 INFO:teuthology.orchestra.run.smithi102.stdout:(9/32): python3-ceph-common-19.1.1-373.g4e45e6b 212 kB/s | 136 kB 00:00 2024-09-21T21:57:56.912 INFO:teuthology.orchestra.run.smithi184.stdout:(11/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 5.0 MB/s | 300 kB 00:00 2024-09-21T21:57:56.920 INFO:teuthology.orchestra.run.smithi102.stdout:(10/32): python3-cephfs-19.1.1-373.g4e45e6b4.el 588 kB/s | 162 kB 00:00 2024-09-21T21:57:56.945 INFO:teuthology.orchestra.run.smithi102.stdout:(11/32): python3-rados-19.1.1-373.g4e45e6b4.el9 4.2 MB/s | 321 kB 00:00 2024-09-21T21:57:56.954 INFO:teuthology.orchestra.run.smithi184.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.5 MB/s | 99 kB 00:00 2024-09-21T21:57:56.979 INFO:teuthology.orchestra.run.smithi102.stdout:(12/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 3.5 MB/s | 300 kB 00:00 2024-09-21T21:57:57.004 INFO:teuthology.orchestra.run.smithi102.stdout:(13/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.2 MB/s | 99 kB 00:00 2024-09-21T21:57:57.013 INFO:teuthology.orchestra.run.smithi184.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 1.0 MB/s | 107 kB 00:00 2024-09-21T21:57:57.046 INFO:teuthology.orchestra.run.smithi184.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-21T21:57:57.071 INFO:teuthology.orchestra.run.smithi184.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-21T21:57:57.113 INFO:teuthology.orchestra.run.smithi102.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 639 kB/s | 107 kB 00:00 2024-09-21T21:57:57.130 INFO:teuthology.orchestra.run.smithi102.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-09-21T21:57:57.130 INFO:teuthology.orchestra.run.smithi184.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-21T21:57:57.163 INFO:teuthology.orchestra.run.smithi102.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 871 kB/s | 160 kB 00:00 2024-09-21T21:57:57.164 INFO:teuthology.orchestra.run.smithi184.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-21T21:57:57.181 INFO:teuthology.orchestra.run.smithi184.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 840 kB/s | 42 kB 00:00 2024-09-21T21:57:57.206 INFO:teuthology.orchestra.run.smithi184.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 5.1 MB/s | 221 kB 00:00 2024-09-21T21:57:57.213 INFO:teuthology.orchestra.run.smithi102.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-21T21:57:57.223 INFO:teuthology.orchestra.run.smithi184.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 856 kB/s | 36 kB 00:00 2024-09-21T21:57:57.240 INFO:teuthology.orchestra.run.smithi184.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-21T21:57:57.247 INFO:teuthology.orchestra.run.smithi102.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T21:57:57.297 INFO:teuthology.orchestra.run.smithi102.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-21T21:57:57.322 INFO:teuthology.orchestra.run.smithi102.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 477 kB/s | 36 kB 00:00 2024-09-21T21:57:57.324 INFO:teuthology.orchestra.run.smithi184.stdout:(22/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-21T21:57:57.349 INFO:teuthology.orchestra.run.smithi184.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T21:57:57.356 INFO:teuthology.orchestra.run.smithi102.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-21T21:57:57.374 INFO:teuthology.orchestra.run.smithi184.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T21:57:57.382 INFO:teuthology.orchestra.run.smithi102.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-21T21:57:57.399 INFO:teuthology.orchestra.run.smithi184.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T21:57:57.440 INFO:teuthology.orchestra.run.smithi102.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 592 kB/s | 26 kB 00:00 2024-09-21T21:57:57.466 INFO:teuthology.orchestra.run.smithi102.stdout:(24/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-21T21:57:57.475 INFO:teuthology.orchestra.run.smithi184.stdout:(26/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T21:57:57.509 INFO:teuthology.orchestra.run.smithi184.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-21T21:57:57.549 INFO:teuthology.orchestra.run.smithi102.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2024-09-21T21:57:57.574 INFO:teuthology.orchestra.run.smithi102.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 622 kB/s | 67 kB 00:00 2024-09-21T21:57:57.616 INFO:teuthology.orchestra.run.smithi102.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T21:57:57.667 INFO:teuthology.orchestra.run.smithi102.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-21T21:57:57.759 INFO:teuthology.orchestra.run.smithi102.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T21:57:57.776 INFO:teuthology.orchestra.run.smithi184.stdout:(28/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x 9.3 MB/s | 21 MB 00:02 2024-09-21T21:57:57.817 INFO:teuthology.orchestra.run.smithi184.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-09-21T21:57:57.851 INFO:teuthology.orchestra.run.smithi102.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-09-21T21:57:57.884 INFO:teuthology.orchestra.run.smithi184.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-09-21T21:57:58.067 INFO:teuthology.orchestra.run.smithi102.stdout:(31/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 8.5 MB/s | 3.4 MB 00:00 2024-09-21T21:57:58.076 INFO:teuthology.orchestra.run.smithi184.stdout:(31/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 12 MB/s | 3.2 MB 00:00 2024-09-21T21:57:58.117 INFO:teuthology.orchestra.run.smithi102.stdout:(32/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 8.8 MB/s | 3.2 MB 00:00 2024-09-21T21:57:58.122 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:57:58.122 INFO:teuthology.orchestra.run.smithi102.stdout:Total 18 MB/s | 60 MB 00:03 2024-09-21T21:57:58.126 INFO:teuthology.orchestra.run.smithi184.stdout:(32/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 9.8 MB/s | 3.4 MB 00:00 2024-09-21T21:57:58.131 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:57:58.131 INFO:teuthology.orchestra.run.smithi184.stdout:Total 20 MB/s | 60 MB 00:03 2024-09-21T21:57:58.225 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:57:58.232 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:57:58.261 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:57:58.261 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:57:58.268 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:57:58.268 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:57:58.944 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:57:58.944 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:57:58.976 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:57:58.977 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:58:00.399 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:58:00.444 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:58:00.482 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T21:58:00.514 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T21:58:00.518 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T21:58:00.539 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T21:58:00.557 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T21:58:00.562 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T21:58:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T21:58:00.586 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T21:58:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T21:58:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T21:58:00.781 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T21:58:00.807 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T21:58:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T21:58:00.863 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T21:58:01.193 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T21:58:01.258 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T21:58:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T21:58:01.316 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T21:58:01.392 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T21:58:01.392 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T21:58:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T21:58:01.482 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T21:58:01.509 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T21:58:01.518 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T21:58:01.579 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T21:58:01.583 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T21:58:01.617 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T21:58:01.618 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T21:58:01.661 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T21:58:01.688 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T21:58:01.731 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T21:58:01.753 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T21:58:01.783 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T21:58:01.817 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T21:58:01.820 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T21:58:01.852 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T21:58:01.885 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T21:58:01.936 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T21:58:01.960 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T21:58:01.995 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T21:58:02.035 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T21:58:02.044 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T21:58:02.085 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T21:58:02.086 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T21:58:02.113 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T21:58:02.135 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T21:58:02.154 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T21:58:02.176 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T21:58:02.205 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T21:58:02.248 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T21:58:02.467 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T21:58:02.509 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T21:58:02.560 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T21:58:02.599 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T21:58:02.601 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T21:58:02.691 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T21:58:02.728 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T21:58:02.755 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T21:58:02.767 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T21:58:02.791 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T21:58:03.249 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T21:58:03.272 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T21:58:03.279 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T21:58:03.303 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T21:58:03.351 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T21:58:03.374 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T21:58:03.429 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T21:58:03.452 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T21:58:03.480 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T21:58:03.481 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T21:58:05.759 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T21:58:05.785 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T21:58:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T21:58:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T21:58:06.366 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T21:58:06.402 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T21:58:06.405 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T21:58:06.447 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T21:58:06.492 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T21:58:06.492 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T21:58:06.492 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T21:58:06.492 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:06.536 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T21:58:06.537 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T21:58:06.537 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T21:58:06.537 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:06.540 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T21:58:06.857 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T21:58:16.923 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T21:58:16.923 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2024-09-21T21:58:16.923 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2024-09-21T21:58:16.923 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2024-09-21T21:58:16.923 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2024-09-21T21:58:16.923 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2024-09-21T21:58:16.923 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /root 2024-09-21T21:58:16.923 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2024-09-21T21:58:16.924 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:16.937 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T21:58:16.937 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-09-21T21:58:16.937 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-09-21T21:58:16.938 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-09-21T21:58:16.938 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-09-21T21:58:16.938 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-09-21T21:58:16.938 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-09-21T21:58:16.938 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-09-21T21:58:16.938 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:17.949 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T21:58:17.951 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T21:58:17.974 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T21:58:17.974 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:17.974 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T21:58:17.974 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T21:58:17.974 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T21:58:17.974 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:17.976 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T21:58:17.976 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T21:58:17.977 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:17.977 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T21:58:17.977 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T21:58:17.977 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T21:58:17.977 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:17.979 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T21:58:18.051 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T21:58:18.051 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T21:58:18.062 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T21:58:18.062 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T21:58:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T21:58:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T21:58:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T21:58:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T21:58:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T21:58:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T21:58:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T21:58:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T21:58:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T21:58:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T21:58:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T21:58:19.224 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T21:58:19.224 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T21:58:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T21:58:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T21:58:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T21:58:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T21:58:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T21:58:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T21:58:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T21:58:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T21:58:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T21:58:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T21:58:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T21:58:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T21:58:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T21:58:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T21:58:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T21:58:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T21:58:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T21:58:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T21:58:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T21:58:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T21:58:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T21:58:20.190 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T21:58:20.190 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:20.190 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-09-21T21:58:20.190 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.190 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.191 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T21:58:20.192 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T21:58:20.193 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:20.193 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:58:20.267 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T21:58:20.267 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:20.267 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-09-21T21:58:20.267 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T21:58:20.268 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T21:58:20.269 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T21:58:20.270 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T21:58:20.270 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:20.270 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:58:20.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-test 2024-09-21T21:58:20.630 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-test 2024-09-21T21:58:21.199 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:29 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:21.206 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:29 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:21.338 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:58:21.339 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:21.340 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-21T21:58:21.340 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:21.340 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 49 M 2024-09-21T21:58:21.340 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 209 M 2024-09-21T21:58:21.340 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:58:21.344 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:58:21.345 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:21.345 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-21T21:58:21.345 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:21.345 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:58:21.345 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T21:58:21.346 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-21T21:58:21.346 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T21:58:21.346 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T21:58:21.346 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T21:58:21.346 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:21.346 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:58:21.346 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:21.346 INFO:teuthology.orchestra.run.smithi184.stdout:Install 4 Packages 2024-09-21T21:58:21.346 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:21.347 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 49 M 2024-09-21T21:58:21.347 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 209 M 2024-09-21T21:58:21.347 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:58:21.808 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-21T21:58:21.814 INFO:teuthology.orchestra.run.smithi184.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-21T21:58:21.833 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 760 kB/s | 163 kB 00:00 2024-09-21T21:58:21.839 INFO:teuthology.orchestra.run.smithi184.stdout:(2/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 690 kB/s | 163 kB 00:00 2024-09-21T21:58:21.859 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T21:58:21.864 INFO:teuthology.orchestra.run.smithi184.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T21:58:23.948 INFO:teuthology.orchestra.run.smithi184.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 21 MB/s | 49 MB 00:02 2024-09-21T21:58:23.950 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:58:23.950 INFO:teuthology.orchestra.run.smithi184.stdout:Total 19 MB/s | 49 MB 00:02 2024-09-21T21:58:23.967 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 21 MB/s | 49 MB 00:02 2024-09-21T21:58:23.969 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:58:23.969 INFO:teuthology.orchestra.run.smithi102.stdout:Total 19 MB/s | 49 MB 00:02 2024-09-21T21:58:23.978 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:58:23.996 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:58:24.000 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:58:24.000 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:58:24.018 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:58:24.018 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:58:24.371 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:58:24.371 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:58:24.386 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:58:24.386 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:58:24.898 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:58:24.917 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:58:24.993 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T21:58:24.999 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T21:58:25.032 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T21:58:25.038 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T21:58:25.061 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T21:58:25.066 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T21:58:29.650 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T21:58:29.675 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T21:58:29.735 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T21:58:29.756 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T21:58:32.175 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T21:58:32.175 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T21:58:32.175 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T21:58:32.175 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T21:58:32.279 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T21:58:32.279 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T21:58:32.279 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T21:58:32.279 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T21:58:32.506 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T21:58:32.506 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:32.506 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:58:32.506 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:32.506 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:32.507 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T21:58:32.507 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T21:58:32.507 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:32.507 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:58:32.586 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T21:58:32.586 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:32.586 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:58:32.586 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:32.586 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:32.586 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T21:58:32.586 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T21:58:32.586 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:32.586 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:58:32.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph 2024-09-21T21:58:32.884 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph 2024-09-21T21:58:33.387 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:41 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:33.470 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:41 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:33.538 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:58:33.540 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:33.540 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-21T21:58:33.540 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:33.540 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T21:58:33.541 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T21:58:33.542 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T21:58:33.543 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:33.544 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:58:33.544 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:33.544 INFO:teuthology.orchestra.run.smithi184.stdout:Install 37 Packages 2024-09-21T21:58:33.544 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:33.544 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 30 M 2024-09-21T21:58:33.544 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 108 M 2024-09-21T21:58:33.545 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:58:33.606 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:58:33.609 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:33.609 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T21:58:33.609 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:33.609 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:58:33.609 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T21:58:33.609 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T21:58:33.609 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T21:58:33.609 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T21:58:33.609 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T21:58:33.610 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T21:58:33.611 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout:Install 37 Packages 2024-09-21T21:58:33.612 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:33.613 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 30 M 2024-09-21T21:58:33.613 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 108 M 2024-09-21T21:58:33.613 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:58:34.015 INFO:teuthology.orchestra.run.smithi184.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 50 kB/s | 6.6 kB 00:00 2024-09-21T21:58:34.224 INFO:teuthology.orchestra.run.smithi184.stdout:(2/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 7.0 MB/s | 2.4 MB 00:00 2024-09-21T21:58:34.266 INFO:teuthology.orchestra.run.smithi184.stdout:(3/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 4.0 MB/s | 1.5 MB 00:00 2024-09-21T21:58:34.332 INFO:teuthology.orchestra.run.smithi184.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 3.7 MB/s | 249 kB 00:00 2024-09-21T21:58:34.499 INFO:teuthology.orchestra.run.smithi184.stdout:(5/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 9.7 MB/s | 4.7 MB 00:00 2024-09-21T21:58:34.550 INFO:teuthology.orchestra.run.smithi184.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-21T21:58:34.600 INFO:teuthology.orchestra.run.smithi184.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T21:58:34.650 INFO:teuthology.orchestra.run.smithi184.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-21T21:58:34.761 INFO:teuthology.orchestra.run.smithi102.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 55 kB/s | 6.6 kB 00:00 2024-09-21T21:58:34.826 INFO:teuthology.orchestra.run.smithi184.stdout:(9/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 28 MB/s | 17 MB 00:00 2024-09-21T21:58:34.851 INFO:teuthology.orchestra.run.smithi184.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 623 kB/s | 125 kB 00:00 2024-09-21T21:58:34.951 INFO:teuthology.orchestra.run.smithi184.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 2.7 MB/s | 1.2 MB 00:00 2024-09-21T21:58:34.952 INFO:teuthology.orchestra.run.smithi102.stdout:(2/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 7.7 MB/s | 2.4 MB 00:00 2024-09-21T21:58:34.994 INFO:teuthology.orchestra.run.smithi102.stdout:(3/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 4.3 MB/s | 1.5 MB 00:00 2024-09-21T21:58:35.022 INFO:teuthology.orchestra.run.smithi184.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-21T21:58:35.047 INFO:teuthology.orchestra.run.smithi184.stdout:(13/37): python3-urllib3-1.26.5-6.el9.noarch.rp 974 kB/s | 215 kB 00:00 2024-09-21T21:58:35.069 INFO:teuthology.orchestra.run.smithi102.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 3.3 MB/s | 249 kB 00:00 2024-09-21T21:58:35.072 INFO:teuthology.orchestra.run.smithi184.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 690 kB/s | 35 kB 00:00 2024-09-21T21:58:35.097 INFO:teuthology.orchestra.run.smithi184.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-21T21:58:35.123 INFO:teuthology.orchestra.run.smithi184.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T21:58:35.148 INFO:teuthology.orchestra.run.smithi184.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-09-21T21:58:35.170 INFO:teuthology.orchestra.run.smithi102.stdout:(5/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-21T21:58:35.173 INFO:teuthology.orchestra.run.smithi184.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-09-21T21:58:35.207 INFO:teuthology.orchestra.run.smithi184.stdout:(19/37): python3-packaging-20.9-5.el9.noarch.rp 483 kB/s | 77 kB 00:00 2024-09-21T21:58:35.257 INFO:teuthology.orchestra.run.smithi184.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-21T21:58:35.274 INFO:teuthology.orchestra.run.smithi184.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-21T21:58:35.291 INFO:teuthology.orchestra.run.smithi184.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 649 kB/s | 11 kB 00:00 2024-09-21T21:58:35.308 INFO:teuthology.orchestra.run.smithi184.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-21T21:58:35.342 INFO:teuthology.orchestra.run.smithi184.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T21:58:35.358 INFO:teuthology.orchestra.run.smithi184.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-21T21:58:35.370 INFO:teuthology.orchestra.run.smithi102.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 844 kB/s | 253 kB 00:00 2024-09-21T21:58:35.375 INFO:teuthology.orchestra.run.smithi184.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 583 kB/s | 19 kB 00:00 2024-09-21T21:58:35.409 INFO:teuthology.orchestra.run.smithi184.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.3 MB/s | 358 kB 00:00 2024-09-21T21:58:35.426 INFO:teuthology.orchestra.run.smithi184.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 292 kB/s | 20 kB 00:00 2024-09-21T21:58:35.443 INFO:teuthology.orchestra.run.smithi184.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 690 kB/s | 46 kB 00:00 2024-09-21T21:58:35.468 INFO:teuthology.orchestra.run.smithi184.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-21T21:58:35.485 INFO:teuthology.orchestra.run.smithi184.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 389 kB/s | 16 kB 00:00 2024-09-21T21:58:35.511 INFO:teuthology.orchestra.run.smithi184.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-21T21:58:35.527 INFO:teuthology.orchestra.run.smithi184.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 857 kB/s | 36 kB 00:00 2024-09-21T21:58:35.546 INFO:teuthology.orchestra.run.smithi102.stdout:(7/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 28 MB/s | 17 MB 00:00 2024-09-21T21:58:35.553 INFO:teuthology.orchestra.run.smithi184.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-21T21:58:35.570 INFO:teuthology.orchestra.run.smithi102.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 533 kB/s | 106 kB 00:00 2024-09-21T21:58:35.578 INFO:teuthology.orchestra.run.smithi184.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-21T21:58:35.595 INFO:teuthology.orchestra.run.smithi184.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 479 kB/s | 20 kB 00:00 2024-09-21T21:58:35.620 INFO:teuthology.orchestra.run.smithi184.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-09-21T21:58:35.621 INFO:teuthology.orchestra.run.smithi102.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-21T21:58:35.625 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:58:35.625 INFO:teuthology.orchestra.run.smithi184.stdout:Total 15 MB/s | 30 MB 00:02 2024-09-21T21:58:35.654 INFO:teuthology.orchestra.run.smithi102.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.5 MB/s | 1.2 MB 00:00 2024-09-21T21:58:35.680 INFO:teuthology.orchestra.run.smithi102.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-21T21:58:35.713 INFO:teuthology.orchestra.run.smithi102.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 808 kB/s | 135 kB 00:00 2024-09-21T21:58:35.771 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:58:35.780 INFO:teuthology.orchestra.run.smithi102.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 523 kB/s | 35 kB 00:00 2024-09-21T21:58:35.806 INFO:teuthology.orchestra.run.smithi102.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-21T21:58:35.811 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:58:35.811 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:58:35.831 INFO:teuthology.orchestra.run.smithi102.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-21T21:58:35.856 INFO:teuthology.orchestra.run.smithi102.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-21T21:58:35.881 INFO:teuthology.orchestra.run.smithi102.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-21T21:58:35.907 INFO:teuthology.orchestra.run.smithi102.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-21T21:58:35.965 INFO:teuthology.orchestra.run.smithi102.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 746 kB/s | 43 kB 00:00 2024-09-21T21:58:35.991 INFO:teuthology.orchestra.run.smithi102.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-21T21:58:36.016 INFO:teuthology.orchestra.run.smithi102.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-09-21T21:58:36.050 INFO:teuthology.orchestra.run.smithi102.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T21:58:36.100 INFO:teuthology.orchestra.run.smithi102.stdout:(23/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-09-21T21:58:36.125 INFO:teuthology.orchestra.run.smithi102.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 98 kB/s | 11 kB 00:00 2024-09-21T21:58:36.151 INFO:teuthology.orchestra.run.smithi102.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 179 kB/s | 18 kB 00:00 2024-09-21T21:58:36.176 INFO:teuthology.orchestra.run.smithi102.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 306 kB/s | 23 kB 00:00 2024-09-21T21:58:36.201 INFO:teuthology.orchestra.run.smithi102.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-09-21T21:58:36.226 INFO:teuthology.orchestra.run.smithi102.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2024-09-21T21:58:36.251 INFO:teuthology.orchestra.run.smithi102.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-21T21:58:36.277 INFO:teuthology.orchestra.run.smithi102.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-21T21:58:36.302 INFO:teuthology.orchestra.run.smithi102.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-21T21:58:36.314 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:58:36.315 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:58:36.331 INFO:teuthology.orchestra.run.smithi102.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.6 MB/s | 90 kB 00:00 2024-09-21T21:58:36.364 INFO:teuthology.orchestra.run.smithi102.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 579 kB/s | 36 kB 00:00 2024-09-21T21:58:36.398 INFO:teuthology.orchestra.run.smithi102.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-21T21:58:36.423 INFO:teuthology.orchestra.run.smithi102.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2024-09-21T21:58:36.448 INFO:teuthology.orchestra.run.smithi102.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T21:58:36.474 INFO:teuthology.orchestra.run.smithi102.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-21T21:58:36.477 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:58:36.477 INFO:teuthology.orchestra.run.smithi102.stdout:Total 11 MB/s | 30 MB 00:02 2024-09-21T21:58:36.624 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:58:36.664 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:58:36.664 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:58:37.132 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:58:37.133 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:58:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:58:37.715 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T21:58:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T21:58:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T21:58:37.863 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T21:58:37.924 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T21:58:37.957 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T21:58:38.049 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T21:58:38.127 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T21:58:38.168 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T21:58:38.203 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T21:58:38.241 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T21:58:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T21:58:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T21:58:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T21:58:38.384 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T21:58:38.419 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T21:58:38.467 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T21:58:38.499 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T21:58:38.506 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:58:38.577 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T21:58:38.582 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T21:58:38.609 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T21:58:38.645 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T21:58:38.716 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T21:58:38.720 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T21:58:38.778 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T21:58:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T21:58:38.811 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T21:58:38.861 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T21:58:38.900 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T21:58:38.901 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T21:58:38.957 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T21:58:38.979 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T21:58:39.012 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T21:58:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T21:58:39.057 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T21:58:39.087 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T21:58:39.121 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T21:58:39.155 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T21:58:39.195 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T21:58:39.200 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T21:58:39.230 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T21:58:39.245 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T21:58:39.264 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T21:58:39.304 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T21:58:39.324 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T21:58:39.336 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T21:58:39.409 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T21:58:39.414 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T21:58:39.452 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T21:58:39.547 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T21:58:39.570 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T21:58:39.646 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T21:58:39.697 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T21:58:39.726 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T21:58:39.736 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T21:58:39.756 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T21:58:39.783 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T21:58:39.783 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:39.783 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T21:58:39.783 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T21:58:39.783 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T21:58:39.783 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:39.794 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T21:58:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T21:58:40.043 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T21:58:40.084 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T21:58:40.153 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T21:58:40.242 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T21:58:40.283 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T21:58:40.398 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T21:58:40.554 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T21:58:40.585 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T21:58:40.611 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T21:58:40.612 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:40.612 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T21:58:40.612 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T21:58:40.612 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T21:58:40.612 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T21:58:41.251 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T21:58:41.251 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:41.251 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T21:58:41.251 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T21:58:41.251 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T21:58:41.251 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:41.682 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T21:58:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T21:58:41.707 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:41.707 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T21:58:41.707 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T21:58:41.707 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T21:58:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:41.933 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T21:58:41.956 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T21:58:41.956 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T21:58:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T21:58:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T21:58:41.957 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:42.022 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T21:58:42.052 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T21:58:42.080 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T21:58:42.080 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:42.080 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T21:58:42.080 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T21:58:42.081 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T21:58:42.081 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:42.512 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T21:58:42.538 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T21:58:42.538 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:42.538 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T21:58:42.538 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T21:58:42.539 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T21:58:42.539 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:42.762 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T21:58:42.786 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T21:58:42.786 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:42.787 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T21:58:42.787 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T21:58:42.787 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T21:58:42.787 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:42.859 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T21:58:43.737 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T21:58:43.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T21:58:43.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T21:58:43.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T21:58:43.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T21:58:43.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T21:58:43.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T21:58:43.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T21:58:43.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T21:58:43.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T21:58:43.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T21:58:43.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T21:58:43.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T21:58:43.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T21:58:43.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T21:58:43.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T21:58:43.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T21:58:43.740 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T21:58:43.740 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T21:58:43.740 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T21:58:43.741 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T21:58:43.741 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T21:58:43.741 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T21:58:43.741 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T21:58:43.741 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T21:58:43.741 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T21:58:44.388 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T21:58:44.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T21:58:44.388 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T21:58:44.389 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T21:58:44.389 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T21:58:44.389 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T21:58:44.389 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T21:58:44.389 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T21:58:44.389 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T21:58:44.389 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T21:58:44.390 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T21:58:44.390 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T21:58:44.390 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T21:58:44.390 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T21:58:44.390 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T21:58:44.390 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T21:58:44.391 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T21:58:44.391 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T21:58:44.391 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T21:58:44.391 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T21:58:44.391 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T21:58:44.391 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T21:58:44.392 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T21:58:44.392 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T21:58:44.392 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T21:58:44.392 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T21:58:44.392 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T21:58:44.392 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T21:58:44.392 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T21:58:44.393 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T21:58:44.393 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T21:58:44.393 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T21:58:44.393 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T21:58:44.393 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T21:58:44.393 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T21:58:44.394 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T21:58:44.394 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T21:58:44.709 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T21:58:44.710 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T21:58:44.711 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T21:58:44.712 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T21:58:44.713 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:44.713 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:58:45.110 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-base 2024-09-21T21:58:45.489 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T21:58:45.489 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:45.489 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:58:45.489 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:45.489 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:45.489 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:45.489 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:58:45.489 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:45.489 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:45.489 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T21:58:45.490 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T21:58:45.491 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T21:58:45.492 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:45.492 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:58:45.700 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:45.789 INFO:teuthology.orchestra.run.smithi184.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:58:45.831 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:58:45.832 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-09-21T21:58:45.832 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:58:45.882 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-base 2024-09-21T21:58:45.893 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install cephadm 2024-09-21T21:58:46.469 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:46.470 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:46.560 INFO:teuthology.orchestra.run.smithi102.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:58:46.599 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:58:46.600 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:46.600 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-21T21:58:46.600 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:46.600 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:58:46.600 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T21:58:46.600 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:46.600 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:58:46.600 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:46.601 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-09-21T21:58:46.601 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:46.601 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 765 k 2024-09-21T21:58:46.601 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 772 k 2024-09-21T21:58:46.601 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:58:46.602 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:58:46.603 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-21T21:58:46.603 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:58:46.674 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install cephadm 2024-09-21T21:58:46.832 INFO:teuthology.orchestra.run.smithi184.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 3.2 MB/s | 765 kB 00:00 2024-09-21T21:58:46.832 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:58:46.833 INFO:teuthology.orchestra.run.smithi184.stdout:Total 3.2 MB/s | 765 kB 00:00 2024-09-21T21:58:46.833 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:58:46.838 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:58:46.838 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:58:46.844 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:58:46.844 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:58:46.917 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:58:47.245 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:47.334 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:58:47.375 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:58:47.376 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:47.376 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T21:58:47.376 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:47.376 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:58:47.376 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T21:58:47.377 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:47.377 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:58:47.377 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:47.377 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-21T21:58:47.377 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:47.377 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 765 k 2024-09-21T21:58:47.377 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 772 k 2024-09-21T21:58:47.377 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:58:47.435 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:58:47.645 INFO:teuthology.orchestra.run.smithi102.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-21T21:58:47.645 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:58:47.646 INFO:teuthology.orchestra.run.smithi102.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-21T21:58:47.646 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:58:47.651 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:58:47.651 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:58:47.657 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:58:47.657 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:58:47.728 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:58:47.826 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:58:48.090 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:58:48.090 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:48.090 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:58:48.090 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:58:48.090 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:48.090 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:58:48.205 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:58:48.292 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:58:48.310 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T21:58:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:58:48.907 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:48.927 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:58:48.928 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:48.928 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:58:48.928 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:58:48.928 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:48.929 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:58:49.043 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:58:49.044 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:49.044 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2024-09-21T21:58:49.044 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:49.044 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:58:49.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T21:58:49.045 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:49.045 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:58:49.045 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:49.045 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-09-21T21:58:49.045 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:49.045 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 145 k 2024-09-21T21:58:49.045 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 435 k 2024-09-21T21:58:49.046 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:58:49.119 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T21:58:49.230 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 784 kB/s | 145 kB 00:00 2024-09-21T21:58:49.230 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:58:49.230 INFO:teuthology.orchestra.run.smithi184.stdout:Total 777 kB/s | 145 kB 00:00 2024-09-21T21:58:49.231 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:58:49.238 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:58:49.238 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:58:49.294 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:58:49.295 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:58:49.453 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:58:49.539 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T21:58:49.564 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T21:58:49.565 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:49.565 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T21:58:49.565 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:49.705 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:49.838 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:58:49.839 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-21T21:58:49.839 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:49.839 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:58:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T21:58:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:49.840 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:58:49.840 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:49.840 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-21T21:58:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:49.840 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 145 k 2024-09-21T21:58:49.840 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 435 k 2024-09-21T21:58:49.840 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:58:50.061 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 655 kB/s | 145 kB 00:00 2024-09-21T21:58:50.062 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:58:50.062 INFO:teuthology.orchestra.run.smithi102.stdout:Total 650 kB/s | 145 kB 00:00 2024-09-21T21:58:50.063 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:58:50.070 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:58:50.070 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:58:50.127 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:58:50.127 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:58:50.296 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:58:50.363 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T21:58:50.387 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T21:58:50.388 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:58:50.388 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T21:58:50.388 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:50.447 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T21:58:50.447 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:50.447 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:58:50.447 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:50.447 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:50.447 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:58:50.699 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr 2024-09-21T21:58:51.291 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:51.304 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T21:58:51.304 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:51.304 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:58:51.304 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:58:51.304 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:51.304 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:58:51.382 INFO:teuthology.orchestra.run.smithi184.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:58:51.424 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:58:51.425 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-09-21T21:58:51.425 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:58:51.502 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T21:58:51.570 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr 2024-09-21T21:58:52.083 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:52.158 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:52.214 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:58:52.218 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:52.218 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-21T21:58:52.218 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:52.218 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:58:52.218 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T21:58:52.218 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-21T21:58:52.218 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T21:58:52.218 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout:Install 12 Packages 2024-09-21T21:58:52.219 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:52.220 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 8.7 M 2024-09-21T21:58:52.220 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 105 M 2024-09-21T21:58:52.220 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:58:52.249 INFO:teuthology.orchestra.run.smithi102.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:58:52.291 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:58:52.292 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-21T21:58:52.292 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:58:52.361 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T21:58:52.741 INFO:teuthology.orchestra.run.smithi184.stdout:(1/12): ceph-prometheus-alerts-19.1.1-373.g4e45 100 kB/s | 16 kB 00:00 2024-09-21T21:58:52.767 INFO:teuthology.orchestra.run.smithi184.stdout:(2/12): ceph-grafana-dashboards-19.1.1-373.g4e4 167 kB/s | 32 kB 00:00 2024-09-21T21:58:52.940 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:52.958 INFO:teuthology.orchestra.run.smithi184.stdout:(3/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 9.3 MB/s | 3.6 MB 00:00 2024-09-21T21:58:52.984 INFO:teuthology.orchestra.run.smithi184.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-09-21T21:58:53.051 INFO:teuthology.orchestra.run.smithi184.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 8.0 MB/s | 548 kB 00:00 2024-09-21T21:58:53.073 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:58:53.074 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:53.074 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T21:58:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T21:58:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T21:58:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T21:58:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T21:58:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:53.076 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:58:53.076 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:58:53.076 INFO:teuthology.orchestra.run.smithi102.stdout:Install 12 Packages 2024-09-21T21:58:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:53.077 INFO:teuthology.orchestra.run.smithi184.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-21T21:58:53.077 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 8.7 M 2024-09-21T21:58:53.077 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 105 M 2024-09-21T21:58:53.077 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:58:53.110 INFO:teuthology.orchestra.run.smithi184.stdout:(7/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-09-21T21:58:53.160 INFO:teuthology.orchestra.run.smithi184.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.8 MB/s | 144 kB 00:00 2024-09-21T21:58:53.185 INFO:teuthology.orchestra.run.smithi184.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T21:58:53.219 INFO:teuthology.orchestra.run.smithi184.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-21T21:58:53.252 INFO:teuthology.orchestra.run.smithi184.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.9 MB/s | 863 kB 00:00 2024-09-21T21:58:53.302 INFO:teuthology.orchestra.run.smithi184.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.0 MB/s | 2.0 MB 00:00 2024-09-21T21:58:53.306 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:58:53.306 INFO:teuthology.orchestra.run.smithi184.stdout:Total 8.0 MB/s | 8.7 MB 00:01 2024-09-21T21:58:53.355 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:58:53.372 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:58:53.372 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:58:53.575 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:58:53.575 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:58:53.965 INFO:teuthology.orchestra.run.smithi102.stdout:(1/12): ceph-grafana-dashboards-19.1.1-373.g4e4 227 kB/s | 32 kB 00:00 2024-09-21T21:58:53.990 INFO:teuthology.orchestra.run.smithi102.stdout:(2/12): ceph-prometheus-alerts-19.1.1-373.g4e45 99 kB/s | 16 kB 00:00 2024-09-21T21:58:54.111 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:58:54.124 INFO:teuthology.orchestra.run.smithi102.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-21T21:58:54.178 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T21:58:54.216 INFO:teuthology.orchestra.run.smithi102.stdout:(4/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 9.1 MB/s | 3.6 MB 00:00 2024-09-21T21:58:54.222 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T21:58:54.250 INFO:teuthology.orchestra.run.smithi102.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.6 MB/s | 1.0 MB 00:00 2024-09-21T21:58:54.276 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T21:58:54.300 INFO:teuthology.orchestra.run.smithi102.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 454 kB/s | 19 kB 00:00 2024-09-21T21:58:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T21:58:54.342 INFO:teuthology.orchestra.run.smithi102.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.3 MB/s | 548 kB 00:00 2024-09-21T21:58:54.376 INFO:teuthology.orchestra.run.smithi102.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-21T21:58:54.401 INFO:teuthology.orchestra.run.smithi102.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T21:58:54.416 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T21:58:54.443 INFO:teuthology.orchestra.run.smithi102.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-21T21:58:54.543 INFO:teuthology.orchestra.run.smithi102.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.4 MB/s | 2.0 MB 00:00 2024-09-21T21:58:54.550 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T21:58:54.577 INFO:teuthology.orchestra.run.smithi102.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.9 MB/s | 863 kB 00:00 2024-09-21T21:58:54.581 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:58:54.581 INFO:teuthology.orchestra.run.smithi102.stdout:Total 5.8 MB/s | 8.7 MB 00:01 2024-09-21T21:58:54.633 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:58:54.651 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:58:54.651 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:58:54.652 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T21:58:54.712 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T21:58:54.740 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T21:58:54.772 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T21:58:54.852 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:58:54.853 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:58:55.384 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:58:55.460 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T21:58:55.496 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T21:58:55.542 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T21:58:55.581 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T21:58:55.689 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T21:58:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T21:58:55.827 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T21:58:55.864 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T21:58:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T21:58:55.953 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T21:58:55.981 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T21:58:56.012 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T21:58:57.072 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T21:58:57.105 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T21:58:57.254 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T21:58:57.254 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T21:58:57.254 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T21:58:57.254 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T21:58:57.254 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T21:58:57.255 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T21:58:57.255 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T21:58:57.255 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T21:58:57.255 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T21:58:57.255 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T21:58:57.255 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T21:58:57.255 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T21:58:57.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T21:58:57.587 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:57.587 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:57.588 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:58:57.858 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T21:58:58.275 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T21:58:58.275 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T21:58:58.275 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T21:58:58.275 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T21:58:58.275 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T21:58:58.275 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T21:58:58.275 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T21:58:58.275 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T21:58:58.276 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T21:58:58.276 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T21:58:58.276 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T21:58:58.276 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T21:58:58.438 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:06 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:58.571 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:58:58.572 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-09-21T21:58:58.572 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-21T21:58:58.572 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-09-21T21:58:58.572 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:58:58.572 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T21:58:58.572 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-21T21:58:58.572 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T21:58:58.572 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T21:58:58.572 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout:Install 12 Packages 2024-09-21T21:58:58.573 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:58:58.574 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 38 M 2024-09-21T21:58:58.574 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 212 M 2024-09-21T21:58:58.574 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:58:58.585 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T21:58:58.585 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:58.585 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:58:58.585 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T21:58:58.585 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:58:58.585 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:58.586 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:58:58.823 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T21:58:59.400 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:07 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:58:59.435 INFO:teuthology.orchestra.run.smithi184.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-37 16 MB/s | 7.4 MB 00:00 2024-09-21T21:58:59.502 INFO:teuthology.orchestra.run.smithi184.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 493 kB/s | 33 kB 00:00 2024-09-21T21:58:59.527 INFO:teuthology.orchestra.run.smithi184.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 348 kB/s | 191 kB 00:00 2024-09-21T21:58:59.533 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T21:58:59.535 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T21:58:59.536 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T21:58:59.536 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T21:58:59.536 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T21:58:59.536 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T21:58:59.536 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T21:58:59.536 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:59.536 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:58:59.536 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-21T21:58:59.536 INFO:teuthology.orchestra.run.smithi102.stdout:Install 12 Packages 2024-09-21T21:58:59.536 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:58:59.537 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 38 M 2024-09-21T21:58:59.537 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 212 M 2024-09-21T21:58:59.537 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:58:59.594 INFO:teuthology.orchestra.run.smithi184.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 274 kB/s | 18 kB 00:00 2024-09-21T21:58:59.644 INFO:teuthology.orchestra.run.smithi184.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-21T21:58:59.828 INFO:teuthology.orchestra.run.smithi184.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 943 kB/s | 801 kB 00:00 2024-09-21T21:58:59.962 INFO:teuthology.orchestra.run.smithi184.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-21T21:59:00.037 INFO:teuthology.orchestra.run.smithi184.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.6 MB/s | 3.0 MB 00:00 2024-09-21T21:59:00.051 INFO:teuthology.orchestra.run.smithi102.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-21T21:59:00.093 INFO:teuthology.orchestra.run.smithi102.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.8 MB/s | 801 kB 00:00 2024-09-21T21:59:00.112 INFO:teuthology.orchestra.run.smithi184.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 11 MB/s | 4.9 MB 00:00 2024-09-21T21:59:00.137 INFO:teuthology.orchestra.run.smithi184.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.5 MB/s | 250 kB 00:00 2024-09-21T21:59:00.152 INFO:teuthology.orchestra.run.smithi102.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-21T21:59:00.219 INFO:teuthology.orchestra.run.smithi102.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 273 kB/s | 18 kB 00:00 2024-09-21T21:59:00.278 INFO:teuthology.orchestra.run.smithi102.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-09-21T21:59:00.303 INFO:teuthology.orchestra.run.smithi102.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-21T21:59:00.438 INFO:teuthology.orchestra.run.smithi184.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2024-09-21T21:59:00.445 INFO:teuthology.orchestra.run.smithi102.stdout:(7/12): ceph-mgr-diskprediction-local-19.1.1-37 14 MB/s | 7.4 MB 00:00 2024-09-21T21:59:00.478 INFO:teuthology.orchestra.run.smithi102.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-21T21:59:00.505 INFO:teuthology.orchestra.run.smithi184.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.4 MB/s | 5.1 MB 00:00 2024-09-21T21:59:00.505 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:00.505 INFO:teuthology.orchestra.run.smithi184.stdout:Total 20 MB/s | 38 MB 00:01 2024-09-21T21:59:00.545 INFO:teuthology.orchestra.run.smithi102.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 18 MB/s | 4.9 MB 00:00 2024-09-21T21:59:00.570 INFO:teuthology.orchestra.run.smithi102.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-21T21:59:00.787 INFO:teuthology.orchestra.run.smithi102.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-21T21:59:00.860 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:59:00.887 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:59:00.887 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:59:01.029 INFO:teuthology.orchestra.run.smithi102.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-21T21:59:01.030 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:01.031 INFO:teuthology.orchestra.run.smithi102.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-21T21:59:01.324 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:59:01.324 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:59:01.387 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:59:01.414 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:59:01.414 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:59:01.835 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:59:01.835 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:59:02.082 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:59:02.146 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T21:59:02.186 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T21:59:02.292 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T21:59:02.329 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T21:59:02.513 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T21:59:02.544 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T21:59:02.619 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:59:02.620 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T21:59:02.684 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T21:59:02.719 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T21:59:02.818 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T21:59:02.853 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T21:59:03.038 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T21:59:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T21:59:03.144 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T21:59:03.280 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T21:59:03.416 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T21:59:03.808 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T21:59:03.923 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T21:59:04.633 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T21:59:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T21:59:05.666 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T21:59:05.702 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T21:59:06.230 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T21:59:06.260 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T21:59:08.396 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T21:59:08.396 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T21:59:08.396 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T21:59:08.396 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T21:59:08.396 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T21:59:08.396 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T21:59:08.396 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T21:59:08.396 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T21:59:08.396 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T21:59:08.396 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T21:59:08.397 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T21:59:08.397 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T21:59:08.770 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T21:59:08.770 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:08.770 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:59:08.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:59:08.770 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:08.771 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T21:59:08.944 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T21:59:09.172 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-rook 2024-09-21T21:59:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T21:59:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:09.312 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:59:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:59:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T21:59:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T21:59:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T21:59:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T21:59:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T21:59:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T21:59:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T21:59:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T21:59:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T21:59:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T21:59:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T21:59:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:09.313 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:09.678 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-rook 2024-09-21T21:59:09.769 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:17 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:09.902 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:09.902 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T21:59:09.903 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout:Install 13 Packages 2024-09-21T21:59:09.904 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:09.905 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 2.2 M 2024-09-21T21:59:09.905 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 26 M 2024-09-21T21:59:09.905 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:59:10.136 INFO:teuthology.orchestra.run.smithi184.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 223 kB/s | 19 kB 00:00 2024-09-21T21:59:10.161 INFO:teuthology.orchestra.run.smithi184.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 230 kB/s | 26 kB 00:00 2024-09-21T21:59:10.220 INFO:teuthology.orchestra.run.smithi184.stdout:(3/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 290 kB/s | 49 kB 00:00 2024-09-21T21:59:10.245 INFO:teuthology.orchestra.run.smithi184.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-21T21:59:10.271 INFO:teuthology.orchestra.run.smithi184.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-21T21:59:10.276 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:18 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:10.296 INFO:teuthology.orchestra.run.smithi184.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T21:59:10.338 INFO:teuthology.orchestra.run.smithi184.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-21T21:59:10.363 INFO:teuthology.orchestra.run.smithi184.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-21T21:59:10.389 INFO:teuthology.orchestra.run.smithi184.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-09-21T21:59:10.411 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:10.412 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T21:59:10.412 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:10.412 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:59:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T21:59:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:10.414 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:59:10.414 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:10.414 INFO:teuthology.orchestra.run.smithi102.stdout:Install 13 Packages 2024-09-21T21:59:10.414 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:10.414 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 2.2 M 2024-09-21T21:59:10.414 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 26 M 2024-09-21T21:59:10.414 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:59:10.422 INFO:teuthology.orchestra.run.smithi184.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-21T21:59:10.456 INFO:teuthology.orchestra.run.smithi184.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.4 MB/s | 90 kB 00:00 2024-09-21T21:59:10.481 INFO:teuthology.orchestra.run.smithi184.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 641 kB/s | 59 kB 00:00 2024-09-21T21:59:10.514 INFO:teuthology.orchestra.run.smithi184.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-21T21:59:10.517 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:10.517 INFO:teuthology.orchestra.run.smithi184.stdout:Total 3.6 MB/s | 2.2 MB 00:00 2024-09-21T21:59:10.580 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:59:10.595 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:59:10.595 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:59:10.687 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:59:10.690 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:59:10.970 INFO:teuthology.orchestra.run.smithi102.stdout:(1/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 307 kB/s | 49 kB 00:00 2024-09-21T21:59:11.095 INFO:teuthology.orchestra.run.smithi102.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 90 kB/s | 26 kB 00:00 2024-09-21T21:59:11.112 INFO:teuthology.orchestra.run.smithi102.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 63 kB/s | 19 kB 00:00 2024-09-21T21:59:11.231 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:59:11.403 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T21:59:11.458 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T21:59:11.487 INFO:teuthology.orchestra.run.smithi102.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 405 kB/s | 159 kB 00:00 2024-09-21T21:59:11.512 INFO:teuthology.orchestra.run.smithi102.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 409 kB/s | 222 kB 00:00 2024-09-21T21:59:11.529 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T21:59:11.554 INFO:teuthology.orchestra.run.smithi102.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 773 kB/s | 32 kB 00:00 2024-09-21T21:59:11.566 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T21:59:11.579 INFO:teuthology.orchestra.run.smithi102.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 597 kB/s | 279 kB 00:00 2024-09-21T21:59:11.605 INFO:teuthology.orchestra.run.smithi102.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 280 kB/s | 14 kB 00:00 2024-09-21T21:59:11.608 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T21:59:11.638 INFO:teuthology.orchestra.run.smithi102.stdout:(9/13): python3-requests-oauthlib-1.3.0-12.el9. 355 kB/s | 54 kB 00:00 2024-09-21T21:59:11.689 INFO:teuthology.orchestra.run.smithi102.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-21T21:59:11.710 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T21:59:11.714 INFO:teuthology.orchestra.run.smithi102.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 804 kB/s | 59 kB 00:00 2024-09-21T21:59:11.739 INFO:teuthology.orchestra.run.smithi102.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-21T21:59:11.781 INFO:teuthology.orchestra.run.smithi102.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.0 MB/s | 1.0 MB 00:00 2024-09-21T21:59:11.783 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:11.784 INFO:teuthology.orchestra.run.smithi102.stdout:Total 1.6 MB/s | 2.2 MB 00:01 2024-09-21T21:59:11.813 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T21:59:11.848 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:59:11.862 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:59:11.863 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:59:11.868 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T21:59:11.951 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:59:11.953 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:59:12.456 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:59:12.599 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T21:59:12.628 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T21:59:12.649 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T21:59:12.682 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T21:59:12.690 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T21:59:12.731 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T21:59:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T21:59:12.761 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T21:59:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T21:59:12.816 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T21:59:12.919 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T21:59:13.019 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T21:59:13.068 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T21:59:13.566 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T21:59:13.566 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T21:59:13.566 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T21:59:13.566 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T21:59:13.567 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T21:59:13.567 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T21:59:13.567 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T21:59:13.567 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T21:59:13.567 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T21:59:13.567 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T21:59:13.567 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T21:59:13.567 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T21:59:13.567 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T21:59:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T21:59:13.823 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T21:59:13.857 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T21:59:13.882 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T21:59:13.882 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:13.882 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:59:13.882 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:59:13.882 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:13.883 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:13.905 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T21:59:13.927 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T21:59:14.154 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T21:59:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T21:59:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T21:59:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T21:59:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T21:59:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T21:59:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T21:59:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T21:59:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T21:59:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T21:59:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T21:59:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T21:59:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T21:59:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T21:59:14.742 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:22 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:14.875 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:14.875 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:14.875 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-21T21:59:14.875 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout:Install 6 Packages 2024-09-21T21:59:14.876 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:14.877 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 7.0 M 2024-09-21T21:59:14.877 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 33 M 2024-09-21T21:59:14.877 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:59:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T21:59:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T21:59:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T21:59:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T21:59:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T21:59:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T21:59:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:15.060 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:15.184 INFO:teuthology.orchestra.run.smithi184.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-21T21:59:15.209 INFO:teuthology.orchestra.run.smithi184.stdout:(2/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 658 kB/s | 146 kB 00:00 2024-09-21T21:59:15.259 INFO:teuthology.orchestra.run.smithi184.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T21:59:15.284 INFO:teuthology.orchestra.run.smithi184.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.3 MB/s | 548 kB 00:00 2024-09-21T21:59:15.309 INFO:teuthology.orchestra.run.smithi184.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-21T21:59:15.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T21:59:15.501 INFO:teuthology.orchestra.run.smithi184.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-21T21:59:15.504 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:15.504 INFO:teuthology.orchestra.run.smithi184.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-21T21:59:15.575 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:59:15.586 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:59:15.586 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:59:15.686 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:59:15.687 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:59:15.897 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:23 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:16.008 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:59:16.030 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:16.031 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T21:59:16.031 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:16.031 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:59:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T21:59:16.031 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T21:59:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T21:59:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T21:59:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T21:59:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T21:59:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T21:59:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:16.032 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:59:16.032 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:16.032 INFO:teuthology.orchestra.run.smithi102.stdout:Install 6 Packages 2024-09-21T21:59:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:16.033 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 7.0 M 2024-09-21T21:59:16.033 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 33 M 2024-09-21T21:59:16.033 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:59:16.183 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T21:59:16.245 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T21:59:16.558 INFO:teuthology.orchestra.run.smithi102.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-21T21:59:16.625 INFO:teuthology.orchestra.run.smithi102.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.0 MB/s | 548 kB 00:00 2024-09-21T21:59:16.650 INFO:teuthology.orchestra.run.smithi102.stdout:(3/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 647 kB/s | 146 kB 00:00 2024-09-21T21:59:16.675 INFO:teuthology.orchestra.run.smithi102.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T21:59:16.726 INFO:teuthology.orchestra.run.smithi102.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 993 kB/s | 74 kB 00:00 2024-09-21T21:59:16.775 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T21:59:16.801 INFO:teuthology.orchestra.run.smithi102.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-21T21:59:16.803 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:16.804 INFO:teuthology.orchestra.run.smithi102.stdout:Total 9.1 MB/s | 7.0 MB 00:00 2024-09-21T21:59:16.856 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T21:59:16.873 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:59:16.884 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:59:16.884 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:59:16.929 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T21:59:16.965 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T21:59:16.984 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:59:16.985 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:59:17.296 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:59:17.449 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T21:59:17.503 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T21:59:17.772 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T21:59:17.773 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T21:59:17.773 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T21:59:17.773 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T21:59:17.773 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T21:59:17.773 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T21:59:18.026 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T21:59:18.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T21:59:18.048 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:18.048 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:59:18.048 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:59:18.048 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T21:59:18.048 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T21:59:18.048 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T21:59:18.049 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T21:59:18.049 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T21:59:18.049 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:18.049 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:18.105 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T21:59:18.168 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T21:59:18.199 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T21:59:18.350 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-fuse 2024-09-21T21:59:18.934 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:26 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:18.980 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T21:59:18.980 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T21:59:18.980 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T21:59:18.980 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T21:59:18.981 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T21:59:18.981 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T21:59:19.066 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:19.067 INFO:teuthology.orchestra.run.smithi184.stdout:Install 2 Packages 2024-09-21T21:59:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:19.068 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 976 k 2024-09-21T21:59:19.068 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 2.9 M 2024-09-21T21:59:19.068 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:59:19.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T21:59:19.249 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:59:19.249 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:59:19.249 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T21:59:19.249 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T21:59:19.249 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T21:59:19.249 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T21:59:19.250 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T21:59:19.250 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:19.462 INFO:teuthology.orchestra.run.smithi184.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 686 kB/s | 80 kB 00:00 2024-09-21T21:59:19.489 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-fuse 2024-09-21T21:59:19.620 INFO:teuthology.orchestra.run.smithi184.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.2 MB/s | 897 kB 00:00 2024-09-21T21:59:19.621 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:19.621 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.7 MB/s | 976 kB 00:00 2024-09-21T21:59:19.633 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:59:19.655 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:59:19.655 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:59:19.737 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:59:19.737 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:59:19.942 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:59:20.064 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:28 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:20.090 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T21:59:20.161 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T21:59:20.195 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:20.196 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:20.196 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T21:59:20.196 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:20.196 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:59:20.196 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T21:59:20.196 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T21:59:20.196 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T21:59:20.196 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:20.197 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:59:20.197 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:20.197 INFO:teuthology.orchestra.run.smithi102.stdout:Install 2 Packages 2024-09-21T21:59:20.197 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:20.197 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 976 k 2024-09-21T21:59:20.197 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 2.9 M 2024-09-21T21:59:20.197 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:59:20.362 INFO:teuthology.orchestra.run.smithi102.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 555 kB/s | 80 kB 00:00 2024-09-21T21:59:20.487 INFO:teuthology.orchestra.run.smithi102.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.3 MB/s | 897 kB 00:00 2024-09-21T21:59:20.487 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:20.488 INFO:teuthology.orchestra.run.smithi102.stdout:Total 3.3 MB/s | 976 kB 00:00 2024-09-21T21:59:20.499 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:59:20.520 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:59:20.520 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:59:20.600 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:59:20.601 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:59:20.794 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:59:20.834 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T21:59:20.834 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T21:59:20.938 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T21:59:21.002 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T21:59:21.142 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T21:59:21.142 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:21.142 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:59:21.143 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T21:59:21.143 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:21.143 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:21.563 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-volume 2024-09-21T21:59:21.658 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T21:59:21.658 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T21:59:21.958 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T21:59:21.958 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:21.958 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:59:21.959 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T21:59:21.959 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:21.959 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:22.155 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:22.291 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-volume 2024-09-21T21:59:22.292 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:22.292 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:22.292 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-21T21:59:22.292 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:22.292 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:59:22.292 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 285 k 2024-09-21T21:59:22.292 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:22.292 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:59:22.292 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:22.293 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-09-21T21:59:22.293 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:22.293 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 285 k 2024-09-21T21:59:22.293 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 1.3 M 2024-09-21T21:59:22.293 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:59:22.500 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-volume-19.1.1-373.g4e45e6b4.el9.noarch.rpm 1.3 MB/s | 285 kB 00:00 2024-09-21T21:59:22.500 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:22.500 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-21T21:59:22.500 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:59:22.509 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:59:22.509 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:59:22.538 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:59:22.538 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:59:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:59:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:59:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:59:22.835 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:59:22.835 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T21:59:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:22.887 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:23.017 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:23.018 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T21:59:23.018 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:23.019 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:59:23.019 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 285 k 2024-09-21T21:59:23.019 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:23.019 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:59:23.019 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:23.019 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-21T21:59:23.019 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:23.019 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 285 k 2024-09-21T21:59:23.019 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 1.3 M 2024-09-21T21:59:23.019 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:59:23.241 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-volume-19.1.1-373.g4e45e6b4.el9.noarch.rpm 1.3 MB/s | 285 kB 00:00 2024-09-21T21:59:23.241 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:23.242 INFO:teuthology.orchestra.run.smithi102.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-21T21:59:23.242 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:59:23.250 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:59:23.250 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:59:23.275 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:59:23.276 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:59:23.502 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:59:23.568 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:59:23.584 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:59:23.584 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:59:23.584 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T21:59:23.584 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:23.837 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:59:23.837 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:23.838 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:59:23.838 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:59:23.838 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:23.838 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:24.141 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados-devel 2024-09-21T21:59:24.575 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T21:59:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:24.576 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:59:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T21:59:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:24.576 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:24.740 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:32 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:24.857 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librados-devel 2024-09-21T21:59:24.874 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:24.874 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:24.875 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2024-09-21T21:59:24.875 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:24.875 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:59:24.875 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T21:59:24.875 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:24.875 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:59:24.875 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:24.875 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-09-21T21:59:24.875 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:24.876 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 127 k 2024-09-21T21:59:24.876 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 456 k 2024-09-21T21:59:24.876 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:59:25.087 INFO:teuthology.orchestra.run.smithi184.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 599 kB/s | 127 kB 00:00 2024-09-21T21:59:25.088 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:25.088 INFO:teuthology.orchestra.run.smithi184.stdout:Total 594 kB/s | 127 kB 00:00 2024-09-21T21:59:25.088 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:59:25.094 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:59:25.094 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:59:25.156 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:59:25.157 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:59:25.314 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:59:25.418 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:25.447 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:25.584 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:25.584 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-21T21:59:25.584 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:25.584 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:59:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T21:59:25.584 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:25.585 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:59:25.585 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:25.585 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-21T21:59:25.585 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:25.585 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 127 k 2024-09-21T21:59:25.586 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 456 k 2024-09-21T21:59:25.586 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:59:25.772 INFO:teuthology.orchestra.run.smithi102.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 681 kB/s | 127 kB 00:00 2024-09-21T21:59:25.772 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:25.772 INFO:teuthology.orchestra.run.smithi102.stdout:Total 675 kB/s | 127 kB 00:00 2024-09-21T21:59:25.772 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:59:25.778 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:59:25.778 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:59:25.840 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:59:25.841 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:59:25.864 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:25.993 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:59:26.102 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:26.112 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:26.112 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:26.113 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:59:26.113 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:59:26.113 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:26.113 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:26.346 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install libcephfs2 2024-09-21T21:59:26.518 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:26.757 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:26.757 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:26.757 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:59:26.758 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:59:26.758 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:26.758 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:26.948 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:26.982 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install libcephfs2 2024-09-21T21:59:27.042 INFO:teuthology.orchestra.run.smithi184.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:27.089 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:27.090 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-09-21T21:59:27.090 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:27.153 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install libcephfs-devel 2024-09-21T21:59:27.565 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:27.653 INFO:teuthology.orchestra.run.smithi102.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:27.697 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:27.698 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-21T21:59:27.698 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:27.736 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:27.791 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install libcephfs-devel 2024-09-21T21:59:27.869 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:27.870 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:27.870 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2024-09-21T21:59:27.870 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:27.870 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:59:27.870 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T21:59:27.870 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:27.870 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:59:27.871 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:27.871 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-09-21T21:59:27.871 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:27.871 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 32 k 2024-09-21T21:59:27.871 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 142 k 2024-09-21T21:59:27.871 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:59:28.016 INFO:teuthology.orchestra.run.smithi184.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 219 kB/s | 32 kB 00:00 2024-09-21T21:59:28.016 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:28.017 INFO:teuthology.orchestra.run.smithi184.stdout:Total 217 kB/s | 32 kB 00:00 2024-09-21T21:59:28.017 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:59:28.020 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:59:28.020 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:59:28.034 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:59:28.035 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:59:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:59:28.212 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:28.376 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:28.509 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:28.509 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 32 k 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 142 k 2024-09-21T21:59:28.510 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:59:28.578 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:28.659 INFO:teuthology.orchestra.run.smithi102.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 214 kB/s | 32 kB 00:00 2024-09-21T21:59:28.659 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:28.659 INFO:teuthology.orchestra.run.smithi102.stdout:Total 212 kB/s | 32 kB 00:00 2024-09-21T21:59:28.660 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:59:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:59:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:59:28.677 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:59:28.677 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:59:28.767 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:59:28.802 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:28.802 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:28.802 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:59:28.803 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:59:28.803 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:28.803 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:28.864 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:28.988 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados2 2024-09-21T21:59:29.221 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:29.481 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:29.481 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:29.481 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:59:29.481 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:59:29.481 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:29.481 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:29.564 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:29.654 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:29.671 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librados2 2024-09-21T21:59:29.698 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:29.699 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-09-21T21:59:29.699 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:29.764 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librbd1 2024-09-21T21:59:30.242 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:30.330 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:30.344 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:30.373 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:30.374 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-21T21:59:30.374 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:30.432 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:30.446 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librbd1 2024-09-21T21:59:30.476 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:30.477 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-09-21T21:59:30.477 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:30.535 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rados 2024-09-21T21:59:31.026 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:31.113 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:31.115 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:31.158 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:31.159 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-21T21:59:31.159 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:31.201 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:31.229 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rados 2024-09-21T21:59:31.244 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:31.245 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-09-21T21:59:31.245 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:31.307 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rgw 2024-09-21T21:59:31.810 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:31.899 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:31.941 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:31.943 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-21T21:59:31.943 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:31.970 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:32.012 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rgw 2024-09-21T21:59:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-09-21T21:59:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:32.079 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-cephfs 2024-09-21T21:59:32.590 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:32.661 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:32.677 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:32.719 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:32.720 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-21T21:59:32.721 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:32.750 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:32.787 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-cephfs 2024-09-21T21:59:32.794 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:32.795 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-09-21T21:59:32.795 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:32.867 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rbd 2024-09-21T21:59:33.370 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:33.461 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:33.461 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:33.504 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:33.505 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-21T21:59:33.505 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:33.550 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:33.582 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rbd 2024-09-21T21:59:33.593 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:33.594 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-09-21T21:59:33.594 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:33.668 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-fuse 2024-09-21T21:59:34.158 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:34.245 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T21:59:34.249 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:34.288 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:34.289 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-21T21:59:34.289 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:34.354 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-fuse 2024-09-21T21:59:34.382 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:34.383 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:34.383 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-09-21T21:59:34.383 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:34.384 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:59:34.384 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T21:59:34.384 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:34.384 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:59:34.384 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:34.384 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-09-21T21:59:34.384 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:34.384 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 85 k 2024-09-21T21:59:34.384 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 231 k 2024-09-21T21:59:34.384 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:59:34.595 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 404 kB/s | 85 kB 00:00 2024-09-21T21:59:34.596 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:34.596 INFO:teuthology.orchestra.run.smithi184.stdout:Total 402 kB/s | 85 kB 00:00 2024-09-21T21:59:34.596 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:59:34.603 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:59:34.603 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:59:34.665 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:59:34.666 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:59:34.817 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:59:34.916 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:34.931 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:35.061 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:35.062 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:35.062 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-21T21:59:35.062 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:35.062 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:59:35.062 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T21:59:35.062 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:35.062 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:59:35.062 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:35.062 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-21T21:59:35.062 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:35.063 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 85 k 2024-09-21T21:59:35.063 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 231 k 2024-09-21T21:59:35.063 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:59:35.254 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 448 kB/s | 85 kB 00:00 2024-09-21T21:59:35.254 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:35.255 INFO:teuthology.orchestra.run.smithi102.stdout:Total 444 kB/s | 85 kB 00:00 2024-09-21T21:59:35.255 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:59:35.262 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:59:35.262 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:59:35.318 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:35.325 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:59:35.326 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:59:35.479 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:59:35.555 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:35.555 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:35.555 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:59:35.555 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:59:35.555 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:35.555 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:35.592 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:35.809 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-mirror 2024-09-21T21:59:35.937 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:36.173 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:36.173 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:36.173 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:59:36.173 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:59:36.173 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:36.173 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:36.418 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:36.424 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-mirror 2024-09-21T21:59:36.558 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 3.1 M 2024-09-21T21:59:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 13 M 2024-09-21T21:59:36.560 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:59:36.889 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.4 MB/s | 3.1 MB 00:00 2024-09-21T21:59:36.890 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:36.890 INFO:teuthology.orchestra.run.smithi184.stdout:Total 9.4 MB/s | 3.1 MB 00:00 2024-09-21T21:59:36.890 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:59:36.905 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:59:36.905 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:59:36.997 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:59:36.997 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:59:37.043 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:37.186 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:37.187 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:37.187 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-21T21:59:37.187 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:37.187 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:59:37.187 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T21:59:37.187 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:37.187 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:59:37.187 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:37.187 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-21T21:59:37.187 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:37.188 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 3.1 M 2024-09-21T21:59:37.188 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 13 M 2024-09-21T21:59:37.188 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:59:37.431 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:59:37.490 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:37.515 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:37.515 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:59:37.515 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T21:59:37.516 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T21:59:37.516 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T21:59:37.516 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:37.516 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.5 MB/s | 3.1 MB 00:00 2024-09-21T21:59:37.517 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:37.517 INFO:teuthology.orchestra.run.smithi102.stdout:Total 9.4 MB/s | 3.1 MB 00:00 2024-09-21T21:59:37.518 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:59:37.526 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:59:37.527 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:59:37.610 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:59:37.611 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:59:38.042 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:59:38.109 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:38.135 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:38.135 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:59:38.135 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T21:59:38.135 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T21:59:38.135 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T21:59:38.136 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:38.631 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:38.631 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:38.631 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:59:38.632 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:59:38.632 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:38.632 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:38.867 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-nbd 2024-09-21T21:59:39.266 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:39.266 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:39.266 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:59:39.266 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:59:39.266 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:39.267 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:39.459 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:47 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:39.478 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-nbd 2024-09-21T21:59:39.596 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-21T21:59:39.596 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:39.597 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-09-21T21:59:39.597 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:39.597 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-21T21:59:39.597 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T21:59:39.597 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:39.597 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-21T21:59:39.597 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-09-21T21:59:39.597 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-09-21T21:59:39.597 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:39.598 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 170 k 2024-09-21T21:59:39.598 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 494 k 2024-09-21T21:59:39.598 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-21T21:59:39.809 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 809 kB/s | 170 kB 00:00 2024-09-21T21:59:39.809 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:39.809 INFO:teuthology.orchestra.run.smithi184.stdout:Total 803 kB/s | 170 kB 00:00 2024-09-21T21:59:39.810 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-21T21:59:39.817 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-21T21:59:39.817 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-21T21:59:39.883 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-21T21:59:39.883 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-21T21:59:40.032 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-21T21:59:40.074 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:48 ago on Sat 21 Sep 2024 09:57:52 PM UTC. 2024-09-21T21:59:40.148 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:40.206 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T21:59:40.207 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:40.207 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-21T21:59:40.207 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:40.207 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T21:59:40.207 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T21:59:40.207 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:40.208 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T21:59:40.208 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T21:59:40.208 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-21T21:59:40.208 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:40.208 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 170 k 2024-09-21T21:59:40.208 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 494 k 2024-09-21T21:59:40.208 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T21:59:40.420 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 804 kB/s | 170 kB 00:00 2024-09-21T21:59:40.421 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:59:40.421 INFO:teuthology.orchestra.run.smithi102.stdout:Total 798 kB/s | 170 kB 00:00 2024-09-21T21:59:40.421 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T21:59:40.428 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T21:59:40.429 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T21:59:40.492 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T21:59:40.492 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T21:59:40.573 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:40.645 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T21:59:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:40.828 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:40.828 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:40.828 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-21T21:59:40.828 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:59:40.828 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:40.828 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-21T21:59:41.070 DEBUG:teuthology.parallel:result is None 2024-09-21T21:59:41.137 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:41.385 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T21:59:41.385 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:41.386 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T21:59:41.386 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T21:59:41.386 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:41.386 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T21:59:41.631 DEBUG:teuthology.parallel:result is None 2024-09-21T21:59:41.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T21:59:41.779 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T21:59:41.800 INFO:teuthology.orchestra.run.smithi102.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T21:59:41.800 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T21:59:41.800 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T21:59:41.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T21:59:41.942 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T21:59:42.062 INFO:teuthology.orchestra.run.smithi184.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T21:59:42.062 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T21:59:42.062 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T21:59:42.064 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T21:59:42.064 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:59:42.064 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T21:59:42.091 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T21:59:42.091 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T21:59:42.131 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T21:59:42.131 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:59:42.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T21:59:42.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T21:59:42.222 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T21:59:42.222 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T21:59:42.251 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T21:59:42.318 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T21:59:42.318 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:59:42.318 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T21:59:42.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T21:59:42.410 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T21:59:42.411 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T21:59:42.438 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T21:59:42.504 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T21:59:42.504 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:59:42.504 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T21:59:42.529 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T21:59:42.594 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T21:59:42.594 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T21:59:42.620 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T21:59:42.686 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T21:59:42.807 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T21:59:42.807 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-09-21T21:59:42.809 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2024-09-21T21:59:42.836 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T21:59:42.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T21:59:42.875 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T21:59:42.901 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T21:59:42.901 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T21:59:42.940 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T21:59:42.976 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T21:59:42.977 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd clone copy on read': True}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T21:59:42.977 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450', 'branch': 'squid', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7914450', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd clone copy on read': True}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1478, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'sleep_before_teardown': 0, 'subset': '24/128', 'suite': 'rbd', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'targets': {'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPEBPGJ7DKLQUwZwP5civddLpdRnKd+Zxz8wpOl518DLgj56bw3+Odd63nsbamw8oDmXJO9eB2PnYuDInwU9cSc=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCZrtHghgB1dqhXPBcYy7Q6inhiQ8rxu89tt4a8RggsDtKDWhsJlom3UavZFTZeQlgeKMGtRBL4DtY990vCuK2I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-21_21:16:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T21:59:42.977 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T21:59:43.005 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T21:59:43.023 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T21:59:43.060 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T21:59:43.088 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:59:43.089 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T21:59:43.138 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T21:59:43.138 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-21T21:59:43.193 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T21:59:43.193 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:59:43.193 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T21:59:43.193 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:59:43.194 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:59:43.194 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-21 21:59:38.373592174 +0000 2024-09-21T21:59:43.194 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-21 21:57:13.212180555 +0000 2024-09-21T21:59:43.194 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-21 21:57:13.212180555 +0000 2024-09-21T21:59:43.194 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-21 21:57:13.212180555 +0000 2024-09-21T21:59:43.194 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T21:59:43.257 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-21T21:59:43.257 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-21T21:59:43.257 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000186677 s, 2.7 MB/s 2024-09-21T21:59:43.258 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T21:59:43.315 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-21T21:59:43.370 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T21:59:43.371 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:59:43.371 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T21:59:43.371 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:59:43.371 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:59:43.371 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-21 21:59:38.373592174 +0000 2024-09-21T21:59:43.371 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-21 21:57:13.546173643 +0000 2024-09-21T21:59:43.371 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-21 21:57:13.546173643 +0000 2024-09-21T21:59:43.371 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-21 21:57:13.546173643 +0000 2024-09-21T21:59:43.372 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T21:59:43.434 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-21T21:59:43.435 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-21T21:59:43.435 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000211416 s, 2.4 MB/s 2024-09-21T21:59:43.436 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T21:59:43.492 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-21T21:59:43.547 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T21:59:43.547 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:59:43.547 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T21:59:43.547 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:59:43.547 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:59:43.547 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-21 21:59:38.373592174 +0000 2024-09-21T21:59:43.547 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-21 21:57:13.855167249 +0000 2024-09-21T21:59:43.547 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-21 21:57:13.855167249 +0000 2024-09-21T21:59:43.547 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-21 21:57:13.855167249 +0000 2024-09-21T21:59:43.548 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T21:59:43.609 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-21T21:59:43.610 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-21T21:59:43.610 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000192742 s, 2.7 MB/s 2024-09-21T21:59:43.611 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T21:59:43.667 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-21T21:59:43.722 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T21:59:43.722 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:59:43.722 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T21:59:43.722 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:59:43.722 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:59:43.722 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-21 21:59:38.374592154 +0000 2024-09-21T21:59:43.722 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-21 21:57:14.182160482 +0000 2024-09-21T21:59:43.722 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-21 21:57:14.182160482 +0000 2024-09-21T21:59:43.723 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-21 21:57:14.182160482 +0000 2024-09-21T21:59:43.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T21:59:43.785 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-21T21:59:43.785 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-21T21:59:43.785 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000188081 s, 2.7 MB/s 2024-09-21T21:59:43.786 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T21:59:43.842 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T21:59:43.842 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T21:59:43.842 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T21:59:43.862 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T21:59:43.862 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-09-21T21:59:43.920 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T21:59:43.920 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:59:43.920 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T21:59:43.920 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:59:43.920 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:59:43.920 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-21 21:59:37.770171015 +0000 2024-09-21T21:59:43.920 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-21 21:57:13.214845838 +0000 2024-09-21T21:59:43.920 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-21 21:57:13.214845838 +0000 2024-09-21T21:59:43.920 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-21 21:57:13.214845838 +0000 2024-09-21T21:59:43.921 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T21:59:43.988 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-21T21:59:43.988 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-21T21:59:43.988 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000249476 s, 2.1 MB/s 2024-09-21T21:59:43.989 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T21:59:44.049 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-09-21T21:59:44.108 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T21:59:44.108 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:59:44.108 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T21:59:44.108 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:59:44.108 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:59:44.108 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-21 21:59:37.770171015 +0000 2024-09-21T21:59:44.108 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-21 21:57:13.541839165 +0000 2024-09-21T21:59:44.109 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-21 21:57:13.541839165 +0000 2024-09-21T21:59:44.109 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-21 21:57:13.541839165 +0000 2024-09-21T21:59:44.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T21:59:44.174 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-21T21:59:44.175 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-21T21:59:44.175 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000187882 s, 2.7 MB/s 2024-09-21T21:59:44.176 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T21:59:44.233 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-09-21T21:59:44.291 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T21:59:44.291 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:59:44.291 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T21:59:44.291 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:59:44.291 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:59:44.291 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-21 21:59:37.770171015 +0000 2024-09-21T21:59:44.291 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-21 21:57:13.864832572 +0000 2024-09-21T21:59:44.291 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-21 21:57:13.864832572 +0000 2024-09-21T21:59:44.292 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-21 21:57:13.864832572 +0000 2024-09-21T21:59:44.292 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T21:59:44.356 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-21T21:59:44.356 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-21T21:59:44.356 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000217127 s, 2.4 MB/s 2024-09-21T21:59:44.357 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T21:59:44.415 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-09-21T21:59:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T21:59:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:59:44.472 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T21:59:44.472 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:59:44.472 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:59:44.472 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-21 21:59:37.771170994 +0000 2024-09-21T21:59:44.472 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-21 21:57:14.173826265 +0000 2024-09-21T21:59:44.472 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-21 21:57:14.173826265 +0000 2024-09-21T21:59:44.472 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-21 21:57:14.173826265 +0000 2024-09-21T21:59:44.472 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T21:59:44.536 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-21T21:59:44.536 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-21T21:59:44.536 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000293163 s, 1.7 MB/s 2024-09-21T21:59:44.538 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T21:59:44.595 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T21:59:44.595 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T21:59:44.595 INFO:tasks.ceph:Generating config... 2024-09-21T21:59:44.596 INFO:tasks.ceph:[client] rbd cache = True 2024-09-21T21:59:44.596 INFO:tasks.ceph:[client] rbd clone copy on read = True 2024-09-21T21:59:44.596 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-21T21:59:44.596 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-21T21:59:44.596 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-21T21:59:44.597 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T21:59:44.597 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T21:59:44.597 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T21:59:44.597 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T21:59:44.597 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T21:59:44.597 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T21:59:44.597 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-09-21T21:59:44.597 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-21T21:59:44.597 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T21:59:44.597 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T21:59:44.597 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T21:59:44.597 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T21:59:44.597 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T21:59:44.597 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T21:59:44.598 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T21:59:44.598 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T21:59:44.598 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T21:59:44.598 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-21T21:59:44.598 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T21:59:44.598 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-21T21:59:44.598 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T21:59:44.598 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-21T21:59:44.598 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T21:59:44.598 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T21:59:44.669 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T21:59:44.671 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T21:59:44.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T21:59:44.740 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.102'), ('mon.c', '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]'), ('mon.b', '172.21.15.184')] 2024-09-21T21:59:44.740 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],172.21.15.184', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd clone copy on read': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-21T21:59:44.741 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:59:44.741 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T21:59:44.796 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.102 --addv c '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]' --add b 172.21.15.184 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:59:44.882 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:59:44.882 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: generated fsid 014f3ec5-afd0-4b18-9c74-de91f34d0760 2024-09-21T21:59:44.882 INFO:teuthology.orchestra.run.smithi102.stdout:setting min_mon_release = quincy 2024-09-21T21:59:44.882 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 0 2024-09-21T21:59:44.882 INFO:teuthology.orchestra.run.smithi102.stdout:fsid 014f3ec5-afd0-4b18-9c74-de91f34d0760 2024-09-21T21:59:44.882 INFO:teuthology.orchestra.run.smithi102.stdout:last_changed 2024-09-21T21:59:44.881649+0000 2024-09-21T21:59:44.882 INFO:teuthology.orchestra.run.smithi102.stdout:created 2024-09-21T21:59:44.881649+0000 2024-09-21T21:59:44.882 INFO:teuthology.orchestra.run.smithi102.stdout:min_mon_release 17 (quincy) 2024-09-21T21:59:44.882 INFO:teuthology.orchestra.run.smithi102.stdout:election_strategy: 1 2024-09-21T21:59:44.883 INFO:teuthology.orchestra.run.smithi102.stdout:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-21T21:59:44.883 INFO:teuthology.orchestra.run.smithi102.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-09-21T21:59:44.883 INFO:teuthology.orchestra.run.smithi102.stdout:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-21T21:59:44.883 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T21:59:44.884 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T21:59:44.899 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 014f3ec5-afd0-4b18-9c74-de91f34d0760... 2024-09-21T21:59:44.899 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T21:59:44.941 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T21:59:44.981 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-21T21:59:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-21T21:59:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T21:59:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-21T21:59:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-21T21:59:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],172.21.15.184" 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon client directed command retry = 5 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on pool no app = False 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject socket failures = 5000 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 014f3ec5-afd0-4b18-9c74-de91f34d0760 2024-09-21T21:59:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-21T21:59:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore compression algorithm = zstd 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore compression mode = aggressive 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: osd blocked scrub grace period = 3600 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-21T21:59:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: osd max markdown count = 1000 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: osd shutdown pgref assert = True 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-21T21:59:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T21:59:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T21:59:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: rbd cache = True 2024-09-21T21:59:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: rbd clone copy on read = True 2024-09-21T21:59:44.991 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-21T21:59:44.991 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-09-21T21:59:44.991 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-09-21T21:59:44.991 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2024-09-21T21:59:44.991 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2024-09-21T21:59:44.991 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T21:59:44.991 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2024-09-21T21:59:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T21:59:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],172.21.15.184" 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon client directed command retry = 5 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on pool no app = False 2024-09-21T21:59:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject socket failures = 5000 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = 014f3ec5-afd0-4b18-9c74-de91f34d0760 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2024-09-21T21:59:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug trim objects = true 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2024-09-21T21:59:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore compression algorithm = zstd 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore compression mode = aggressive 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 1/20 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 1/20 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 4/10 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: osd blocked scrub grace period = 3600 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: osd max markdown count = 1000 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2024-09-21T21:59:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: osd shutdown pgref assert = True 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-09-21T21:59:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T21:59:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: rbd cache = True 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: rbd clone copy on read = True 2024-09-21T21:59:45.000 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2024-09-21T21:59:45.001 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2024-09-21T21:59:45.001 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2024-09-21T21:59:45.002 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T21:59:45.002 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T21:59:45.096 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T21:59:45.096 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:59:45.096 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T21:59:45.112 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:59:45.112 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T21:59:45.167 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T21:59:45.167 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:59:45.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T21:59:45.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T21:59:45.241 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T21:59:45.241 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:59:45.297 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T21:59:45.297 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T21:59:45.297 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T21:59:45.297 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T21:59:45.334 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T21:59:45.334 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:59:45.391 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T21:59:45.391 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T21:59:45.391 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T21:59:45.441 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T21:59:45.444 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T21:59:45.512 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T21:59:45.515 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T21:59:45.515 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T21:59:45.516 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T21:59:45.556 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T21:59:45.569 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T21:59:45.612 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T21:59:45.624 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T21:59:45.625 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T21:59:45.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T21:59:45.650 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T21:59:45.650 INFO:tasks.ceph:role: osd.0 2024-09-21T21:59:45.650 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T21:59:45.650 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T21:59:45.721 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T21:59:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T21:59:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T21:59:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T21:59:45.722 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T21:59:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-21T21:59:45.722 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T21:59:45.722 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T21:59:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T21:59:45.722 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T21:59:46.236 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-21T21:59:46.239 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-21T21:59:46.239 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T21:59:46.350 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T21:59:46.384 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T21:59:46.449 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T21:59:46.450 INFO:tasks.ceph:role: osd.1 2024-09-21T21:59:46.450 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T21:59:46.450 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T21:59:46.523 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T21:59:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T21:59:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T21:59:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T21:59:46.523 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T21:59:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-21T21:59:46.524 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T21:59:46.524 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T21:59:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T21:59:46.524 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T21:59:46.995 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-21T21:59:46.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-21T21:59:46.997 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T21:59:47.093 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T21:59:47.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T21:59:47.188 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T21:59:47.189 INFO:tasks.ceph:role: osd.2 2024-09-21T21:59:47.189 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T21:59:47.189 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T21:59:47.261 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T21:59:47.263 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T21:59:47.263 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T21:59:47.263 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T21:59:47.263 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T21:59:47.263 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-21T21:59:47.263 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T21:59:47.263 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T21:59:47.263 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T21:59:47.263 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T21:59:47.747 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-21T21:59:47.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-21T21:59:47.750 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T21:59:47.891 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T21:59:47.922 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T21:59:47.988 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T21:59:47.988 INFO:tasks.ceph:role: osd.3 2024-09-21T21:59:47.988 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T21:59:47.988 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T21:59:48.061 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T21:59:48.061 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T21:59:48.062 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T21:59:48.062 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T21:59:48.062 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T21:59:48.062 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-21T21:59:48.062 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T21:59:48.062 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T21:59:48.062 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T21:59:48.062 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T21:59:48.588 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-21T21:59:48.590 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-21T21:59:48.591 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T21:59:48.718 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T21:59:48.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:59:48.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:48.853+0000 7f4cf001e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T21:59:48.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:48.853+0000 7f4cf001e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T21:59:48.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:48.854+0000 7f4cf001e640 -1 bdev(0x55feb28cf800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T21:59:48.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:48.854+0000 7f4cf001e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T21:59:52.019 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T21:59:52.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:59:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:52.140+0000 7f767cc0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T21:59:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:52.141+0000 7f767cc0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T21:59:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:52.141+0000 7f767cc0d640 -1 bdev(0x55c20468b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T21:59:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:52.141+0000 7f767cc0d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T21:59:55.310 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T21:59:55.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:59:55.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:55.427+0000 7ff3a2525640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T21:59:55.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:55.428+0000 7ff3a2525640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T21:59:55.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:55.428+0000 7ff3a2525640 -1 bdev(0x55b6e2753800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T21:59:55.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:55.428+0000 7ff3a2525640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T21:59:58.589 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T21:59:58.619 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:59:58.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:58.710+0000 7f430974b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T21:59:58.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:58.711+0000 7f430974b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T21:59:58.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:58.711+0000 7f430974b640 -1 bdev(0x55566fcc5800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T21:59:58.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T21:59:58.711+0000 7f430974b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T22:00:01.624 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T22:00:01.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T22:00:01.685 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T22:00:01.685 INFO:tasks.ceph:role: osd.4 2024-09-21T22:00:01.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T22:00:01.686 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T22:00:01.763 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:00:01.763 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:00:01.763 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:00:01.763 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:00:01.763 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:00:01.763 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:00:01.763 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:00:01.763 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:00:01.763 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:00:01.763 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:00:02.282 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-09-21T22:00:02.284 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-09-21T22:00:02.284 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T22:00:02.429 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T22:00:02.467 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T22:00:02.537 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T22:00:02.537 INFO:tasks.ceph:role: osd.5 2024-09-21T22:00:02.537 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T22:00:02.537 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T22:00:02.616 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:00:02.617 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:00:02.617 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:00:02.617 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:00:02.617 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:00:02.617 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:00:02.617 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:00:02.617 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:00:02.617 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:00:02.617 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:00:03.058 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-09-21T22:00:03.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-09-21T22:00:03.060 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T22:00:03.157 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T22:00:03.186 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T22:00:03.252 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T22:00:03.252 INFO:tasks.ceph:role: osd.6 2024-09-21T22:00:03.252 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T22:00:03.252 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T22:00:03.324 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:00:03.325 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:00:03.325 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:00:03.325 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:00:03.325 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:00:03.325 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:00:03.325 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:00:03.325 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:00:03.325 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:00:03.325 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:00:03.812 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-09-21T22:00:03.813 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-09-21T22:00:03.814 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T22:00:03.957 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T22:00:03.986 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T22:00:04.052 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T22:00:04.052 INFO:tasks.ceph:role: osd.7 2024-09-21T22:00:04.052 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T22:00:04.052 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T22:00:04.124 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T22:00:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T22:00:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T22:00:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T22:00:04.124 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T22:00:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-09-21T22:00:04.124 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T22:00:04.124 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T22:00:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T22:00:04.125 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T22:00:04.649 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-09-21T22:00:04.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-09-21T22:00:04.651 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T22:00:04.805 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T22:00:04.840 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:00:04.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:04.946+0000 7f27286b4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T22:00:04.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:04.947+0000 7f27286b4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T22:00:04.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:04.947+0000 7f27286b4640 -1 bdev(0x55867be67800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T22:00:04.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:04.947+0000 7f27286b4640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T22:00:07.846 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T22:00:07.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:00:07.960 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:07.958+0000 7f38ee517640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T22:00:07.960 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:07.958+0000 7f38ee517640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T22:00:07.961 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:07.958+0000 7f38ee517640 -1 bdev(0x558c427fd800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T22:00:07.961 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:07.959+0000 7f38ee517640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T22:00:11.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T22:00:11.145 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:00:11.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:11.236+0000 7fcb59c2e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T22:00:11.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:11.237+0000 7fcb59c2e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T22:00:11.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:11.237+0000 7fcb59c2e640 -1 bdev(0x556784d21800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T22:00:11.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:11.237+0000 7fcb59c2e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T22:00:14.399 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T22:00:14.430 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:00:14.524 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:14.521+0000 7fdcb4619640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T22:00:14.524 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:14.522+0000 7fdcb4619640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T22:00:14.524 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:14.522+0000 7fdcb4619640 -1 bdev(0x56163a3a1800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T22:00:14.524 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-21T22:00:14.522+0000 7fdcb4619640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T22:00:17.675 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T22:00:17.700 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T22:00:17.701 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T22:00:17.701 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T22:00:17.730 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T22:00:17.731 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T22:00:17.800 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T22:00:17.800 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T22:00:17.867 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T22:00:17.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T22:00:17.933 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T22:00:17.943 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T22:00:18.000 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T22:00:18.000 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T22:00:18.024 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T22:00:18.025 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T22:00:18.090 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T22:00:18.090 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T22:00:18.154 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T22:00:18.154 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T22:00:18.219 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T22:00:18.219 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T22:00:18.284 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T22:00:18.285 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T22:00:18.301 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T22:00:18.302 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T22:00:18.340 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T22:00:18.340 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T22:00:18.344 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDRQe9mZPVNGhAAgwV6u6c+9gqNoOeS+QdJPA== 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDUQe9mKr7pMhAAb03VPmbROFoL7/KB2QJekw== 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDYQe9m8VdtCBAAqiuN0lxi2I9FGHcd4CLO9A== 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDbQe9m0I2JGRAAcyAbr9sY0WfD/jTkBtJYEA== 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDeQe9mMidmKhAA/J0/D/wCKhN757wl8v8ToA== 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDRQe9mj5qLHhAAno69SNuZay99lpsdG/rlTg== 2024-09-21T22:00:18.384 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDkQe9m+LaBOBAAHvQTw7Y0q9l4xY5V21W6qw== 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDnQe9mYwA4ORAAnRy4D2tN7IX89d2kUQD05g== 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDrQe9mymcyDhAATkRMOnb6SJYpyNT1y55KoA== 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDuQe9m/K8uHxAAEmLV4uJvhpAWNy/A/e7TzA== 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDRQe9mDzUlIRAASHpMhZagIeQlzMZmsOpOjQ== 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2024-09-21T22:00:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDRQe9mkwZ5JBAA+Vggwhdma7a5ew75QnHwQw== 2024-09-21T22:00:18.403 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2024-09-21T22:00:18.403 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDRQe9mZPVNGhAAgwV6u6c+9gqNoOeS+QdJPA== 2024-09-21T22:00:18.403 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2024-09-21T22:00:18.403 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDUQe9mKr7pMhAAb03VPmbROFoL7/KB2QJekw== 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDYQe9m8VdtCBAAqiuN0lxi2I9FGHcd4CLO9A== 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDbQe9m0I2JGRAAcyAbr9sY0WfD/jTkBtJYEA== 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDeQe9mMidmKhAA/J0/D/wCKhN757wl8v8ToA== 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDRQe9mj5qLHhAAno69SNuZay99lpsdG/rlTg== 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDkQe9m+LaBOBAAHvQTw7Y0q9l4xY5V21W6qw== 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDnQe9mYwA4ORAAnRy4D2tN7IX89d2kUQD05g== 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDrQe9mymcyDhAATkRMOnb6SJYpyNT1y55KoA== 2024-09-21T22:00:18.404 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2024-09-21T22:00:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDuQe9m/K8uHxAAEmLV4uJvhpAWNy/A/e7TzA== 2024-09-21T22:00:18.405 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2024-09-21T22:00:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDRQe9mDzUlIRAASHpMhZagIeQlzMZmsOpOjQ== 2024-09-21T22:00:18.405 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2024-09-21T22:00:18.405 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDRQe9mkwZ5JBAA+Vggwhdma7a5ew75QnHwQw== 2024-09-21T22:00:18.405 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T22:00:18.428 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T22:00:18.496 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.499 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.551 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.601 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.654 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.656 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.707 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T22:00:18.709 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T22:00:18.760 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.813 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.816 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.866 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.868 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.921 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T22:00:18.971 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T22:00:18.973 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T22:00:19.027 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T22:00:19.029 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T22:00:19.083 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T22:00:19.083 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T22:00:19.107 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T22:00:19.203 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T22:00:19.227 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T22:00:19.292 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T22:00:19.388 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T22:00:19.412 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T22:00:19.437 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T22:00:19.533 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T22:00:19.558 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:00:19.560 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T22:00:19.614 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T22:00:19.614 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T22:00:19.614 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T22:00:19.616 INFO:tasks.ceph.mon.a:Started 2024-09-21T22:00:19.616 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T22:00:19.616 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T22:00:19.618 INFO:tasks.ceph.mon.c:Started 2024-09-21T22:00:19.618 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T22:00:19.618 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T22:00:19.656 INFO:tasks.ceph.mon.b:Started 2024-09-21T22:00:19.656 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T22:00:19.656 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T22:00:19.656 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T22:00:19.659 INFO:tasks.ceph.mgr.y:Started 2024-09-21T22:00:19.659 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T22:00:19.659 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T22:00:19.661 INFO:tasks.ceph.mgr.x:Started 2024-09-21T22:00:19.661 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T22:00:19.661 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T22:00:25.025 INFO:teuthology.orchestra.run.smithi102.stderr:adjusted tunables profile to default 2024-09-21T22:00:25.037 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T22:00:25.037 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T22:00:25.038 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T22:00:25.038 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T22:00:25.056 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:25.054+0000 7f0ad560e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T22:00:25.063 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T22:00:25.063 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T22:00:25.099 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:25.096+0000 7f0ad560e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T22:00:25.123 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T22:00:25.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T22:00:25.187 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T22:00:25.188 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T22:00:25.241 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:25.239+0000 7f0ad560e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T22:00:25.249 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:25.248+0000 7f2379b39040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T22:00:25.252 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T22:00:25.252 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T22:00:25.279 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T22:00:25.279 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T22:00:25.293 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:25.291+0000 7f0ad560e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T22:00:25.295 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:25.294+0000 7f2379b39040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T22:00:25.319 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T22:00:25.320 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T22:00:25.385 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-21T22:00:25.385 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T22:00:25.451 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new ebc4f0b9-33fc-4301-b1c0-ac843b19095b 0 2024-09-21T22:00:25.455 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:25.454+0000 7f2379b39040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T22:00:25.456 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:25.454+0000 7f0ad560e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T22:00:25.510 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:25.509+0000 7f2379b39040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T22:00:25.564 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:25.562+0000 7f0ad560e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T22:00:25.637 INFO:teuthology.orchestra.run.smithi184.stdout:0 2024-09-21T22:00:25.648 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 1c8f54fe-439f-486e-8b8b-fe892332ada3 1 2024-09-21T22:00:25.699 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:25.698+0000 7f2379b39040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T22:00:25.814 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:25.813+0000 7f2379b39040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T22:00:25.831 INFO:teuthology.orchestra.run.smithi184.stdout:1 2024-09-21T22:00:25.843 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new b202159c-804c-4d22-9aa3-8f590dce8faa 2 2024-09-21T22:00:25.893 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:25.891+0000 7f0ad560e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T22:00:25.946 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:25.944+0000 7f0ad560e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T22:00:26.059 INFO:teuthology.orchestra.run.smithi184.stdout:2 2024-09-21T22:00:26.070 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 28a8c407-a445-4c76-8d7c-d5a249d13e03 3 2024-09-21T22:00:26.094 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:26.092+0000 7f0ad560e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T22:00:26.187 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:26.187+0000 7f2379b39040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T22:00:26.242 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:26.241+0000 7f2379b39040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T22:00:26.248 INFO:teuthology.orchestra.run.smithi184.stdout:3 2024-09-21T22:00:26.259 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605 4 2024-09-21T22:00:26.402 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:26.401+0000 7f2379b39040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T22:00:26.439 INFO:teuthology.orchestra.run.smithi184.stdout:4 2024-09-21T22:00:26.450 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 7a0cc26e-a543-4647-bc53-fbecb69b2326 5 2024-09-21T22:00:26.631 INFO:teuthology.orchestra.run.smithi184.stdout:5 2024-09-21T22:00:26.642 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 7768eeb7-c6d0-47d8-a400-c47a2154c590 6 2024-09-21T22:00:26.822 INFO:teuthology.orchestra.run.smithi184.stdout:6 2024-09-21T22:00:26.834 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 30ed992b-2e99-4523-9fdd-8389f75940af 7 2024-09-21T22:00:27.019 INFO:teuthology.orchestra.run.smithi184.stdout:7 2024-09-21T22:00:27.031 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T22:00:27.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T22:00:27.033 INFO:tasks.ceph.osd.0:Started 2024-09-21T22:00:27.033 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T22:00:27.033 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T22:00:27.035 INFO:tasks.ceph.osd.1:Started 2024-09-21T22:00:27.035 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T22:00:27.035 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T22:00:27.037 INFO:tasks.ceph.osd.2:Started 2024-09-21T22:00:27.037 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T22:00:27.037 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T22:00:27.039 INFO:tasks.ceph.osd.3:Started 2024-09-21T22:00:27.040 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T22:00:27.040 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T22:00:27.042 INFO:tasks.ceph.osd.4:Started 2024-09-21T22:00:27.042 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T22:00:27.042 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T22:00:27.043 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:27.041+0000 7f0ad560e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T22:00:27.044 INFO:tasks.ceph.osd.5:Started 2024-09-21T22:00:27.044 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T22:00:27.044 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T22:00:27.046 INFO:tasks.ceph.osd.6:Started 2024-09-21T22:00:27.046 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T22:00:27.046 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T22:00:27.048 INFO:tasks.ceph.osd.7:Started 2024-09-21T22:00:27.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:00:27.131 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:27.129+0000 7f0ad560e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T22:00:27.232 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:00:27.233 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":10,"fsid":"014f3ec5-afd0-4b18-9c74-de91f34d0760","created":"2024-09-21T22:00:24.916784+0000","modified":"2024-09-21T22:00:27.013065+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T22:00:27.013065+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ebc4f0b9-33fc-4301-b1c0-ac843b19095b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1c8f54fe-439f-486e-8b8b-fe892332ada3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b202159c-804c-4d22-9aa3-8f590dce8faa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"28a8c407-a445-4c76-8d7c-d5a249d13e03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7a0cc26e-a543-4647-bc53-fbecb69b2326","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7768eeb7-c6d0-47d8-a400-c47a2154c590","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30ed992b-2e99-4523-9fdd-8389f75940af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:00:27.243 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T22:00:27.244 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T22:00:27.432 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:27.431+0000 7f2379b39040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T22:00:27.485 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:27.484+0000 7f2379b39040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T22:00:27.508 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:27.506+0000 7f0ad560e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T22:00:27.591 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:27.589+0000 7f0ad560e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T22:00:27.698 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:27.695+0000 7f0ad560e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T22:00:27.745 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:27.743+0000 7f0ad560e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T22:00:27.851 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:27.850+0000 7f2379b39040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T22:00:27.858 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:27.856+0000 7f0ad560e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T22:00:27.911 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:27.908+0000 7f0ad560e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T22:00:27.936 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:27.935+0000 7f2379b39040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T22:00:27.956 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:27.954+0000 7f0ad560e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T22:00:28.045 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.044+0000 7f2379b39040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T22:00:28.050 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T22:00:28.070 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:28.068+0000 7f0ad560e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T22:00:28.090 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.090+0000 7f2379b39040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T22:00:28.122 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:28.120+0000 7f0ad560e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T22:00:28.176 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:28.174+0000 7f0ad560e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T22:00:28.204 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.203+0000 7f2379b39040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T22:00:28.208 INFO:teuthology.misc.health.smithi102.stdout: 2024-09-21T22:00:28.208 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":10,"fsid":"014f3ec5-afd0-4b18-9c74-de91f34d0760","created":"2024-09-21T22:00:24.916784+0000","modified":"2024-09-21T22:00:27.013065+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T22:00:27.013065+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ebc4f0b9-33fc-4301-b1c0-ac843b19095b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1c8f54fe-439f-486e-8b8b-fe892332ada3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b202159c-804c-4d22-9aa3-8f590dce8faa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"28a8c407-a445-4c76-8d7c-d5a249d13e03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7a0cc26e-a543-4647-bc53-fbecb69b2326","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7768eeb7-c6d0-47d8-a400-c47a2154c590","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30ed992b-2e99-4523-9fdd-8389f75940af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:00:28.218 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T22:00:28.246 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:28.244+0000 7f0ad560e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T22:00:28.250 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:28.249+0000 7fead1e15640 -1 Falling back to public interface 2024-09-21T22:00:28.258 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.257+0000 7f2379b39040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T22:00:28.291 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:28.289+0000 7f0ad560e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T22:00:28.303 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.302+0000 7f2379b39040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T22:00:28.336 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:28.334+0000 7f0ad560e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T22:00:28.413 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.412+0000 7f2379b39040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T22:00:28.462 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.461+0000 7f2379b39040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T22:00:28.470 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:28.469+0000 7f13243a6640 -1 Falling back to public interface 2024-09-21T22:00:28.495 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:28.494+0000 7ff463356640 -1 Falling back to public interface 2024-09-21T22:00:28.500 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:28.498+0000 7fb112a20640 -1 Falling back to public interface 2024-09-21T22:00:28.515 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.514+0000 7f2379b39040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T22:00:28.580 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:28.578+0000 7f1ffe5b0640 -1 Falling back to public interface 2024-09-21T22:00:28.582 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.581+0000 7f2379b39040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T22:00:28.626 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.625+0000 7f2379b39040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T22:00:28.669 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:28.668+0000 7f2379b39040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T22:00:28.749 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:28.748+0000 7f049a102640 -1 Falling back to public interface 2024-09-21T22:00:28.778 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:28.776+0000 7f17672d6640 -1 Falling back to public interface 2024-09-21T22:00:28.786 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:00:28.784+0000 7f1b84244640 -1 Falling back to public interface 2024-09-21T22:00:28.996 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:28.994+0000 7f0ad560e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T22:00:29.326 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-21T22:00:29.325+0000 7f2379b39040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T22:00:30.010 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:30.008+0000 7f0a751d6640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T22:00:30.011 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-09-21T22:00:30.009+0000 7f0a751d6640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T22:00:32.072 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:32.071+0000 7ff463356640 -1 osd.7 0 log_to_monitors true 2024-09-21T22:00:32.313 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:32.312+0000 7fead1e15640 -1 osd.6 0 log_to_monitors true 2024-09-21T22:00:32.616 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:32.615+0000 7f1ffe5b0640 -1 osd.0 0 log_to_monitors true 2024-09-21T22:00:32.738 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:32.737+0000 7f13243a6640 -1 osd.5 0 log_to_monitors true 2024-09-21T22:00:32.810 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:32.809+0000 7f049a102640 -1 osd.4 0 log_to_monitors true 2024-09-21T22:00:32.820 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:32.819+0000 7f17672d6640 -1 osd.2 0 log_to_monitors true 2024-09-21T22:00:32.884 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:00:32.882+0000 7f1b84244640 -1 osd.1 0 log_to_monitors true 2024-09-21T22:00:33.114 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:33.113+0000 7fb112a20640 -1 osd.3 0 log_to_monitors true 2024-09-21T22:00:35.013 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:35.012+0000 7f1ffa53f640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T22:00:35.023 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T22:00:35.023 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:35.022+0000 7f1ff235f640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:00:35.055 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:35.054+0000 7f1763265640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T22:00:35.056 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:00:35.055+0000 7f1b801d3640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T22:00:35.065 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:35.064+0000 7f175b085640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:00:35.078 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:00:35.077+0000 7f1b77ff3640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:00:35.110 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:35.110+0000 7f1320335640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T22:00:35.121 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:35.120+0000 7f1318155640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:00:35.131 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:35.129+0000 7ff45f2e5640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T22:00:35.132 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:35.131+0000 7f0496091640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T22:00:35.140 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:35.139+0000 7ff457105640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:00:35.142 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:35.142+0000 7feacd726640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T22:00:35.148 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:35.147+0000 7f048deb1640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:00:35.152 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:35.151+0000 7feac5546640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:00:35.353 INFO:teuthology.misc.health.smithi102.stdout: 2024-09-21T22:00:35.353 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":13,"fsid":"014f3ec5-afd0-4b18-9c74-de91f34d0760","created":"2024-09-21T22:00:24.916784+0000","modified":"2024-09-21T22:00:35.029718+0000","last_up_change":"2024-09-21T22:00:35.029718+0000","last_in_change":"2024-09-21T22:00:27.013065+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ebc4f0b9-33fc-4301-b1c0-ac843b19095b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6809","nonce":3559797623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6811","nonce":3559797623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6815","nonce":3559797623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6813","nonce":3559797623}]},"public_addr":"172.21.15.102:6809/3559797623","cluster_addr":"172.21.15.102:6811/3559797623","heartbeat_back_addr":"172.21.15.102:6815/3559797623","heartbeat_front_addr":"172.21.15.102:6813/3559797623","state":["exists","up"]},{"osd":1,"uuid":"1c8f54fe-439f-486e-8b8b-fe892332ada3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b202159c-804c-4d22-9aa3-8f590dce8faa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"28a8c407-a445-4c76-8d7c-d5a249d13e03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7a0cc26e-a543-4647-bc53-fbecb69b2326","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7768eeb7-c6d0-47d8-a400-c47a2154c590","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"30ed992b-2e99-4523-9fdd-8389f75940af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:00:35.366 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-21T22:00:35.747 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:35.746+0000 7fb10f1c3640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T22:00:35.758 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:35.757+0000 7fb1067cf640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T22:00:42.173 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T22:00:42.450 INFO:teuthology.misc.health.smithi102.stdout: 2024-09-21T22:00:42.451 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":17,"fsid":"014f3ec5-afd0-4b18-9c74-de91f34d0760","created":"2024-09-21T22:00:24.916784+0000","modified":"2024-09-21T22:00:39.074505+0000","last_up_change":"2024-09-21T22:00:36.060631+0000","last_in_change":"2024-09-21T22:00:27.013065+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:00:37.034134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ebc4f0b9-33fc-4301-b1c0-ac843b19095b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6809","nonce":3559797623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6811","nonce":3559797623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6815","nonce":3559797623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6813","nonce":3559797623}]},"public_addr":"172.21.15.102:6809/3559797623","cluster_addr":"172.21.15.102:6811/3559797623","heartbeat_back_addr":"172.21.15.102:6815/3559797623","heartbeat_front_addr":"172.21.15.102:6813/3559797623","state":["exists","up"]},{"osd":1,"uuid":"1c8f54fe-439f-486e-8b8b-fe892332ada3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6825","nonce":428384344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6827","nonce":428384344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6831","nonce":428384344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6829","nonce":428384344}]},"public_addr":"172.21.15.102:6825/428384344","cluster_addr":"172.21.15.102:6827/428384344","heartbeat_back_addr":"172.21.15.102:6831/428384344","heartbeat_front_addr":"172.21.15.102:6829/428384344","state":["exists","up"]},{"osd":2,"uuid":"b202159c-804c-4d22-9aa3-8f590dce8faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6817","nonce":4237051748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6819","nonce":4237051748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6823","nonce":4237051748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6821","nonce":4237051748}]},"public_addr":"172.21.15.102:6817/4237051748","cluster_addr":"172.21.15.102:6819/4237051748","heartbeat_back_addr":"172.21.15.102:6823/4237051748","heartbeat_front_addr":"172.21.15.102:6821/4237051748","state":["exists","up"]},{"osd":3,"uuid":"28a8c407-a445-4c76-8d7c-d5a249d13e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6801","nonce":3004236595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6803","nonce":3004236595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6807","nonce":3004236595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6805","nonce":3004236595}]},"public_addr":"172.21.15.102:6801/3004236595","cluster_addr":"172.21.15.102:6803/3004236595","heartbeat_back_addr":"172.21.15.102:6807/3004236595","heartbeat_front_addr":"172.21.15.102:6805/3004236595","state":["exists","up"]},{"osd":4,"uuid":"cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6825","nonce":743062291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6827","nonce":743062291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6831","nonce":743062291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6829","nonce":743062291}]},"public_addr":"172.21.15.184:6825/743062291","cluster_addr":"172.21.15.184:6827/743062291","heartbeat_back_addr":"172.21.15.184:6831/743062291","heartbeat_front_addr":"172.21.15.184:6829/743062291","state":["exists","up"]},{"osd":5,"uuid":"7a0cc26e-a543-4647-bc53-fbecb69b2326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6809","nonce":2410886219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6811","nonce":2410886219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6815","nonce":2410886219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6813","nonce":2410886219}]},"public_addr":"172.21.15.184:6809/2410886219","cluster_addr":"172.21.15.184:6811/2410886219","heartbeat_back_addr":"172.21.15.184:6815/2410886219","heartbeat_front_addr":"172.21.15.184:6813/2410886219","state":["exists","up"]},{"osd":6,"uuid":"7768eeb7-c6d0-47d8-a400-c47a2154c590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6801","nonce":2491178498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6803","nonce":2491178498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6807","nonce":2491178498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6805","nonce":2491178498}]},"public_addr":"172.21.15.184:6801/2491178498","cluster_addr":"172.21.15.184:6803/2491178498","heartbeat_back_addr":"172.21.15.184:6807/2491178498","heartbeat_front_addr":"172.21.15.184:6805/2491178498","state":["exists","up"]},{"osd":7,"uuid":"30ed992b-2e99-4523-9fdd-8389f75940af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6817","nonce":1580142875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6819","nonce":1580142875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6823","nonce":1580142875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6821","nonce":1580142875}]},"public_addr":"172.21.15.184:6817/1580142875","cluster_addr":"172.21.15.184:6819/1580142875","heartbeat_back_addr":"172.21.15.184:6823/1580142875","heartbeat_front_addr":"172.21.15.184:6821/1580142875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.652871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.866866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.859757+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:34.082180+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.844484+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.746321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.324821+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.093833+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:00:42.462 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T22:00:42.462 INFO:tasks.ceph:Creating RBD pool 2024-09-21T22:00:42.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-21T22:00:43.093 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'rbd' created 2024-09-21T22:00:43.105 DEBUG:teuthology.orchestra.run.smithi102:> rbd --cluster ceph pool init rbd 2024-09-21T22:00:46.129 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T22:00:46.130 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T22:00:46.130 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T22:00:46.130 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T22:00:46.131 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T22:00:46.467 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:00:46.479 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2382384456},{"type":"v1","addr":"172.21.15.102:6833","nonce":2382384456}]},"active_addr":"172.21.15.102:6833/2382384456","active_change":"2024-09-21T22:00:28.996540+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":378972456}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":750701463}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":3496150163}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":1004922414}]}]} 2024-09-21T22:00:46.482 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T22:00:46.482 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T22:00:46.482 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:00:46.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:00:46.759 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"014f3ec5-afd0-4b18-9c74-de91f34d0760","created":"2024-09-21T22:00:24.916784+0000","modified":"2024-09-21T22:00:46.105168+0000","last_up_change":"2024-09-21T22:00:36.060631+0000","last_in_change":"2024-09-21T22:00:27.013065+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:00:37.034134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T22:00:42.753049+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ebc4f0b9-33fc-4301-b1c0-ac843b19095b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6809","nonce":3559797623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6811","nonce":3559797623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6815","nonce":3559797623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6813","nonce":3559797623}]},"public_addr":"172.21.15.102:6809/3559797623","cluster_addr":"172.21.15.102:6811/3559797623","heartbeat_back_addr":"172.21.15.102:6815/3559797623","heartbeat_front_addr":"172.21.15.102:6813/3559797623","state":["exists","up"]},{"osd":1,"uuid":"1c8f54fe-439f-486e-8b8b-fe892332ada3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6825","nonce":428384344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6827","nonce":428384344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6831","nonce":428384344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6829","nonce":428384344}]},"public_addr":"172.21.15.102:6825/428384344","cluster_addr":"172.21.15.102:6827/428384344","heartbeat_back_addr":"172.21.15.102:6831/428384344","heartbeat_front_addr":"172.21.15.102:6829/428384344","state":["exists","up"]},{"osd":2,"uuid":"b202159c-804c-4d22-9aa3-8f590dce8faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6817","nonce":4237051748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6819","nonce":4237051748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6823","nonce":4237051748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6821","nonce":4237051748}]},"public_addr":"172.21.15.102:6817/4237051748","cluster_addr":"172.21.15.102:6819/4237051748","heartbeat_back_addr":"172.21.15.102:6823/4237051748","heartbeat_front_addr":"172.21.15.102:6821/4237051748","state":["exists","up"]},{"osd":3,"uuid":"28a8c407-a445-4c76-8d7c-d5a249d13e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6801","nonce":3004236595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6803","nonce":3004236595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6807","nonce":3004236595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6805","nonce":3004236595}]},"public_addr":"172.21.15.102:6801/3004236595","cluster_addr":"172.21.15.102:6803/3004236595","heartbeat_back_addr":"172.21.15.102:6807/3004236595","heartbeat_front_addr":"172.21.15.102:6805/3004236595","state":["exists","up"]},{"osd":4,"uuid":"cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6825","nonce":743062291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6827","nonce":743062291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6831","nonce":743062291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6829","nonce":743062291}]},"public_addr":"172.21.15.184:6825/743062291","cluster_addr":"172.21.15.184:6827/743062291","heartbeat_back_addr":"172.21.15.184:6831/743062291","heartbeat_front_addr":"172.21.15.184:6829/743062291","state":["exists","up"]},{"osd":5,"uuid":"7a0cc26e-a543-4647-bc53-fbecb69b2326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6809","nonce":2410886219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6811","nonce":2410886219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6815","nonce":2410886219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6813","nonce":2410886219}]},"public_addr":"172.21.15.184:6809/2410886219","cluster_addr":"172.21.15.184:6811/2410886219","heartbeat_back_addr":"172.21.15.184:6815/2410886219","heartbeat_front_addr":"172.21.15.184:6813/2410886219","state":["exists","up"]},{"osd":6,"uuid":"7768eeb7-c6d0-47d8-a400-c47a2154c590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6801","nonce":2491178498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6803","nonce":2491178498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6807","nonce":2491178498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6805","nonce":2491178498}]},"public_addr":"172.21.15.184:6801/2491178498","cluster_addr":"172.21.15.184:6803/2491178498","heartbeat_back_addr":"172.21.15.184:6807/2491178498","heartbeat_front_addr":"172.21.15.184:6805/2491178498","state":["exists","up"]},{"osd":7,"uuid":"30ed992b-2e99-4523-9fdd-8389f75940af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6817","nonce":1580142875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6819","nonce":1580142875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6823","nonce":1580142875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6821","nonce":1580142875}]},"public_addr":"172.21.15.184:6817/1580142875","cluster_addr":"172.21.15.184:6819/1580142875","heartbeat_back_addr":"172.21.15.184:6823/1580142875","heartbeat_front_addr":"172.21.15.184:6821/1580142875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.652871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.866866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.859757+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:34.082180+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.844484+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.746321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.324821+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.093833+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:00:46.772 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T22:00:46.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:00:47.052 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:00:47.052 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"014f3ec5-afd0-4b18-9c74-de91f34d0760","created":"2024-09-21T22:00:24.916784+0000","modified":"2024-09-21T22:00:46.105168+0000","last_up_change":"2024-09-21T22:00:36.060631+0000","last_in_change":"2024-09-21T22:00:27.013065+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:00:37.034134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T22:00:42.753049+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ebc4f0b9-33fc-4301-b1c0-ac843b19095b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6809","nonce":3559797623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6811","nonce":3559797623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6815","nonce":3559797623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6813","nonce":3559797623}]},"public_addr":"172.21.15.102:6809/3559797623","cluster_addr":"172.21.15.102:6811/3559797623","heartbeat_back_addr":"172.21.15.102:6815/3559797623","heartbeat_front_addr":"172.21.15.102:6813/3559797623","state":["exists","up"]},{"osd":1,"uuid":"1c8f54fe-439f-486e-8b8b-fe892332ada3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6825","nonce":428384344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6827","nonce":428384344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6831","nonce":428384344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6829","nonce":428384344}]},"public_addr":"172.21.15.102:6825/428384344","cluster_addr":"172.21.15.102:6827/428384344","heartbeat_back_addr":"172.21.15.102:6831/428384344","heartbeat_front_addr":"172.21.15.102:6829/428384344","state":["exists","up"]},{"osd":2,"uuid":"b202159c-804c-4d22-9aa3-8f590dce8faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6817","nonce":4237051748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6819","nonce":4237051748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6823","nonce":4237051748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6821","nonce":4237051748}]},"public_addr":"172.21.15.102:6817/4237051748","cluster_addr":"172.21.15.102:6819/4237051748","heartbeat_back_addr":"172.21.15.102:6823/4237051748","heartbeat_front_addr":"172.21.15.102:6821/4237051748","state":["exists","up"]},{"osd":3,"uuid":"28a8c407-a445-4c76-8d7c-d5a249d13e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6801","nonce":3004236595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6803","nonce":3004236595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6807","nonce":3004236595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6805","nonce":3004236595}]},"public_addr":"172.21.15.102:6801/3004236595","cluster_addr":"172.21.15.102:6803/3004236595","heartbeat_back_addr":"172.21.15.102:6807/3004236595","heartbeat_front_addr":"172.21.15.102:6805/3004236595","state":["exists","up"]},{"osd":4,"uuid":"cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6825","nonce":743062291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6827","nonce":743062291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6831","nonce":743062291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6829","nonce":743062291}]},"public_addr":"172.21.15.184:6825/743062291","cluster_addr":"172.21.15.184:6827/743062291","heartbeat_back_addr":"172.21.15.184:6831/743062291","heartbeat_front_addr":"172.21.15.184:6829/743062291","state":["exists","up"]},{"osd":5,"uuid":"7a0cc26e-a543-4647-bc53-fbecb69b2326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6809","nonce":2410886219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6811","nonce":2410886219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6815","nonce":2410886219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6813","nonce":2410886219}]},"public_addr":"172.21.15.184:6809/2410886219","cluster_addr":"172.21.15.184:6811/2410886219","heartbeat_back_addr":"172.21.15.184:6815/2410886219","heartbeat_front_addr":"172.21.15.184:6813/2410886219","state":["exists","up"]},{"osd":6,"uuid":"7768eeb7-c6d0-47d8-a400-c47a2154c590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6801","nonce":2491178498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6803","nonce":2491178498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6807","nonce":2491178498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6805","nonce":2491178498}]},"public_addr":"172.21.15.184:6801/2491178498","cluster_addr":"172.21.15.184:6803/2491178498","heartbeat_back_addr":"172.21.15.184:6807/2491178498","heartbeat_front_addr":"172.21.15.184:6805/2491178498","state":["exists","up"]},{"osd":7,"uuid":"30ed992b-2e99-4523-9fdd-8389f75940af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6817","nonce":1580142875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6819","nonce":1580142875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6823","nonce":1580142875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6821","nonce":1580142875}]},"public_addr":"172.21.15.184:6817/1580142875","cluster_addr":"172.21.15.184:6819/1580142875","heartbeat_back_addr":"172.21.15.184:6823/1580142875","heartbeat_front_addr":"172.21.15.184:6821/1580142875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.652871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.866866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.859757+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:34.082180+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.844484+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.746321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.324821+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.093833+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:00:47.065 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T22:00:47.065 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T22:00:47.066 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T22:00:47.066 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T22:00:47.067 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T22:00:47.067 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T22:00:47.067 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T22:00:47.068 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T22:00:47.304 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-21T22:00:47.305 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T22:00:47.308 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-21T22:00:47.308 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T22:00:47.309 INFO:teuthology.orchestra.run.smithi102.stdout:55834574852 2024-09-21T22:00:47.309 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T22:00:47.310 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-21T22:00:47.311 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T22:00:47.311 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-21T22:00:47.312 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T22:00:47.312 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-21T22:00:47.313 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T22:00:47.314 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-21T22:00:47.315 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T22:00:47.319 INFO:teuthology.orchestra.run.smithi102.stdout:60129542151 2024-09-21T22:00:47.319 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T22:00:47.869 INFO:teuthology.orchestra.run.smithi102.stdout:60129542147 2024-09-21T22:00:47.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.2 2024-09-21T22:00:47.889 INFO:teuthology.orchestra.run.smithi102.stdout:60129542148 2024-09-21T22:00:47.895 INFO:teuthology.orchestra.run.smithi102.stdout:60129542147 2024-09-21T22:00:47.902 INFO:teuthology.orchestra.run.smithi102.stdout:60129542148 2024-09-21T22:00:47.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.6 2024-09-21T22:00:47.912 INFO:teuthology.orchestra.run.smithi102.stdout:60129542148 2024-09-21T22:00:47.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.3 2024-09-21T22:00:47.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.1 2024-09-21T22:00:47.922 INFO:teuthology.orchestra.run.smithi102.stdout:55834574851 2024-09-21T22:00:47.924 INFO:teuthology.orchestra.run.smithi102.stdout:60129542147 2024-09-21T22:00:47.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.4 2024-09-21T22:00:47.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-09-21T22:00:47.937 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-21T22:00:47.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.5 2024-09-21T22:00:47.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.7 2024-09-21T22:00:48.890 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T22:00:48.910 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T22:00:48.918 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T22:00:48.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T22:00:48.933 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T22:00:48.937 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T22:00:48.940 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T22:00:48.950 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T22:00:49.449 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-21T22:00:49.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-09-21T22:00:49.468 DEBUG:teuthology.parallel:result is None 2024-09-21T22:00:49.499 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-21T22:00:49.511 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-21T22:00:49.512 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-21T22:00:49.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-21T22:00:49.517 DEBUG:teuthology.parallel:result is None 2024-09-21T22:00:49.518 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-21T22:00:49.531 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-21T22:00:49.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-21T22:00:49.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-21T22:00:49.535 DEBUG:teuthology.parallel:result is None 2024-09-21T22:00:49.535 DEBUG:teuthology.parallel:result is None 2024-09-21T22:00:49.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-21T22:00:49.538 DEBUG:teuthology.parallel:result is None 2024-09-21T22:00:49.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-21T22:00:49.545 DEBUG:teuthology.parallel:result is None 2024-09-21T22:00:49.571 INFO:teuthology.orchestra.run.smithi102.stdout:55834574852 2024-09-21T22:00:49.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-09-21T22:00:49.584 DEBUG:teuthology.parallel:result is None 2024-09-21T22:00:49.596 INFO:teuthology.orchestra.run.smithi102.stdout:60129542151 2024-09-21T22:00:49.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-09-21T22:00:49.610 DEBUG:teuthology.parallel:result is None 2024-09-21T22:00:49.611 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T22:00:49.611 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:00:49.927 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:00:49.928 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:00:49.940 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T22:00:49.700904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218060,"kb_used_data":1784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756660,"statfs":{"total":773094113280,"available":772870819840,"internally_reserved":0,"allocated":1826816,"data_stored":1760606,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.600246"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188285+0000","last_change":"2024-09-21T22:00:46.188285+0000","last_active":"2024-09-21T22:00:46.188285+0000","last_peered":"2024-09-21T22:00:46.188285+0000","last_clean":"2024-09-21T22:00:46.188285+0000","last_became_active":"2024-09-21T22:00:44.109650+0000","last_became_peered":"2024-09-21T22:00:44.109650+0000","last_unstale":"2024-09-21T22:00:46.188285+0000","last_undegraded":"2024-09-21T22:00:46.188285+0000","last_fullsized":"2024-09-21T22:00:46.188285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:13:09.906285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044888699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.118750+0000","last_change":"2024-09-21T22:00:46.118750+0000","last_active":"2024-09-21T22:00:46.118750+0000","last_peered":"2024-09-21T22:00:46.118750+0000","last_clean":"2024-09-21T22:00:46.118750+0000","last_became_active":"2024-09-21T22:00:44.109810+0000","last_became_peered":"2024-09-21T22:00:44.109810+0000","last_unstale":"2024-09-21T22:00:46.118750+0000","last_undegraded":"2024-09-21T22:00:46.118750+0000","last_fullsized":"2024-09-21T22:00:46.118750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:35:43.247067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050505999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188341+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:00:46.188341+0000","last_peered":"2024-09-21T22:00:46.188341+0000","last_clean":"2024-09-21T22:00:46.188341+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:00:46.188341+0000","last_undegraded":"2024-09-21T22:00:46.188341+0000","last_fullsized":"2024-09-21T22:00:46.188341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.118721+0000","last_change":"2024-09-21T22:00:46.118721+0000","last_active":"2024-09-21T22:00:46.118721+0000","last_peered":"2024-09-21T22:00:46.118721+0000","last_clean":"2024-09-21T22:00:46.118721+0000","last_became_active":"2024-09-21T22:00:44.221481+0000","last_became_peered":"2024-09-21T22:00:44.221481+0000","last_unstale":"2024-09-21T22:00:46.118721+0000","last_undegraded":"2024-09-21T22:00:46.118721+0000","last_fullsized":"2024-09-21T22:00:46.118721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:51.492172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000509061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.123906+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:00:46.123906+0000","last_peered":"2024-09-21T22:00:46.123906+0000","last_clean":"2024-09-21T22:00:46.123906+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:00:46.123906+0000","last_undegraded":"2024-09-21T22:00:46.123906+0000","last_fullsized":"2024-09-21T22:00:46.123906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188179+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:00:46.188179+0000","last_peered":"2024-09-21T22:00:46.188179+0000","last_clean":"2024-09-21T22:00:46.188179+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:00:46.188179+0000","last_undegraded":"2024-09-21T22:00:46.188179+0000","last_fullsized":"2024-09-21T22:00:46.188179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188368+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:00:46.188368+0000","last_peered":"2024-09-21T22:00:46.188368+0000","last_clean":"2024-09-21T22:00:46.188368+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:00:46.188368+0000","last_undegraded":"2024-09-21T22:00:46.188368+0000","last_fullsized":"2024-09-21T22:00:46.188368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.122354+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:00:46.122354+0000","last_peered":"2024-09-21T22:00:46.122354+0000","last_clean":"2024-09-21T22:00:46.122354+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:00:46.122354+0000","last_undegraded":"2024-09-21T22:00:46.122354+0000","last_fullsized":"2024-09-21T22:00:46.122354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.187811+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:00:46.187811+0000","last_peered":"2024-09-21T22:00:46.187811+0000","last_clean":"2024-09-21T22:00:46.187811+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:00:46.187811+0000","last_undegraded":"2024-09-21T22:00:46.187811+0000","last_fullsized":"2024-09-21T22:00:46.187811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":662847,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":662847,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:00:49.941 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:00:50.220 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:00:50.220 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:00:50.232 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T22:00:49.700904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218060,"kb_used_data":1784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756660,"statfs":{"total":773094113280,"available":772870819840,"internally_reserved":0,"allocated":1826816,"data_stored":1760606,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.600246"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188285+0000","last_change":"2024-09-21T22:00:46.188285+0000","last_active":"2024-09-21T22:00:46.188285+0000","last_peered":"2024-09-21T22:00:46.188285+0000","last_clean":"2024-09-21T22:00:46.188285+0000","last_became_active":"2024-09-21T22:00:44.109650+0000","last_became_peered":"2024-09-21T22:00:44.109650+0000","last_unstale":"2024-09-21T22:00:46.188285+0000","last_undegraded":"2024-09-21T22:00:46.188285+0000","last_fullsized":"2024-09-21T22:00:46.188285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:13:09.906285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044888699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.118750+0000","last_change":"2024-09-21T22:00:46.118750+0000","last_active":"2024-09-21T22:00:46.118750+0000","last_peered":"2024-09-21T22:00:46.118750+0000","last_clean":"2024-09-21T22:00:46.118750+0000","last_became_active":"2024-09-21T22:00:44.109810+0000","last_became_peered":"2024-09-21T22:00:44.109810+0000","last_unstale":"2024-09-21T22:00:46.118750+0000","last_undegraded":"2024-09-21T22:00:46.118750+0000","last_fullsized":"2024-09-21T22:00:46.118750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:35:43.247067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050505999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188341+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:00:46.188341+0000","last_peered":"2024-09-21T22:00:46.188341+0000","last_clean":"2024-09-21T22:00:46.188341+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:00:46.188341+0000","last_undegraded":"2024-09-21T22:00:46.188341+0000","last_fullsized":"2024-09-21T22:00:46.188341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.118721+0000","last_change":"2024-09-21T22:00:46.118721+0000","last_active":"2024-09-21T22:00:46.118721+0000","last_peered":"2024-09-21T22:00:46.118721+0000","last_clean":"2024-09-21T22:00:46.118721+0000","last_became_active":"2024-09-21T22:00:44.221481+0000","last_became_peered":"2024-09-21T22:00:44.221481+0000","last_unstale":"2024-09-21T22:00:46.118721+0000","last_undegraded":"2024-09-21T22:00:46.118721+0000","last_fullsized":"2024-09-21T22:00:46.118721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:51.492172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000509061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.123906+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:00:46.123906+0000","last_peered":"2024-09-21T22:00:46.123906+0000","last_clean":"2024-09-21T22:00:46.123906+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:00:46.123906+0000","last_undegraded":"2024-09-21T22:00:46.123906+0000","last_fullsized":"2024-09-21T22:00:46.123906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188179+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:00:46.188179+0000","last_peered":"2024-09-21T22:00:46.188179+0000","last_clean":"2024-09-21T22:00:46.188179+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:00:46.188179+0000","last_undegraded":"2024-09-21T22:00:46.188179+0000","last_fullsized":"2024-09-21T22:00:46.188179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188368+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:00:46.188368+0000","last_peered":"2024-09-21T22:00:46.188368+0000","last_clean":"2024-09-21T22:00:46.188368+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:00:46.188368+0000","last_undegraded":"2024-09-21T22:00:46.188368+0000","last_fullsized":"2024-09-21T22:00:46.188368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.122354+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:00:46.122354+0000","last_peered":"2024-09-21T22:00:46.122354+0000","last_clean":"2024-09-21T22:00:46.122354+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:00:46.122354+0000","last_undegraded":"2024-09-21T22:00:46.122354+0000","last_fullsized":"2024-09-21T22:00:46.122354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.187811+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:00:46.187811+0000","last_peered":"2024-09-21T22:00:46.187811+0000","last_clean":"2024-09-21T22:00:46.187811+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:00:46.187811+0000","last_undegraded":"2024-09-21T22:00:46.187811+0000","last_fullsized":"2024-09-21T22:00:46.187811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":662847,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":662847,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:00:50.233 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T22:00:50.233 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T22:00:50.233 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T22:00:50.233 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T22:00:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:00:50.544 INFO:teuthology.orchestra.run.smithi102.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T22:00:50.556 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T22:00:50.556 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-21T22:00:50.569 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-21T22:00:50.569 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd clone copy on read': True}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-21T22:00:50.569 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-21T22:00:50.569 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-21T22:00:50.863 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-21T22:00:50.864 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T22:00:50.864 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:00:51.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:00:51.141 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:00:51.153 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-21T22:00:51.004532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218060,"kb_used_data":1784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756660,"statfs":{"total":773094113280,"available":772870819840,"internally_reserved":0,"allocated":1826816,"data_stored":1760606,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000920"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188285+0000","last_change":"2024-09-21T22:00:46.188285+0000","last_active":"2024-09-21T22:00:46.188285+0000","last_peered":"2024-09-21T22:00:46.188285+0000","last_clean":"2024-09-21T22:00:46.188285+0000","last_became_active":"2024-09-21T22:00:44.109650+0000","last_became_peered":"2024-09-21T22:00:44.109650+0000","last_unstale":"2024-09-21T22:00:46.188285+0000","last_undegraded":"2024-09-21T22:00:46.188285+0000","last_fullsized":"2024-09-21T22:00:46.188285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:13:09.906285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044888699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.118750+0000","last_change":"2024-09-21T22:00:46.118750+0000","last_active":"2024-09-21T22:00:46.118750+0000","last_peered":"2024-09-21T22:00:46.118750+0000","last_clean":"2024-09-21T22:00:46.118750+0000","last_became_active":"2024-09-21T22:00:44.109810+0000","last_became_peered":"2024-09-21T22:00:44.109810+0000","last_unstale":"2024-09-21T22:00:46.118750+0000","last_undegraded":"2024-09-21T22:00:46.118750+0000","last_fullsized":"2024-09-21T22:00:46.118750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:35:43.247067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050505999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188341+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:00:46.188341+0000","last_peered":"2024-09-21T22:00:46.188341+0000","last_clean":"2024-09-21T22:00:46.188341+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:00:46.188341+0000","last_undegraded":"2024-09-21T22:00:46.188341+0000","last_fullsized":"2024-09-21T22:00:46.188341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.118721+0000","last_change":"2024-09-21T22:00:46.118721+0000","last_active":"2024-09-21T22:00:46.118721+0000","last_peered":"2024-09-21T22:00:46.118721+0000","last_clean":"2024-09-21T22:00:46.118721+0000","last_became_active":"2024-09-21T22:00:44.221481+0000","last_became_peered":"2024-09-21T22:00:44.221481+0000","last_unstale":"2024-09-21T22:00:46.118721+0000","last_undegraded":"2024-09-21T22:00:46.118721+0000","last_fullsized":"2024-09-21T22:00:46.118721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:51.492172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000509061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.123906+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:00:46.123906+0000","last_peered":"2024-09-21T22:00:46.123906+0000","last_clean":"2024-09-21T22:00:46.123906+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:00:46.123906+0000","last_undegraded":"2024-09-21T22:00:46.123906+0000","last_fullsized":"2024-09-21T22:00:46.123906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188179+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:00:46.188179+0000","last_peered":"2024-09-21T22:00:46.188179+0000","last_clean":"2024-09-21T22:00:46.188179+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:00:46.188179+0000","last_undegraded":"2024-09-21T22:00:46.188179+0000","last_fullsized":"2024-09-21T22:00:46.188179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188368+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:00:46.188368+0000","last_peered":"2024-09-21T22:00:46.188368+0000","last_clean":"2024-09-21T22:00:46.188368+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:00:46.188368+0000","last_undegraded":"2024-09-21T22:00:46.188368+0000","last_fullsized":"2024-09-21T22:00:46.188368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.122354+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:00:46.122354+0000","last_peered":"2024-09-21T22:00:46.122354+0000","last_clean":"2024-09-21T22:00:46.122354+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:00:46.122354+0000","last_undegraded":"2024-09-21T22:00:46.122354+0000","last_fullsized":"2024-09-21T22:00:46.122354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.187811+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:00:46.187811+0000","last_peered":"2024-09-21T22:00:46.187811+0000","last_clean":"2024-09-21T22:00:46.187811+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:00:46.187811+0000","last_undegraded":"2024-09-21T22:00:46.187811+0000","last_fullsized":"2024-09-21T22:00:46.187811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":662847,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":662847,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:00:51.154 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:00:51.428 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:00:51.429 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:00:51.440 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-21T22:00:51.004532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218060,"kb_used_data":1784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756660,"statfs":{"total":773094113280,"available":772870819840,"internally_reserved":0,"allocated":1826816,"data_stored":1760606,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000920"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188285+0000","last_change":"2024-09-21T22:00:46.188285+0000","last_active":"2024-09-21T22:00:46.188285+0000","last_peered":"2024-09-21T22:00:46.188285+0000","last_clean":"2024-09-21T22:00:46.188285+0000","last_became_active":"2024-09-21T22:00:44.109650+0000","last_became_peered":"2024-09-21T22:00:44.109650+0000","last_unstale":"2024-09-21T22:00:46.188285+0000","last_undegraded":"2024-09-21T22:00:46.188285+0000","last_fullsized":"2024-09-21T22:00:46.188285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:13:09.906285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044888699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.118750+0000","last_change":"2024-09-21T22:00:46.118750+0000","last_active":"2024-09-21T22:00:46.118750+0000","last_peered":"2024-09-21T22:00:46.118750+0000","last_clean":"2024-09-21T22:00:46.118750+0000","last_became_active":"2024-09-21T22:00:44.109810+0000","last_became_peered":"2024-09-21T22:00:44.109810+0000","last_unstale":"2024-09-21T22:00:46.118750+0000","last_undegraded":"2024-09-21T22:00:46.118750+0000","last_fullsized":"2024-09-21T22:00:46.118750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:35:43.247067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050505999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188341+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:00:46.188341+0000","last_peered":"2024-09-21T22:00:46.188341+0000","last_clean":"2024-09-21T22:00:46.188341+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:00:46.188341+0000","last_undegraded":"2024-09-21T22:00:46.188341+0000","last_fullsized":"2024-09-21T22:00:46.188341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.118721+0000","last_change":"2024-09-21T22:00:46.118721+0000","last_active":"2024-09-21T22:00:46.118721+0000","last_peered":"2024-09-21T22:00:46.118721+0000","last_clean":"2024-09-21T22:00:46.118721+0000","last_became_active":"2024-09-21T22:00:44.221481+0000","last_became_peered":"2024-09-21T22:00:44.221481+0000","last_unstale":"2024-09-21T22:00:46.118721+0000","last_undegraded":"2024-09-21T22:00:46.118721+0000","last_fullsized":"2024-09-21T22:00:46.118721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:51.492172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000509061,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.123906+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:00:46.123906+0000","last_peered":"2024-09-21T22:00:46.123906+0000","last_clean":"2024-09-21T22:00:46.123906+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:00:46.123906+0000","last_undegraded":"2024-09-21T22:00:46.123906+0000","last_fullsized":"2024-09-21T22:00:46.123906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188179+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:00:46.188179+0000","last_peered":"2024-09-21T22:00:46.188179+0000","last_clean":"2024-09-21T22:00:46.188179+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:00:46.188179+0000","last_undegraded":"2024-09-21T22:00:46.188179+0000","last_fullsized":"2024-09-21T22:00:46.188179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.188368+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:00:46.188368+0000","last_peered":"2024-09-21T22:00:46.188368+0000","last_clean":"2024-09-21T22:00:46.188368+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:00:46.188368+0000","last_undegraded":"2024-09-21T22:00:46.188368+0000","last_fullsized":"2024-09-21T22:00:46.188368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.122354+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:00:46.122354+0000","last_peered":"2024-09-21T22:00:46.122354+0000","last_clean":"2024-09-21T22:00:46.122354+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:00:46.122354+0000","last_undegraded":"2024-09-21T22:00:46.122354+0000","last_fullsized":"2024-09-21T22:00:46.122354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T22:00:46.187811+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:00:46.187811+0000","last_peered":"2024-09-21T22:00:46.187811+0000","last_clean":"2024-09-21T22:00:46.187811+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:00:46.187811+0000","last_undegraded":"2024-09-21T22:00:46.187811+0000","last_fullsized":"2024-09-21T22:00:46.187811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":662847,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":662847,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:00:51.441 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T22:00:51.441 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-21T22:00:51.718 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 22 2024-09-21T22:00:51.718 INFO:teuthology.orchestra.run.smithi102.stdout:fsid 014f3ec5-afd0-4b18-9c74-de91f34d0760 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:created 2024-09-21T22:00:24.916784+0000 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:modified 2024-09-21T22:00:49.698681+0000 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:crush_version 5 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:full_ratio 0.95 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:backfillfull_ratio 0.9 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:nearfull_ratio 0.85 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:require_min_compat_client luminous 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:min_compat_client jewel 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:require_osd_release squid 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:stretch_mode_enabled false 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-21T22:00:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:max_osd 8 2024-09-21T22:00:51.720 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6808/3559797623,v1:172.21.15.102:6809/3559797623] [v2:172.21.15.102:6810/3559797623,v1:172.21.15.102:6811/3559797623] exists,up ebc4f0b9-33fc-4301-b1c0-ac843b19095b 2024-09-21T22:00:51.720 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6824/428384344,v1:172.21.15.102:6825/428384344] [v2:172.21.15.102:6826/428384344,v1:172.21.15.102:6827/428384344] exists,up 1c8f54fe-439f-486e-8b8b-fe892332ada3 2024-09-21T22:00:51.720 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6816/4237051748,v1:172.21.15.102:6817/4237051748] [v2:172.21.15.102:6818/4237051748,v1:172.21.15.102:6819/4237051748] exists,up b202159c-804c-4d22-9aa3-8f590dce8faa 2024-09-21T22:00:51.720 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6800/3004236595,v1:172.21.15.102:6801/3004236595] [v2:172.21.15.102:6802/3004236595,v1:172.21.15.102:6803/3004236595] exists,up 28a8c407-a445-4c76-8d7c-d5a249d13e03 2024-09-21T22:00:51.720 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6824/743062291,v1:172.21.15.184:6825/743062291] [v2:172.21.15.184:6826/743062291,v1:172.21.15.184:6827/743062291] exists,up cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605 2024-09-21T22:00:51.720 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6808/2410886219,v1:172.21.15.184:6809/2410886219] [v2:172.21.15.184:6810/2410886219,v1:172.21.15.184:6811/2410886219] exists,up 7a0cc26e-a543-4647-bc53-fbecb69b2326 2024-09-21T22:00:51.720 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6800/2491178498,v1:172.21.15.184:6801/2491178498] [v2:172.21.15.184:6802/2491178498,v1:172.21.15.184:6803/2491178498] exists,up 7768eeb7-c6d0-47d8-a400-c47a2154c590 2024-09-21T22:00:51.720 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6816/1580142875,v1:172.21.15.184:6817/1580142875] [v2:172.21.15.184:6818/1580142875,v1:172.21.15.184:6819/1580142875] exists,up 30ed992b-2e99-4523-9fdd-8389f75940af 2024-09-21T22:00:51.731 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6808/3559797623,v1:172.21.15.102:6809/3559797623] [v2:172.21.15.102:6810/3559797623,v1:172.21.15.102:6811/3559797623] exists,up ebc4f0b9-33fc-4301-b1c0-ac843b19095b', 'osd.1 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6824/428384344,v1:172.21.15.102:6825/428384344] [v2:172.21.15.102:6826/428384344,v1:172.21.15.102:6827/428384344] exists,up 1c8f54fe-439f-486e-8b8b-fe892332ada3', 'osd.2 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6816/4237051748,v1:172.21.15.102:6817/4237051748] [v2:172.21.15.102:6818/4237051748,v1:172.21.15.102:6819/4237051748] exists,up b202159c-804c-4d22-9aa3-8f590dce8faa', 'osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6800/3004236595,v1:172.21.15.102:6801/3004236595] [v2:172.21.15.102:6802/3004236595,v1:172.21.15.102:6803/3004236595] exists,up 28a8c407-a445-4c76-8d7c-d5a249d13e03', 'osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6824/743062291,v1:172.21.15.184:6825/743062291] [v2:172.21.15.184:6826/743062291,v1:172.21.15.184:6827/743062291] exists,up cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605', 'osd.5 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6808/2410886219,v1:172.21.15.184:6809/2410886219] [v2:172.21.15.184:6810/2410886219,v1:172.21.15.184:6811/2410886219] exists,up 7a0cc26e-a543-4647-bc53-fbecb69b2326', 'osd.6 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6800/2491178498,v1:172.21.15.184:6801/2491178498] [v2:172.21.15.184:6802/2491178498,v1:172.21.15.184:6803/2491178498] exists,up 7768eeb7-c6d0-47d8-a400-c47a2154c590', 'osd.7 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6816/1580142875,v1:172.21.15.184:6817/1580142875] [v2:172.21.15.184:6818/1580142875,v1:172.21.15.184:6819/1580142875] exists,up 30ed992b-2e99-4523-9fdd-8389f75940af'] 2024-09-21T22:00:51.731 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-21T22:00:51.829 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mon.a", 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster": "ceph", 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "admin_socket_mode": "", 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_client_required": "cephx, none", 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_cluster_required": "cephx", 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_debug": "true", 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-21T22:00:51.830 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_service_required": "cephx", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_supported": "cephx", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_aio": "true", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_aio_poll_ms": "250", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_aio_reap_max": "16", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_async_discard": "false", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_block_size": "4096", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_debug_aio": "false", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_debug_inflight_ios": "false", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_enable_discard": "false", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_flock_retry": "3", 2024-09-21T22:00:51.831 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_inject_crash": "0", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_ioring": "false", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_ioring_hipri": "false", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_type": "", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_alloc_size": "1048576", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_allocator": "hybrid", 2024-09-21T22:00:51.832 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_buffered_io": "true", 2024-09-21T22:00:51.833 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_check_for_zeros": "false", 2024-09-21T22:00:51.833 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-21T22:00:51.833 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-21T22:00:51.833 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_compact_log_sync": "false", 2024-09-21T22:00:51.833 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-21T22:00:51.833 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-21T22:00:51.833 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-21T22:00:51.833 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-21T22:00:51.833 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_max_log_runway": "4194304", 2024-09-21T22:00:51.833 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_max_prefetch": "1048576", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_min_flush_size": "524288", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_min_log_runway": "1048576", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_replay_recovery": "false", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_sync_write": "false", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_allocation_from_file": "true", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_allocator": "hybrid", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-21T22:00:51.834 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bdev_label_multi": "true", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_create": "true", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_db_create": "false", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_db_path": "", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_db_size": "0", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_path": "", 2024-09-21T22:00:51.835 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_preallocate_file": "false", 2024-09-21T22:00:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_size": "107374182400", 2024-09-21T22:00:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_wal_create": "false", 2024-09-21T22:00:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_wal_path": "", 2024-09-21T22:00:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_wal_size": "100663296", 2024-09-21T22:00:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bluefs": "true", 2024-09-21T22:00:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-21T22:00:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-21T22:00:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-21T22:00:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-21T22:00:51.836 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_autotune": "true", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_size": "0", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-21T22:00:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_type": "2q", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_clone_cow": "true", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_mode": "none", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_csum_type": "crc32c", 2024-09-21T22:00:51.838 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_freelist": "false", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-21T22:00:51.839 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_small_allocations": "0", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_default_buffered_read": "true", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_default_buffered_write": "false", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fail_eio": "false", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-21T22:00:51.840 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_mount": "false", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_umount": "false", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-21T22:00:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_ignore_data_csum": "false", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_log_op_age": "5.000000", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_alloc_size": "0", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_blob_size": "0", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_deferred_txc": "32", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_min_alloc_size": "0", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-21T22:00:51.842 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_nid_prealloc": "1024", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_retry_disk_reads": "3", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_rocksdb_cf": "true", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-21T22:00:51.843 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_spdk_mem": "512", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_tracing": "false", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-21T22:00:51.844 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_zero_block_detection": "false", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-21T22:00:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_cluster_require_signatures": "false", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_cluster_require_version": "2", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_require_signatures": "false", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_require_version": "2", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_service_require_signatures": "false", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_service_require_version": "2", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_sign_messages": "true", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "chdir": "", 2024-09-21T22:00:51.846 INFO:teuthology.orchestra.run.smithi102.stdout: "client_acl_type": "", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_asio_thread_count": "2", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_cache_mid": "0.750000", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_cache_size": "16384", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_caps_release_delay": "5", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_check_pool_perm": "true", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_debug_force_sync_read": "false", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_debug_getattr_caps": "false", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_debug_inject_features": "", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_debug_inject_tick_delay": "0", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_die_on_failed_remount": "false", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_dirsize_rbytes": "true", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_force_lazyio": "false", 2024-09-21T22:00:51.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_fs": "", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_inject_release_failure": "false", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_max_inline_size": "4096", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_mds_namespace": "", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_metadata": "", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_mount_gid": "-1", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_mount_timeout": "300", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_mount_uid": "-1", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_mountpoint": "/", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_notify_timeout": "10", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc": "true", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc_max_dirty": "104857600", 2024-09-21T22:00:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc_max_objects": "1000", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc_size": "209715200", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc_target_dirty": "8388608", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_permissions": "true", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_quota": "true", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_quota_df": "true", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_readahead_max_bytes": "0", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_readahead_max_periods": "4", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_readahead_min": "131072", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_reconnect_stale": "false", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_shutdown_timeout": "30", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_snapdir": ".snap", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_tick_interval": "1", 2024-09-21T22:00:51.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_trace": "", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "client_try_dentry_invalidate": "false", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "client_use_faked_inos": "false", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "client_use_random_mds": "false", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_graylog": "false", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_graylog_port": "12201", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_monitors": "default=true", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_syslog": "false", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_syslog_level": "info", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "-", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_network": "", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_network_interface": "", 2024-09-21T22:00:51.850 INFO:teuthology.orchestra.run.smithi102.stdout: "compressor_zlib_isal": "false", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "compressor_zlib_level": "5", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "compressor_zlib_winsize": "-15", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "compressor_zstd_level": "1", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_alien_op_num_threads": "6", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_osd_stat_interval": "0", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_seastar_cpu_cores": "", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_seastar_num_threads": "0", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_location": "", 2024-09-21T22:00:51.851 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_location_hook": "", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_location_hook_timeout": "10", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "daemonize": "false", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "daos_pool": "tank", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_alienstore": "0/5", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_allow_any_pool_priority": "false", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_asok": "1/5", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_asok_assert_abort": "false", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_asserts_on_shutdown": "true", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_auth": "20/20", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_bdev": "1/3", 2024-09-21T22:00:51.852 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_bluefs": "1/5", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_bluestore": "1/5", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_buffer": "0/1", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_ceph_exporter": "1/5", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_cephfs_mirror": "0/5", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_cephsqlite": "0/5", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_client": "0/5", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_compressor": "1/5", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_context": "0/1", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_crimson_interrupt": "0/5", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_crush": "1/1", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_crypto": "1/5", 2024-09-21T22:00:51.853 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_cyanstore": "0/5", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_deliberately_leak_memory": "false", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_disable_randomized_ping": "false", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_dpdk": "1/5", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_eventtrace": "1/5", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_filer": "0/1", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_filestore": "1/3", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_finisher": "1/1", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_fuse": "1/5", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_heartbeat_testing_span": "0", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_heartbeatmap": "1/5", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-21T22:00:51.854 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_javaclient": "1/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_journal": "1/3", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_journaler": "0/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_kstore": "1/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_lockdep": "0/1", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mclock": "1/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds": "1/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_balancer": "1/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_locker": "1/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_log": "1/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_log_expire": "1/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_migrator": "1/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_quiesce": "3/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_memstore": "1/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mgr": "2/5", 2024-09-21T22:00:51.855 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mgrc": "1/5", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mon": "20/20", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_monc": "0/10", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_ms": "1/1", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_none": "0/5", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_objclass": "0/5", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_objectcacher": "0/5", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_objecter": "0/1", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_optracker": "0/5", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_osd": "1/5", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_paxos": "20/20", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_perfcounter": "1/5", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_prioritycache": "1/5", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rados": "0/5", 2024-09-21T22:00:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rbd": "0/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rbd_mirror": "0/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rbd_pwl": "0/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rbd_replay": "0/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_refs": "0/0", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_reserver": "1/1", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw": "1/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_access": "1/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_datacache": "1/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_dbstore": "1/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_flight": "1/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_sync": "1/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rocksdb": "4/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore": "0/5", 2024-09-21T22:00:51.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_backref": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_cache": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_cleaner": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_device": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_epm": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_journal": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_lba": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_odata": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_omap": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_onode": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_t": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_tm": "0/5", 2024-09-21T22:00:51.858 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_striper": "0/1", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_test": "0/5", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_throttle": "1/1", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_timer": "0/1", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_tp": "0/5", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_trace": "1/5", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "device_failure_prediction_mode": "none", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "err_to_graylog": "false", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "err_to_journald": "false", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "err_to_stderr": "true", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "err_to_syslog": "false", 2024-09-21T22:00:51.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event_tracing": "false", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_addr": "0.0.0.0", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_http_port": "9926", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_prio_limit": "5", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_sort_metrics": "true", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_stats_period": "5", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "fake_statfs_for_testing": "0", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "fatal_signal_handlers": "true", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "filer_max_purge_ops": "10", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "filer_max_truncate_ops": "128", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_apply_finisher_threads": "1", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_blackhole": "false", 2024-09-21T22:00:51.860 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_btrfs_clone_range": "true", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_btrfs_snap": "true", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_caller_concurrency": "10", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_collect_device_partition_information": "true", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_commit_timeout": "600.000000", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_debug_inject_read_err": "false", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_debug_omap_check": "false", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_debug_verify_split": "false", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_dump_file": "", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fadvise": "true", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fail_eio": "true", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fd_cache_shards": "16", 2024-09-21T22:00:51.861 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fd_cache_size": "128", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fiemap": "false", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fiemap_threshold": "4096", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_inject_stall": "0", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_journal_parallel": "false", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_journal_trailing": "false", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_journal_writeahead": "false", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_kill_at": "0", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-21T22:00:51.862 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattrs": "0", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_xattr_value_size": "0", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_merge_threshold": "-10", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_odsync_write": "false", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_omap_backend": "rocksdb", 2024-09-21T22:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_omap_backend_path": "", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_op_thread_timeout": "60", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_op_threads": "2", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_punch_hole": "false", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-21T22:00:51.864 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_max_ops": "50", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_seek_data_hole": "false", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_sloppy_crc": "false", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_splice": "false", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_split_multiple": "2", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_split_rand_factor": "20", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_update_to": "1000", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-21T22:00:51.865 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_enable": "true", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_xfs_extsize": "false", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_zfs_snap": "false", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "fio_dir": "/tmp/fio", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "014f3ec5-afd0-4b18-9c74-de91f34d0760", 2024-09-21T22:00:51.866 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_allow_other": "true", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_atomic_o_trunc": "true", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_big_writes": "true", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_debug": "false", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_default_permissions": "false", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_disable_pagecache": "false", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_max_write": "0", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_multithreaded": "true", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_require_active_mds": "true", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_set_user_groups": "true", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_splice_move": "true", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_splice_read": "true", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_splice_write": "true", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-21T22:00:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_use_invalidate_cb": "true", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "gss_target_name": "ceph", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_file": "", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_inject_failure": "0", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_interval": "5", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "host": "smithi102", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-21T22:00:51.868 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "inject_early_sigterm": "false", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "jaeger_agent_port": "6799", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "jaeger_tracing_enable": "false", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_aio": "true", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_align_min_size": "65536", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_block_align": "true", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_block_size": "4096", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_dio": "true", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_discard": "false", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_force_aio": "false", 2024-09-21T22:00:51.869 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_ignore_corruption": "false", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_max_write_bytes": "10485760", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_max_write_entries": "100", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_replay_from": "0", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_write_header_frequency": "0", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_zero_on_create": "false", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journaler_prefetch_periods": "10", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journaler_prezero_periods": "5", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "journaler_write_head_interval": "15", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "", 2024-09-21T22:00:51.870 INFO:teuthology.orchestra.run.smithi102.stdout: "keyfile": "", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_backend": "rocksdb", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_default_stripe_size": "65536", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_fsck_on_mount": "false", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_max_bytes": "67108864", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_max_ops": "512", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_nid_prealloc": "1024", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_onode_map_size": "1024", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_sync_submit_transaction": "false", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_sync_transaction": "false", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "librados_thread_count": "2", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "lockdep": "false", 2024-09-21T22:00:51.871 INFO:teuthology.orchestra.run.smithi102.stdout: "lockdep_force_backtrace": "false", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_coarse_timestamps": "true", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_flush_on_exit": "false", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_graylog_host": "127.0.0.1", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_graylog_port": "12201", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_max_new": "1000", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_max_recent": "10000", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_stderr_prefix": "", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_stop_at_utilization": "0.970000", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": "true", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_graylog": "false", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_journald": "false", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_stderr": "false", 2024-09-21T22:00:51.872 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_syslog": "false", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "max_rotating_auth_attempts": "10", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_action_on_write_error": "1", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_alternate_name_max": "8192", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_asio_thread_count": "2", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_export_pin": "true", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_fragment_dirs": "true", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_fragment_interval": "5", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_interval": "10", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_max": "-1", 2024-09-21T22:00:51.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_max_until": "-1", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_merge_size": "50", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_midchunk": "0.300000", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_min_start": "0.200000", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_minchunk": "0.001000", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_mode": "0", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_need_max": "1.200000", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_need_min": "0.800000", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_overload_epochs": "2", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_split_bits": "3", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-21T22:00:51.874 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_split_size": "10000", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_target_decay": "10.000000", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_beacon_grace": "15.000000", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_beacon_interval": "4.000000", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_mid": "0.700000", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_quiesce_delay": "0", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-21T22:00:51.875 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_release_free_interval": "10", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_reservation": "0.050000", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_trim_interval": "1", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_trim_threshold": "262144", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_client_prealloc_inos": "1000", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_connect_bootstrapping": "false", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_damage_table_max_entries": "10000", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_debug_auth_pins": "false", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_debug_frag": "false", 2024-09-21T22:00:51.876 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_debug_scatterstat": "false", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_debug_subtrees": "false", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_decay_halflife": "5.000000", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_default_dir_hash": "2", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_defer_session_stale": "true", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_deny_all_reconnect": "false", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dir_keys_per_op": "16384", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dir_max_commit_size": "10", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dir_max_entries": "0", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dir_prefetch": "true", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dump_cache_on_map": "false", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-21T22:00:51.877 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_early_reply": "true", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_enable_op_tracker": "true", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_enforce_unique_name": "true", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_export_ephemeral_random": "true", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-21T22:00:51.878 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_health_summarize_threshold": "10", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_health_dummy": "false", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_migrator_session_race": "false", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_join_fs": "", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_journal_format": "1", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_create_at": "0", 2024-09-21T22:00:51.879 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_export_at": "0", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_import_at": "0", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_journal_at": "0", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_journal_expire_at": "0", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_journal_replay_at": "0", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_link_at": "0", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_mdstable_at": "0", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_openc_at": "0", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_rename_at": "0", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_shutdown_at": "0", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_event_large_threshold": "524288", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_events_per_segment": "1024", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_max_events": "-1", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_max_segments": "128", 2024-09-21T22:00:51.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_pause": "false", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_segment_size": "0", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_trim_threshold": "128", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_warn_factor": "2.000000", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_caps_per_client": "1048576", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_completed_flushes": "100000", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_completed_requests": "100000", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_export_size": "20971520", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_file_recover": "32", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_purge_files": "64", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_purge_ops": "8192", 2024-09-21T22:00:51.881 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_snaps_per_dir": "100", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_metrics_update_interval": "2", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_min_caps_per_client": "100", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_min_caps_working_set": "10000", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_numa_node": "-1", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_complaint_time": "30.000000", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_history_duration": "600", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_history_size": "20", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_history_slow_op_size": "20", 2024-09-21T22:00:51.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_log_threshold": "5", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_ping_grace": "15", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_ping_interval": "5", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_max_caps": "30000", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_warning_threshold": "262144", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_replay_interval": "1.000000", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-21T22:00:51.883 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_root_ino_gid": "0", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_root_ino_uid": "0", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_shutdown_check": "0", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_skip_ino": "0", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-21T22:00:51.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_snap_max_uid": "4294967294", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_snap_min_uid": "0", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_snap_rstat": "false", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_standby_replay_damaged": "false", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_symlink_recovery": "true", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_thrash_exports": "0", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_thrash_fragments": "0", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_tick_interval": "5.000000", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_valgrind_exit": "false", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_verify_backtrace": "1", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_verify_scatter": "false", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_wipe_sessions": "false", 2024-09-21T22:00:51.885 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool_debug": "false", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "memstore_device_bytes": "1073741824", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "memstore_page_set": "false", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "memstore_page_size": "65536", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_client_bytes": "134217728", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_client_messages": "512", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_disabled_modules": "", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_enable_op_tracker": "true", 2024-09-21T22:00:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_max_pg_num_change": "128", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_mds_bytes": "134217728", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_mds_messages": "128", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_mon_bytes": "134217728", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_mon_messages": "128", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_op_history_duration": "600", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_op_history_size": "20", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_op_log_threshold": "5", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_osd_bytes": "536870912", 2024-09-21T22:00:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_osd_messages": "8192", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_pool": "true", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_standby_modules": "true", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_stats_period": "5", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_stats_threshold": "5", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_tick_period": "2", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_allow_pool_delete": "true", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_allow_pool_size_one": "true", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_auth_validate_all_caps": "true", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-21T22:00:51.888 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_bytes": "104857600", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_directed_command_retry": "5", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_hunt_parallel": "3", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_log_interval": "1.000000", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_ping_interval": "10.000000", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_target_rank": "-1", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-21T22:00:51.889 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_file_level": "debug", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_file": "true", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_journald": "false", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_compact_on_bootstrap": "false", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_compact_on_start": "false", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_compact_on_trim": "true", 2024-09-21T22:00:51.890 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cpu_threads": "4", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_crush_min_required_version": "hammer", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_daemon_bytes": "419430400", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_data_avail_crit": "5", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_data_avail_warn": "5", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_data_size_warn": "16106127360", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_dump_json": "false", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_dump_transactions": "false", 2024-09-21T22:00:51.891 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_extra_checks": "false", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_no_require_reef": "false", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_no_require_squid": "false", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_down_mkfs_grace": "120", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_down_uptime_grace": "60", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_election_default_strategy": "1", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_election_timeout": "5.000000", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_elector_ping_divisor": "2", 2024-09-21T22:00:51.892 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_enable_op_tracker": "true", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_fake_pool_delete": "false", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_force_quorum_join": "false", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_globalid_prealloc": "10000", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_detail_to_clog": "false", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_log_update_period": "5", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_max_detail": "50", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_to_clog": "true", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_to_clog_interval": "600", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_host": "172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],172.21.15.184", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_host_override": "", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_initial_members": "", 2024-09-21T22:00:51.893 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_lease": "5.000000", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_log_full_interval": "50", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_log_max": "10000", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_log_max_summary": "50", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_log_epochs": "500", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-21T22:00:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_osd": "10000", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_pg_per_osd": "10000", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_pool_pg_num": "65536", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mds_force_trim_to": "0", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mds_skip_sanity": "false", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_memory_autotune": "true", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_memory_target": "2147483648", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_beacon_grace": "30", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_digest_period": "5", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_inactive_grace": "60", 2024-09-21T22:00:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_min_osdmap_epochs": "500", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_complaint_time": "30", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_history_duration": "600", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_history_size": "20", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_history_slow_op_size": "20", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_log_threshold": "5", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_auto_mark_in": "false", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-21T22:00:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_cache_size": "500", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_down_out_interval": "600", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_force_trim_to": "0", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-21T22:00:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_min_down_reporters": "2", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_report_timeout": "900", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-21T22:00:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_stuck_threshold": "60", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_probe_timeout": "2.000000", 2024-09-21T22:00:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_reweight_max_change": "0.050000", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_reweight_max_osds": "4", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_scrub_interval": "86400", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_scrub_max_keys": "100", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_scrub_timeout": "300", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_session_timeout": "300", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_smart_report_timeout": "5", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_stat_smooth_intervals": "6", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-21T22:00:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_stretch_pool_min_size": "2", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_stretch_pool_size": "4", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_debug": "false", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_provider_kill_at": "0", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_requester_kill_at": "0", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_timeout": "60.000000", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_target_pg_per_osd": "100", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_tick_interval": "5", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_timecheck_interval": "300.000000", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_use_min_delay_socket": "false", 2024-09-21T22:00:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_older_version_delay": "604800", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_misplaced": "false", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_older_version": "true", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-21T22:00:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "monmap": "", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_tracing_enabled": "false", 2024-09-21T22:00:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_op_threads": "3", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_cm": "false", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_device_name": "", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_dscp": "96", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_local_gid": "", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_port_num": "1", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-21T22:00:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_sl": "3", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_support_srq": "true", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_type": "ib", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_reap_threshold": "5", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_before_connect": "false", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_ipv4": "true", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_ipv6": "false", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_msgr1": "true", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_msgr2": "true", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_port_max": "7568", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_port_min": "6800", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_retry_count": "3", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_retry_delay": "5", 2024-09-21T22:00:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_blackhole_client": "false", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_blackhole_mds": "false", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_blackhole_mgr": "false", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_blackhole_mon": "false", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_blackhole_osd": "false", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_client_mode": "crc secure", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_cluster_mode": "crc secure", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_cluster_type": "", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_compress_secure": "false", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_connection_idle_timeout": "900", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_connection_ready_timeout": "10", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_crc_data": "true", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_crc_header": "true", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_die_on_bad_msg": "false", 2024-09-21T22:00:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_die_on_bug": "true", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_die_on_old_message": "true", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_die_on_skipped_message": "false", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_coremask": "0xF", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_enable_tso": "true", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_hugepages": "", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-21T22:00:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_lro": "true", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_memory_channel": "4", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_pmd": "", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_port_id": "0", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dump_on_send": "false", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_initial_backoff": "0.200000", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_delay_max": "1.000000", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_delay_type": "", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_network_congestion": "0", 2024-09-21T22:00:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_socket_failures": "5000", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_learn_addr_from_peer": "true", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_max_accept_failures": "4", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_max_backoff": "15.000000", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_mon_client_mode": "secure crc", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_mon_service_mode": "secure crc", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_osd_compress_min_size": "1024", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_osd_compress_mode": "none", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_pq_min_cost": "65536", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_public_type": "", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_service_mode": "crc secure", 2024-09-21T22:00:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_tcp_listen_backlog": "512", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_tcp_nodelay": "true", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_tcp_rcvbuf": "0", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_type": "async+posix", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "no_config_file": "false", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_completion_locks_per_session": "32", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_inflight_ops": "1024", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_tick_interval": "5.000000", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_timeout": "10.000000", 2024-09-21T22:00:51.910 INFO:teuthology.orchestra.run.smithi102.stdout: "objectstore_blackhole": "false", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "openssl_engine_opts": "", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_delay_time": "5.000000", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_hist_halflife": "1000", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_max_low_ops": "2", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_max_ops": "4", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_slop": "0.020000", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_asio_thread_count": "2", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_async_recovery_min_cost": "100", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-21T22:00:51.911 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backfill_scan_max": "512", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backfill_scan_min": "64", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backoff_on_degraded": "false", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backoff_on_peering": "false", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backoff_on_unfound": "true", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_beacon_report_interval": "300", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bench_duration": "30", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bench_max_block_size": "67108864", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_blkin_trace_all": "false", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-21T22:00:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_check_for_log_corruption": "false", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_class_update_on_start": "true", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_client_message_cap": "256", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_client_message_size_cap": "524288000", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_client_op_priority": "63", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_client_watch_timeout": "30", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_command_max_records": "256", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_compact_on_start": "false", 2024-09-21T22:00:51.913 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_crush_update_on_start": "true", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_crush_update_weight_set": "true", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_feed_pullee": "-1", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-21T22:00:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_misdirected_ops": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_no_acting_change": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_no_purge_strays": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_op_order": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_shutdown": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_trim_objects": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-21T22:00:51.915 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_verify_snaps": "false", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_keys": "1024", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_stride": "524288", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_default_notify_timeout": "30", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_delete_sleep": "0.000000", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-21T22:00:51.916 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_discard_disconnected_ops": "true", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_enable_op_tracker": "true", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_fast_info": "true", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_fast_shutdown": "true", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_function_tracing": "false", 2024-09-21T22:00:51.917 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_grace": "20", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_interval": "6", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_min_peers": "10", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_min_size": "2000", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_stale": "600", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_hit_set_max_size": "100000", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_hit_set_min_size": "1000", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-21T22:00:51.918 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_journal_size": "5120", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_kill_backfill_at": "0", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_map_cache_size": "50", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_map_dedup": "true", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_map_message_max": "40", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_map_share_max_epochs": "40", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_attr_name_len": "100", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_attr_size": "0", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_backfills": "1", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_markdown_count": "5", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_markdown_period": "600", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_object_name_len": "2048", 2024-09-21T22:00:51.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_object_namespace_len": "256", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_object_size": "134217728", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_pg_blocked_by": "16", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_pg_log_entries": "10000", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_pgls": "1024", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_push_cost": "8388608", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_push_objects": "10", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_scrubs": "3", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_trimming_pgs": "2", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_write_op_reply_len": "64", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_write_size": "90", 2024-09-21T22:00:51.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_profile": "balanced", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-21T22:00:51.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_base": "805306368", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_cache_min": "134217728", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_target": "4294967296", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_target_autotune": "false", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_min_pg_log_entries": "250", 2024-09-21T22:00:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_min_recovery_priority": "0", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mon_report_interval": "5", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_num_cache_shards": "32", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_num_op_tracker_shard": "32", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_numa_auto_affinity": "true", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_numa_node": "-1", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_numa_prefer_iface": "true", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_objecter_finishers": "1", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_objectstore": "bluestore", 2024-09-21T22:00:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_objectstore_fuse": "false", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_objectstore_tracing": "false", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_complaint_time": "30.000000", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_history_duration": "600", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_history_size": "20", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_history_slow_op_size": "20", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_log_threshold": "5", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_shards": "0", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_shards_hdd": "5", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_shards_ssd": "8", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-21T22:00:51.924 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_pq_min_cost": "65536", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_queue_cut_off": "high", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_thread_timeout": "15", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_open_classes_on_start": "true", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_os_flags": "0", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_peering_op_priority": "255", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_delete_cost": "1048576", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_delete_priority": "5", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_log_trim_max": "10000", 2024-09-21T22:00:51.925 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_log_trim_min": "100", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_crimson": "false", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-21T22:00:51.926 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flags": "0", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_min_size": "0", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_pg_num": "32", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_pgp_num": "0", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_read_ratio": "70", 2024-09-21T22:00:51.927 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_size": "2", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_type": "replicated", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_push_per_object_cost": "1000", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recover_clone_overlap": "true", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_cost": "20971520", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_active": "0", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-21T22:00:51.928 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_single_start": "1", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_op_priority": "3", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_priority": "5", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_sleep": "0.000000", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_repair_during_recovery": "false", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_requested_scrub_priority": "120", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_auto_repair": "false", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-21T22:00:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_begin_hour": "0", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_begin_week_day": "0", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_chunk_max": "25", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_chunk_min": "5", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_cost": "52428800", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_during_recovery": "false", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_end_hour": "0", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_end_week_day": "0", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_event_cost": "4096", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_invalid_stats": "true", 2024-09-21T22:00:51.930 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_max_preemptions": "5", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_priority": "5", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_sleep": "0.000000", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_skip_data_digest": "false", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_smart_report_timeout": "5", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_cost": "1048576", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_priority": "5", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-21T22:00:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_target_transaction_size": "30", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-21T22:00:51.932 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tracing": "false", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_use_stale_snap": "false", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "osdc_blkin_trace_all": "false", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_kill_at": "0", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_max_join_drift": "10", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_min": "500", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_min_wait": "0.050000", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_propose_interval": "1.000000", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_service_trim_max": "500", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_service_trim_min": "250", 2024-09-21T22:00:51.933 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_stash_full_interval": "25", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_trim_max": "500", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_trim_min": "250", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "perf": "true", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "-", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrv": "", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "public_bind_addr": "-", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "public_network": "", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "public_network_interface": "", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "qat_compressor_busy_polling": "false", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "qat_compressor_enabled": "false", 2024-09-21T22:00:51.934 INFO:teuthology.orchestra.run.smithi102.stdout: "qat_compressor_session_max_number": "256", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rados_mon_op_timeout": "0", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rados_osd_op_timeout": "0", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rados_tracing": "false", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_atime_update_interval": "60", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_balance_parent_reads": "false", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_balance_snap_reads": "false", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_blkin_trace_all": "false", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache": "true", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-21T22:00:51.935 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_policy": "writearound", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_size": "33554432", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_clone_copy_on_read": "false", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_compression_hint": "none", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_concurrent_management_ops": "10", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_clone_format": "auto", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_data_pool": "", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_features": "61", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_format": "2", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_map_options": "", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_order": "22", 2024-09-21T22:00:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_pool": "rbd", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_stripe_count": "0", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_stripe_unit": "0", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_enable_alloc_hint": "true", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_io_scheduler": "simple", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-21T22:00:51.937 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_order": "24", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_pool": "", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_splay_width": "4", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_localize_parent_reads": "false", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_localize_snap_reads": "false", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-21T22:00:51.938 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-21T22:00:51.939 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mtime_update_interval": "60", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_non_blocking_aio": "true", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_op_thread_timeout": "60", 2024-09-21T22:00:51.940 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_op_threads": "1", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_parent_cache_enabled": "false", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_plugins": "", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_bps_burst": "0", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_bps_limit": "0", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_exclude_ops": "0", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_iops_burst": "0", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_iops_limit": "0", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-21T22:00:51.941 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_read_from_replica_policy": "default", 2024-09-21T22:00:51.942 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_skip_partial_discard": "true", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_tracing": "false", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_validate_names": "true", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_validate_pool": "true", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "restapi_base_url": "", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "restapi_log_level": "", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_acl_grants_max_num": "100", 2024-09-21T22:00:51.943 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_admin_entry": "admin", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_backend_store": "rados", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_barbican_url": "", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_beast_enable_async": "true", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_counters_cache": "false", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_cache_enabled": "true", 2024-09-21T22:00:51.944 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_cache_expiry_interval": "900", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_cache_lru_size": "25000", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_config_store": "rados", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_content_length_compat": "false", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_copy_obj_progress": "true", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_cors_rules_max_num": "100", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_cross_domain_policy": "", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_addr": "", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-21T22:00:51.945 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_password": "", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_username": "", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_require_ssl": "true", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-21T22:00:51.946 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_addr": "", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_auth": "token", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_namespace": "", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_prefix": "", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_token_file": "", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-21T22:00:51.947 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_curl_buffersize": "524288", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_curl_low_speed_time": "300", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d4n_port": "6379", 2024-09-21T22:00:51.948 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_log_changes_size": "1000", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_log_num_shards": "128", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_log_window": "30", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-21T22:00:51.949 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-21T22:00:51.950 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dns_name": "", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dns_s3website_name": "", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dynamic_resharding": "true", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_gc_threads": "true", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_lc_threads": "true", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_ops_log": "false", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_quota_threads": "true", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_static_website": "false", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_usage_log": "false", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enforce_swift_acls": "true", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_exit_timeout_secs": "120", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_expose_bucket": "false", 2024-09-21T22:00:51.951 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_extended_http_attrs": "", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_filter": "none", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_frontends": "beast port=7480", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_deferred": "50", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_objs": "32", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_processor_period": "3600", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-21T22:00:51.952 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_init_timeout": "300", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_kafka_connection_idle": "300", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_domain": "", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_password": "", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_password_path": "", 2024-09-21T22:00:51.953 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_project": "", 2024-09-21T22:00:51.954 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_tenant": "", 2024-09-21T22:00:51.954 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_token": "", 2024-09-21T22:00:51.954 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_token_path": "", 2024-09-21T22:00:51.954 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_user": "", 2024-09-21T22:00:51.954 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_api_version": "2", 2024-09-21T22:00:51.954 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_barbican_domain": "", 2024-09-21T22:00:51.954 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_barbican_password": "", 2024-09-21T22:00:51.954 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_barbican_project": "", 2024-09-21T22:00:51.954 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-21T22:00:51.954 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_barbican_user": "", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_url": "", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_debug_interval": "-1", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_lock_max_time": "90", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_max_objs": "32", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_max_rules": "1000", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_max_worker": "3", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-21T22:00:51.955 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_thread_delay": "0", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_dnattr": "uid", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_searchfilter": "", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_uri": "", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_log_http_headers": "", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_log_object_name_utc": "false", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-21T22:00:51.956 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_attr_name_len": "0", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_attr_size": "0", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_chunk_size": "4194304", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_listing_results": "1000", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_notify_retries": "10", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_put_param_size": "1048576", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_put_size": "5368709120", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_slo_entries": "1000", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_md_log_max_shards": "64", 2024-09-21T22:00:51.957 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_mp_lock_max_time": "600", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-21T22:00:51.958 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_max_gc": "300", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_num_async_rados_threads": "32", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_num_control_oids": "8", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_numa_node": "-1", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_objexp_chunk_size": "100", 2024-09-21T22:00:51.959 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_objexp_gc_interval": "600", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_op_thread_timeout": "600", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_op_tracing": "false", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_opa_token": "", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_opa_url": "", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_opa_verify_ssl": "true", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ops_log_rados": "false", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ops_log_socket_path": "", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-21T22:00:51.960 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_period_push_interval": "2.000000", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_cache_lanes": "3", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_cache_partitions": "3", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_print_continue": "true", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-21T22:00:51.961 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_rados_tracing": "false", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_realm": "", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_realm_id": "", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_region": "", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_request_uri": "", 2024-09-21T22:00:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_reshard_batch_size": "64", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_reshard_max_aio": "128", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_reshard_num_logs": "16", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_reshard_thread_interval": "600", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_resolve_cname": "false", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_run_sync_thread": "true", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-21T22:00:51.963 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_scheduler_type": "throttler", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_script_uri": "", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_service_provider_name": "", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_client_id": "", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_client_secret": "", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_entry": "sts", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_key": "sts", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_min_session_duration": "900", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_token_introspection_url": "", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_account_in_url": "false", 2024-09-21T22:00:51.964 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_auth_entry": "auth", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_auth_url": "", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_custom_header": "", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_need_stats": "true", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_tenant_name": "", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_token_expiration": "86400", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_url": "", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_url_prefix": "swift", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_lease_period": "120", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-21T22:00:51.965 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_thread_pool_size": "512", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_comment": "", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_createby": "", 2024-09-21T22:00:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_encoding": "", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_flag": "false", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_origin": "", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_tracker": "", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_trust_forwarded_https": "false", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_usage_max_shards": "32", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_usage_max_user_shards": "1", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_use_opa_authz": "false", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_counters_cache": "false", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-21T22:00:51.967 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_max_buckets": "1000", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_policies_max_num": "100", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_unique_email": "true", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_verify_ssl": "true", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zone": "", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zone_id": "", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zonegroup": "", 2024-09-21T22:00:51.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zonegroup_id": "", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rgwlc_auto_session_clear": "true", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_block_size": "4096", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_size": "536870912", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-21T22:00:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_index_type": "binary_search", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_partition_filters": "false", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_perf": "false", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "run_dir": "/var/run/ceph", 2024-09-21T22:00:51.970 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_block_create": "true", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_cache_lru_size": "67108864", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_default_max_object_size": "16777216", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_device_size": "53687091200", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_full_integrity_check": "false", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_journal_batch_capacity": "16", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_main_device_type": "SSD", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-21T22:00:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_segment_size": "67108864", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "set_keepcaps": "false", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "setgroup": "", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "setuser": "", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "setuser_match_path": "", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "thp": "false", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "threadpool_default_timeout": "60", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout: "throttler_perf_counter": "true" 2024-09-21T22:00:51.972 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:51.974 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-21T22:00:52.086 INFO:teuthology.orchestra.run.smithi102.stdout:mon.a: {} 2024-09-21T22:00:52.086 INFO:teuthology.orchestra.run.smithi102.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:00:52.095 INFO:teuthology.orchestra.run.smithi102.stdout:mon.b: {} 2024-09-21T22:00:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:00:52.104 INFO:teuthology.orchestra.run.smithi102.stdout:mon.c: {} 2024-09-21T22:00:52.104 INFO:teuthology.orchestra.run.smithi102.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:00:52.114 DEBUG:teuthology.orchestra.run.smithi184:> type ceph-objectstore-tool 2024-09-21T22:00:52.132 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-21T22:00:52.132 DEBUG:teuthology.orchestra.run.smithi102:> type ceph-objectstore-tool 2024-09-21T22:00:52.147 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-21T22:00:52.147 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-21T22:00:52.157 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-21T22:00:52.157 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-21T22:00:52.157 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:00:52.157 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:00:52.157 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-21T22:00:52.157 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.148456 2024-09-21T22:00:52.158 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.14845596533983285 2024-09-21T22:00:52.158 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-21T22:00:52.158 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-21T22:00:52.158 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:00:52.159 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-21T22:00:52.159 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:00:52.159 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-21T22:00:52.159 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:00:52.159 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-21T22:00:52.175 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:52.173+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:52.224 INFO:teuthology.orchestra.run.smithi102.stdout:mapped writes DISABLED 2024-09-21T22:00:52.224 INFO:teuthology.orchestra.run.smithi102.stdout:mapped reads DISABLED 2024-09-21T22:00:52.224 INFO:teuthology.orchestra.run.smithi102.stdout:Seed set to 2598 2024-09-21T22:00:52.265 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:52.264+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:00:52.304 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:52.304 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:52.304 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:00:52.304 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:52.316 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:00:52.324 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:00:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:00:52.343 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:00:52.343 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:00:52.361 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:00:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:00:52.361 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:52.360+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:00:52.377 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:00:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:00:52.395 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:00:52.395 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:00:52.413 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:00:52.413 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:00:52.430 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:00:52.430 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:00:52.431 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:52.432 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:52.441 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:00:52.448 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:00:52.448 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:00:52.501 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:52.500+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:00:52.552 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:52.553 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:52.562 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:00:52.603 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:52.602+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:00:52.664 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:52.662+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:00:52.704 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:52.705 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:52.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:00:52.764 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:52.763+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:52.816 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:52.817 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:52.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:00:52.866 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:52.864+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:52.928 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:52.928 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:52.936 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:00:52.980 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:52.979+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:00:53.039 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:53.039 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:53.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:00:53.068 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:53.067+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:53.148 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.1 primary-affinity to 0.148456 (897292) 2024-09-21T22:00:53.148 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:00:53.170 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:53.168+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:00:53.199 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:53.199 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:53.208 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:00:53.292 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:00:53.291+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:00:53.351 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:53.352 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:53.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:00:53.401 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:53.400+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:00:53.472 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:53.471+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:00:53.503 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:53.503 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:53.512 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:00:53.573 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:53.571+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:00:53.654 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:53.655 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:53.663 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:00:53.673 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:53.671+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:00:53.766 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:53.766 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:53.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:00:53.778 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:53.777+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:00:53.875 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:53.874+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:00:53.894 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:53.895 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:53.902 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:00:53.988 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:53.986+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:00:54.046 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:54.046 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:54.055 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:00:54.098 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:54.094+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:54.179 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:00:54.178+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:00:54.209 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:54.209 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:54.217 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:00:54.280 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:54.278+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:54.321 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:54.321 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:54.330 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:00:54.381 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:54.380+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:00:54.460 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:00:54.472 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:54.473 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:54.481 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:00:54.505 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:54.504+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:00:54.583 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:54.582+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:00:54.584 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:54.584 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:54.589 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:00:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:00:54.593 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:00:54.606 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:00:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:00:54.622 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:00:54.622 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:00:54.638 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:00:54.638 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:00:54.654 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:00:54.654 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:00:54.671 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:00:54.671 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:00:54.684 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:54.683+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:00:54.687 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:00:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:00:54.697 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:00:54.698 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:00:54.698 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:00:54.698 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:00:54.704 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:00:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:00:54.707 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:00:54.784 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:54.783+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:54.810 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:00:54.810 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:00:54.810 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:00:54.810 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:00:54.811 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:00:54.819 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:00:54.903 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:54.901+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:54.962 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:00:54.962 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:00:54.963 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:00:54.963 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [] 2024-09-21T22:00:54.963 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:00:54.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:00:54.986 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:54.985+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:00:55.088 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:55.087+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:00:55.114 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:00:55.114 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:00:55.115 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:00:55.115 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:00:55.123 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:00:55.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:00:55.215 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:55.213+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:00:55.227 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:00:55.227 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:00:55.227 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:00:55.227 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:00:55.227 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:00:55.236 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:00:55.290 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:55.288+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:00:55.341 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:00:55.341 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:00:55.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:00:55.341 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:00:55.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.341 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.341 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 17.264849583, 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:00:55.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:00:55.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.980354291000001, 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099026370000000006, 2024-09-21T22:00:55.349 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 36 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357881+0000", 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3139999999999999e-06 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357884+0000", 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6799999999999999e-06 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357888+0000", 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.286e-06 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.361833+0000", 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0039451979999999996 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.361912+0000", 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8916000000000001e-05 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362042+0000", 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013033700000000001 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.364625+0000", 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0025829170000000001 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367727+0000", 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031021540000000002 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367759+0000", 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1711999999999997e-05 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367779+0000", 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0726000000000001e-05 2024-09-21T22:00:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.357896+0000", 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.980334642999999, 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099972970000000005, 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 37 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357896+0000", 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357896+0000", 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357897+0000", 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9999999999999999e-07 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357900+0000", 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.768e-06 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357903+0000", 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8500000000000004e-06 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357907+0000", 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2710000000000001e-06 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362472+0000", 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045652560000000002 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362538+0000", 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6078e-05 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362624+0000", 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5958999999999995e-05 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.364646+0000", 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.002022041 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367814+0000", 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031681880000000002 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367850+0000", 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6248999999999998e-05 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367894+0000", 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3337000000000002e-05 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:74 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.401975+0000", 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.936256173, 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0082466589999999999, 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 74 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.401975+0000", 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.401975+0000", 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.401976+0000", 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8599999999999997e-07 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.401981+0000", 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8080000000000004e-06 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.401988+0000", 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5730000000000002e-06 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.401994+0000", 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6030000000000004e-06 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.403463+0000", 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0014691229999999999 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.403555+0000", 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1803000000000002e-05 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.403661+0000", 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010626800000000001 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.404139+0000", 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00047826999999999999 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.410168+0000", 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0060284090000000002 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.410199+0000", 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1300000000000002e-05 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.410222+0000", 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2716000000000001e-05 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.419896+0000", 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.918335032999998, 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0079668470000000009, 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 87 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.419896+0000", 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.419896+0000", 2024-09-21T22:00:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.419897+0000", 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4000000000000002e-07 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.419960+0000", 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3035999999999998e-05 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.419969+0000", 2024-09-21T22:00:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9809999999999992e-06 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.419975+0000", 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5590000000000002e-06 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.422691+0000", 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027157769999999999 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.422740+0000", 2024-09-21T22:00:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8772e-05 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.422829+0000", 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8942000000000003e-05 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.424319+0000", 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0014900569999999999 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.427805+0000", 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0034862109999999999 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.427838+0000", 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3374999999999998e-05 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.427863+0000", 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4596999999999998e-05 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.419988+0000", 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.918242908, 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0079945080000000009, 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 88 2024-09-21T22:00:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.419988+0000", 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.419988+0000", 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.419989+0000", 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2200000000000003e-07 2024-09-21T22:00:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.419994+0000", 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1229999999999999e-06 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.420001+0000", 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4980000000000003e-06 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.420006+0000", 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2490000000000001e-06 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.423880+0000", 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0038738959999999999 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.423940+0000", 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9752e-05 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.424050+0000", 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011068100000000001 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.424683+0000", 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00063310099999999995 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.427903+0000", 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003219347 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.427939+0000", 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6570999999999999e-05 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.427983+0000", 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3467999999999998e-05 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.782019560999998, 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095823990000000001, 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 110 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:00:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556217+0000", 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5889999999999996e-06 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556226+0000", 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3910000000000004e-06 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556232+0000", 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8089999999999998e-06 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559353+0000", 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031209219999999999 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559420+0000", 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7195999999999998e-05 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559525+0000", 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000104947 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.560853+0000", 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0013283170000000001 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565693+0000", 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0048393050000000003 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565755+0000", 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2360000000000006e-05 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565794+0000", 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8859000000000002e-05 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.781987390000001, 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096657129999999994, 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 111 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0699999999999996e-07 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556249+0000", 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6120000000000001e-06 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556257+0000", 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8220000000000007e-06 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556292+0000", 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5439999999999999e-05 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559894+0000", 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003601599 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559981+0000", 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7082000000000004e-05 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.560150+0000", 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00016919299999999999 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562194+0000", 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.002043572 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565841+0000", 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0036475610000000001 2024-09-21T22:00:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565878+0000", 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6681000000000003e-05 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565909+0000", 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1443999999999999e-05 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556312+0000", 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.781919180999999, 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096874349999999994, 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 112 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556312+0000", 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556312+0000", 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556313+0000", 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3799999999999996e-07 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556412+0000", 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9259999999999995e-05 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556422+0000", 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0413e-05 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556430+0000", 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2300000000000002e-06 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561110+0000", 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046802759999999997 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561160+0000", 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0611e-05 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561250+0000", 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9979e-05 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563304+0000", 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0020534220000000001 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565948+0000", 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0026440790000000001 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565978+0000", 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0357000000000001e-05 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565999+0000", 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.107e-05 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556443+0000", 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.781788050999999, 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096365949999999995, 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 113 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556443+0000", 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556443+0000", 2024-09-21T22:00:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556444+0000", 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0999999999999997e-07 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556450+0000", 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8259999999999998e-06 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556462+0000", 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2588999999999999e-05 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556468+0000", 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9290000000000003e-06 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561729+0000", 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0052607690000000002 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561822+0000", 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2948000000000005e-05 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561925+0000", 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103379 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563890+0000", 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0019645169999999998 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.566029+0000", 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0021388869999999999 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.566058+0000", 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9014999999999999e-05 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.566080+0000", 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1826000000000001e-05 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556481+0000", 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.781749932, 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011982389, 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 114 2024-09-21T22:00:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556481+0000", 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556481+0000", 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556482+0000", 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2099999999999996e-07 2024-09-21T22:00:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556488+0000", 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5950000000000004e-06 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556495+0000", 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556501+0000", 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4110000000000004e-06 2024-09-21T22:00:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562235+0000", 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0057339399999999999 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562311+0000", 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6307e-05 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562408+0000", 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7388999999999999e-05 2024-09-21T22:00:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563894+0000", 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0014856699999999999 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568375+0000", 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0044804830000000004 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568427+0000", 2024-09-21T22:00:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2462e-05 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568464+0000", 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6529000000000002e-05 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556511+0000", 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.781720167, 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012065541000000001, 2024-09-21T22:00:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 115 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556511+0000", 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556511+0000", 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556512+0000", 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6599999999999996e-07 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556585+0000", 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3905000000000005e-05 2024-09-21T22:00:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556596+0000", 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0549e-05 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556602+0000", 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0090000000000004e-06 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562744+0000", 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0061415410000000004 2024-09-21T22:00:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562801+0000", 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7499e-05 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562887+0000", 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5549000000000004e-05 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563902+0000", 2024-09-21T22:00:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0010152749999999999 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568513+0000", 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.004611118 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568548+0000", 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5261e-05 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568577+0000", 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8269e-05 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556616+0000", 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.781615195000001, 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012059043, 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 116 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556616+0000", 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556616+0000", 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556617+0000", 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6899999999999996e-07 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556622+0000", 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1719999999999998e-06 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556632+0000", 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0284e-05 2024-09-21T22:00:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556639+0000", 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0110000000000003e-06 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563457+0000", 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0068177769999999997 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563534+0000", 2024-09-21T22:00:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7453999999999994e-05 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563625+0000", 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0243999999999999e-05 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.564337+0000", 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00071240099999999998 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568622+0000", 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0042851169999999997 2024-09-21T22:00:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568652+0000", 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0179e-05 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568675+0000", 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2634999999999999e-05 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.781580394999999, 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012111705, 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 117 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3499999999999996e-07 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556656+0000", 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3000000000000003e-06 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556666+0000", 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0020999999999999e-05 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556673+0000", 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1810000000000004e-06 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563928+0000", 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0072551129999999997 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563984+0000", 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6267000000000002e-05 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.564080+0000", 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6211000000000004e-05 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.564582+0000", 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00050163599999999997 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568709+0000", 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.004126785 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568740+0000", 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0657999999999997e-05 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568762+0000", 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2898e-05 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:121 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.569311+0000", 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.76891998, 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0075409609999999997, 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 121 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.569311+0000", 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.569311+0000", 2024-09-21T22:00:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.569312+0000", 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8299999999999996e-07 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.569390+0000", 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8372000000000001e-05 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.569400+0000", 2024-09-21T22:00:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8230000000000006e-06 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.569407+0000", 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5579999999999997e-06 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.570658+0000", 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0012515359999999999 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.570727+0000", 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8460000000000005e-05 2024-09-21T22:00:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.570844+0000", 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000117346 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.572504+0000", 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001659918 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.576793+0000", 2024-09-21T22:00:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0042886310000000002 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.576827+0000", 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3929e-05 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.576852+0000", 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5605e-05 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.425615091000001, 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010152499000000001, 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 138 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912619+0000", 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9490000000000001e-06 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912628+0000", 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1699999999999997e-06 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912631+0000", 2024-09-21T22:00:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4939999999999999e-06 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.917688+0000", 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0050565999999999996 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.917751+0000", 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3359000000000001e-05 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.917835+0000", 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4027e-05 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922655+0000", 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0048200079999999998 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922709+0000", 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4320999999999997e-05 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922742+0000", 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2308999999999998e-05 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922769+0000", 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6911e-05 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:00:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.425595266999999, 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010189116999999999, 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 139 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912639+0000", 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.774e-06 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912643+0000", 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.687e-06 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912646+0000", 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1779999999999999e-06 2024-09-21T22:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.918591+0000", 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0059446209999999998 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.918641+0000", 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9985000000000003e-05 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.918724+0000", 2024-09-21T22:00:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3718e-05 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922698+0000", 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003973903 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922775+0000", 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7212000000000005e-05 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922805+0000", 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9955999999999999e-05 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922825+0000", 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9624999999999999e-05 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912656+0000", 2024-09-21T22:00:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.42557493, 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010746136, 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 140 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912656+0000", 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912656+0000", 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912657+0000", 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1e-07 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912696+0000", 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9632000000000003e-05 2024-09-21T22:00:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912703+0000", 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912708+0000", 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3440000000000003e-06 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.919071+0000", 2024-09-21T22:00:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0063632480000000002 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.919130+0000", 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8779000000000001e-05 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.919214+0000", 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4456999999999995e-05 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922886+0000", 2024-09-21T22:00:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003672228 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923339+0000", 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00045238100000000002 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923376+0000", 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7431999999999997e-05 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923402+0000", 2024-09-21T22:00:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.614e-05 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.425516097999999, 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011180765, 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.445 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 141 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.446 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912718+0000", 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7709999999999998e-06 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912722+0000", 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7629999999999998e-06 2024-09-21T22:00:55.447 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912725+0000", 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0699999999999998e-06 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922910+0000", 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010185318 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922974+0000", 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3836000000000003e-05 2024-09-21T22:00:55.448 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923060+0000", 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5714e-05 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923672+0000", 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000612467 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923838+0000", 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00016549499999999999 2024-09-21T22:00:55.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923873+0000", 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5055999999999998e-05 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923896+0000", 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2908000000000002e-05 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.450 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:39.366977+0000", 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 15.971253667999999, 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0073633420000000002, 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 158 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:00:55.451 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.366977+0000", 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.366977+0000", 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.366978+0000", 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.39e-07 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.367042+0000", 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3738999999999994e-05 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.367052+0000", 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.367058+0000", 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0469999999999999e-06 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.369433+0000", 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.002375182 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.369476+0000", 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2837000000000003e-05 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.369544+0000", 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8250999999999994e-05 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.370454+0000", 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00090963000000000003 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.374278+0000", 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0038246679999999998 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.374317+0000", 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8362000000000003e-05 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:00:55.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:00:55.456 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:00:55.456 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:39.374341+0000", 2024-09-21T22:00:55.456 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3989e-05 2024-09-21T22:00:55.456 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.456 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.456 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.456 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:00:55.456 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:00:55.456 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:00:55.457 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:55.455+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:55.458 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:00:55.558 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:55.556+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:00:55.560 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:55.560 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:55.560 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:00:55.560 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:55.568 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:00:55.659 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:55.657+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:00:55.712 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:55.712 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:55.712 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:00:55.712 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:00:55.713 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:55.721 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:00:55.759 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:55.758+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:00:55.861 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:55.859+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:00:55.865 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'15)", 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.362276+0000", 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.501248232000002, 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052927499999999997, 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362276+0000", 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362276+0000", 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362277+0000", 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.68e-07 2024-09-21T22:00:55.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362284+0000", 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5599999999999999e-06 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362294+0000", 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0947e-05 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362300+0000", 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:00:55.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362352+0000", 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2079000000000001e-05 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362373+0000", 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.067e-05 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.367537+0000", 2024-09-21T22:00:55.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051640130000000003 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.367569+0000", 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2551000000000001e-05 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'15)", 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.362757+0000", 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.500767981999999, 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048471349999999998, 2024-09-21T22:00:55.870 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362757+0000", 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362757+0000", 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362757+0000", 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.61e-07 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362763+0000", 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2800000000000003e-06 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362772+0000", 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4439999999999997e-06 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362777+0000", 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3669999999999996e-06 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362823+0000", 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5836e-05 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362841+0000", 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7906000000000001e-05 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.367572+0000", 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047307740000000001 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.367604+0000", 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1866999999999998e-05 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.402587+0000", 2024-09-21T22:00:55.874 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.460937362999999, 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046722439999999999, 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402587+0000", 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402587+0000", 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402588+0000", 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9999999999999998e-07 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402630+0000", 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2670000000000003e-05 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402642+0000", 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1561e-05 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402647+0000", 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402691+0000", 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.456e-05 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402710+0000", 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8695e-05 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.407215+0000", 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045050300000000001 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.407259+0000", 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4292000000000002e-05 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:73 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'47, mlcod=16'43)", 2024-09-21T22:00:55.878 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.403233+0000", 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.460291740999999, 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040598470000000001, 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403233+0000", 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403233+0000", 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403234+0000", 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9599999999999998e-07 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403284+0000", 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0337000000000003e-05 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403297+0000", 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3329999999999999e-05 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403303+0000", 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5849999999999999e-06 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403350+0000", 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6968999999999997e-05 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403368+0000", 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8436000000000001e-05 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.407263+0000", 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038949200000000001 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.407293+0000", 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9374e-05 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.882 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:74 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'48, mlcod=16'43)", 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.403783+0000", 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.459741513000001, 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062239929999999997, 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403783+0000", 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403783+0000", 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403784+0000", 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.47e-07 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403791+0000", 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4379999999999998e-06 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403804+0000", 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2883e-05 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403810+0000", 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403856+0000", 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5948999999999997e-05 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403875+0000", 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.906e-05 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.409947+0000", 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060721120000000002 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.410007+0000", 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0062000000000002e-05 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:87 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'57, mlcod=16'51)", 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.422922+0000", 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.440602388999999, 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047278959999999997, 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.887 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.422922+0000", 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.422922+0000", 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.422923+0000", 2024-09-21T22:00:55.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.422987+0000", 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3930999999999995e-05 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.422996+0000", 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9930000000000001e-06 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.423001+0000", 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7949999999999998e-06 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.423042+0000", 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1523999999999997e-05 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.423056+0000", 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3927999999999999e-05 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.427610+0000", 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045538360000000003 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.427650+0000", 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0321999999999998e-05 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:110 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'72, mlcod=16'65)", 2024-09-21T22:00:55.891 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.559628+0000", 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.303896483999999, 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059335489999999998, 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559628+0000", 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559628+0000", 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559629+0000", 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559634+0000", 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6389999999999997e-06 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559642+0000", 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5179999999999998e-06 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559647+0000", 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1930000000000001e-06 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559679+0000", 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2085999999999997e-05 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559690+0000", 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0849000000000001e-05 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565523+0000", 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058330980000000001 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565562+0000", 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8782999999999998e-05 2024-09-21T22:00:55.895 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:111 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'73, mlcod=16'65)", 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.560244+0000", 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.303280813000001, 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053515799999999999, 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560244+0000", 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560244+0000", 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560244+0000", 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5600000000000001e-07 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560248+0000", 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6219999999999998e-06 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560255+0000", 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3080000000000002e-06 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560266+0000", 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0764999999999999e-05 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560295+0000", 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9135000000000001e-05 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560305+0000", 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0389e-05 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565564+0000", 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052588549999999998 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565595+0000", 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1050000000000003e-05 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:112 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'74, mlcod=16'69)", 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.561376+0000", 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.302148848000002, 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004249063, 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.900 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561376+0000", 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561376+0000", 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561376+0000", 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561439+0000", 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3238999999999995e-05 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561447+0000", 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3499999999999999e-06 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561452+0000", 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1479999999999997e-06 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561487+0000", 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4561999999999999e-05 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561497+0000", 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0193e-05 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565597+0000", 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004099882 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565625+0000", 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8249e-05 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:113 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'75, mlcod=16'69)", 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.562019+0000", 2024-09-21T22:00:55.904 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.301505599999999, 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003636172, 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562019+0000", 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562019+0000", 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562019+0000", 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7999999999999996e-07 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562024+0000", 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1420000000000003e-06 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562030+0000", 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.64e-06 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562035+0000", 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8760000000000004e-06 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562074+0000", 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8931999999999999e-05 2024-09-21T22:00:55.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562088+0000", 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3553000000000001e-05 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565626+0000", 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035384499999999998 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565655+0000", 2024-09-21T22:00:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9099e-05 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:114 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'76, mlcod=16'69)", 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.562517+0000", 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.301007216999999, 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005615063, 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562517+0000", 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562517+0000", 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562518+0000", 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:00:55.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562526+0000", 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5029999999999997e-06 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562535+0000", 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3620000000000006e-06 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562539+0000", 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5900000000000001e-06 2024-09-21T22:00:55.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562578+0000", 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8627999999999997e-05 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562596+0000", 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7958e-05 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568103+0000", 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055073800000000001 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568132+0000", 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9127000000000001e-05 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:115 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'77, mlcod=16'69)", 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.563039+0000", 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.300485156000001, 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051092830000000001, 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563039+0000", 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563039+0000", 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563040+0000", 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563088+0000", 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.791e-05 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563094+0000", 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5239999999999997e-06 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563101+0000", 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9959999999999996e-06 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563138+0000", 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7230000000000001e-05 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563156+0000", 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7093000000000001e-05 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568135+0000", 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049789140000000001 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568149+0000", 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4232e-05 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:116 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'78, mlcod=16'70)", 2024-09-21T22:00:55.917 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.563717+0000", 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.299807181999999, 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044438400000000001, 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563717+0000", 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563717+0000", 2024-09-21T22:00:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563718+0000", 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563721+0000", 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6710000000000001e-06 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563728+0000", 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1519999999999997e-06 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563733+0000", 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563764+0000", 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1814999999999999e-05 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563778+0000", 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3879999999999999e-05 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568149+0000", 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043712220000000001 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568161+0000", 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1790000000000001e-05 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.921 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:117 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'79, mlcod=16'70)", 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.564170+0000", 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.299354730000001, 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040067870000000004, 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564170+0000", 2024-09-21T22:00:55.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564170+0000", 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564170+0000", 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.53e-07 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564175+0000", 2024-09-21T22:00:55.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4950000000000002e-06 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564180+0000", 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6520000000000003e-06 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564183+0000", 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9529999999999999e-06 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564218+0000", 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4779e-05 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564237+0000", 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.916e-05 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568163+0000", 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039259129999999996 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568177+0000", 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3582e-05 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:119 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'81, mlcod=16'78)", 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.569879+0000", 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.293645957999999, 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039636979999999999, 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.926 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569879+0000", 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569879+0000", 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569879+0000", 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8100000000000002e-07 2024-09-21T22:00:55.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569953+0000", 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4086999999999997e-05 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569964+0000", 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0703000000000001e-05 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569969+0000", 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7369999999999997e-06 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570000+0000", 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1340000000000001e-05 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570012+0000", 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1950000000000001e-05 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.573797+0000", 2024-09-21T22:00:55.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003785166 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.573842+0000", 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5034000000000003e-05 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:120 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'82, mlcod=16'78)", 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.570354+0000", 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.293170326999999, 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003504886, 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.930 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570354+0000", 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570354+0000", 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570355+0000", 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570497+0000", 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141953 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570503+0000", 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5239999999999997e-06 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570507+0000", 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4750000000000002e-06 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570535+0000", 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8677999999999999e-05 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570546+0000", 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1100999999999999e-05 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.573844+0000", 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032979490000000001 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.573859+0000", 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4833e-05 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:121 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'83, mlcod=16'78)", 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.570945+0000", 2024-09-21T22:00:55.934 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.292579792000002, 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056196579999999996, 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570945+0000", 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570945+0000", 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570945+0000", 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.96e-07 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.571058+0000", 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113304 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.571065+0000", 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5740000000000001e-06 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.571068+0000", 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3529999999999999e-06 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.571096+0000", 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7450999999999999e-05 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.571106+0000", 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8640000000000008e-06 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.576532+0000", 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0054258960000000004 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.576564+0000", 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2920000000000003e-05 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.938 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:122 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'84, mlcod=16'82)", 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.577389+0000", 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.286135434999998, 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003600032, 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577389+0000", 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577389+0000", 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577390+0000", 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2699999999999999e-07 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577402+0000", 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2466000000000001e-05 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577412+0000", 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0222e-05 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577417+0000", 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.758e-06 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577450+0000", 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3201999999999998e-05 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577463+0000", 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2126e-05 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.580959+0000", 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003496304 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.580989+0000", 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0326999999999999e-05 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:143 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'101, mlcod=16'98)", 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.924975+0000", 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.938549567999999, 2024-09-21T22:00:55.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040259099999999997, 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.924975+0000", 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.924975+0000", 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.924975+0000", 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925027+0000", 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1165000000000002e-05 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925034+0000", 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0280000000000003e-06 2024-09-21T22:00:55.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925038+0000", 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0239999999999999e-06 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925067+0000", 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9635999999999999e-05 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925079+0000", 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2021999999999999e-05 2024-09-21T22:00:55.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.928965+0000", 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038860259999999999 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.929001+0000", 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5592000000000001e-05 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:144 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'102, mlcod=16'98)", 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.925506+0000", 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.938018567, 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035240219999999999, 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925506+0000", 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925506+0000", 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925506+0000", 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925594+0000", 2024-09-21T22:00:55.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7701999999999995e-05 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925600+0000", 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0920000000000003e-06 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925607+0000", 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6279999999999999e-06 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:55.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925642+0000", 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5250000000000003e-05 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925659+0000", 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6614000000000001e-05 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.929003+0000", 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033445020000000001 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:55.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.929030+0000", 2024-09-21T22:00:55.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6834000000000001e-05 2024-09-21T22:00:55.952 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.952 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.952 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.952 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:55.952 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:55.952 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:55.953 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:00:55.961 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:55.959+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:56.057 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:56.057 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:56.057 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:00:56.057 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:56.062 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:56.060+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:00:56.066 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:00:56.159 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:00:56.163 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:56.161+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:56.215 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:56.215 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:56.215 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:00:56.215 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:00:56.215 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:56.224 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:00:56.264 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:56.263+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4223.0:5 2.2 e20/18 2:5cea7035:::rbd_info:head v 20'1, mlcod=0'0)", 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:45.117556+0000", 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.210528994000001, 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088378000000000003, 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:56.329 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117556+0000", 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117556+0000", 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117556+0000", 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9399999999999999e-07 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117561+0000", 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.254e-06 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117575+0000", 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3464e-05 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117585+0000", 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9210000000000004e-06 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117632+0000", 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6692e-05 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:56.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117661+0000", 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9481000000000001e-05 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.118396+0000", 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073515799999999997 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.118440+0000", 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3615999999999997e-05 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4223.0:7 2.2 e21/18 2:5cea7035:::rbd_info:head v 21'2, mlcod=0'0)", 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:46.122478+0000", 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.205606718, 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0012318959999999999, 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122478+0000", 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122478+0000", 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122479+0000", 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.35e-07 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:56.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122484+0000", 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6840000000000001e-06 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122498+0000", 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3643e-05 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122507+0000", 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2329999999999995e-06 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122560+0000", 2024-09-21T22:00:56.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2543999999999997e-05 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122575+0000", 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4972e-05 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.123669+0000", 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0010940380000000001 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.123710+0000", 2024-09-21T22:00:56.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1547e-05 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7 3.1a e25/23 3:5cea7035:::rbd_info:head v 25'1, mlcod=0'0)", 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:55.163598+0000", 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.164486559, 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000697432, 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:56.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163598+0000", 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163598+0000", 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163599+0000", 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6299999999999999e-07 2024-09-21T22:00:56.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163603+0000", 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6890000000000003e-06 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163616+0000", 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2631e-05 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163625+0000", 2024-09-21T22:00:56.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8799999999999997e-06 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163676+0000", 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1221000000000003e-05 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163692+0000", 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5815999999999999e-05 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.164255+0000", 2024-09-21T22:00:56.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056331999999999997 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.164296+0000", 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0711999999999999e-05 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:56.165881+0000", 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.16220380600000001, 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0011992890000000001, 2024-09-21T22:00:56.342 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165881+0000", 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165881+0000", 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165882+0000", 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165903+0000", 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1100000000000001e-05 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165916+0000", 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3594999999999999e-05 2024-09-21T22:00:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165928+0000", 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1554e-05 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.166011+0000", 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3337999999999994e-05 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.166034+0000", 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3078000000000002e-05 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.167038+0000", 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001003561 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.167081+0000", 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2679999999999998e-05 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:56.346 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:56.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:00:56.365 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:56.363+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:56.452 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:56.452 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:56.452 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:00:56.452 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:56.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:00:56.505 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:56.503+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:00:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:56.566 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:56.566 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:00:56.566 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:00:56.566 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:56.567 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:00:56.564+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:00:56.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:00:56.667 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:56.666+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:00:56.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:00:56.719 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:00:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:00:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:00:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4223.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-21T22:00:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:44.111294+0000", 2024-09-21T22:00:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.607036820999999, 2024-09-21T22:00:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043357339999999999, 2024-09-21T22:00:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111294+0000", 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111294+0000", 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111295+0000", 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111305+0000", 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8859999999999999e-06 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111319+0000", 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4168000000000001e-05 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111330+0000", 2024-09-21T22:00:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1615e-05 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111388+0000", 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7336999999999997e-05 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111422+0000", 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4663000000000003e-05 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.115586+0000", 2024-09-21T22:00:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004163529 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.115630+0000", 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4135999999999999e-05 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:56.723 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:56.728 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:00:56.769 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:00:56.767+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:00:56.839 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:00:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:00:56.856 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:00:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:00:56.870 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:56.869+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:56.873 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:00:56.873 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:00:56.876 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:56.876 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:56.876 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:00:56.876 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:56.885 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:00:56.890 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:00:56.890 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:00:56.920 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:00:56.920 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:00:56.947 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:00:56.947 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:00:56.964 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:00:56.964 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:00:56.971 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:56.969+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:56.981 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:00:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:00:56.989 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:56.990 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:56.999 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:00:57.071 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:57.070+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:00:57.143 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:57.144 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:57.153 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:00:57.197 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:57.195+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:57.269 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:57.269 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:57.272 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:57.270+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:00:57.278 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:00:57.373 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:57.371+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:00:57.422 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:57.422 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:57.431 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:00:57.515 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:57.513+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:57.574 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:57.574 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:57.575 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:57.573+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:57.582 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:00:57.675 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:57.673+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:00:57.725 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:57.725 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:57.734 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:00:57.778 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:57.776+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:57.837 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:57.837 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:57.846 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:00:57.885 INFO:teuthology.orchestra.run.smithi102.stdout:truncating to largest ever: 0xa8216f2 2024-09-21T22:00:57.887 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:57.885+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:00:57.897 INFO:teuthology.orchestra.run.smithi102.stdout:2 trunc from 0x0 to 0xa8216f2 2024-09-21T22:00:57.903 INFO:teuthology.orchestra.run.smithi102.stdout:4 write 0x80e5f6e thru 0x80e5fd0 (0x63 bytes) 2024-09-21T22:00:57.907 INFO:teuthology.orchestra.run.smithi102.stdout:7 punch from 0x3dfc497 to 0x3e031dd, (0x6d46 bytes) 2024-09-21T22:00:57.907 INFO:teuthology.orchestra.run.smithi102.stdout:10 read 0xfb83b9 thru 0xfc2e8a (0xaad2 bytes) 2024-09-21T22:00:57.907 INFO:teuthology.orchestra.run.smithi102.stdout:11 read 0x1872a33 thru 0x187ed8d (0xc35b bytes) 2024-09-21T22:00:57.907 INFO:teuthology.orchestra.run.smithi102.stdout:12 writesame 0x3005893 thru 0x300e0f3 data_size 0x1(0x8861 bytes) 2024-09-21T22:00:57.924 INFO:teuthology.orchestra.run.smithi102.stdout:13 read 0x93d808e thru 0x93e31b8 (0xb12b bytes) 2024-09-21T22:00:57.924 INFO:teuthology.orchestra.run.smithi102.stdout:15 clone 1 order 21 su 16384 sc 14 2024-09-21T22:00:57.979 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:57.977+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:00:57.990 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:57.990 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:57.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:00:58.079 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:00:58.077+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:00:58.101 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:58.101 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:58.110 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:00:58.171 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:00:58.172 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:00:58.172 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:00:58.172 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 6 2024-09-21T22:00:58.176 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:00:58.216 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:00:58.214+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:00:58.220 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:58.220 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:58.230 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:00:58.281 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:58.279+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:58.335 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:58.335 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:58.341 INFO:teuthology.orchestra.run.smithi102.stdout:truncating to largest ever: 0xead7d93 2024-09-21T22:00:58.344 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:00:58.346 INFO:teuthology.orchestra.run.smithi102.stdout:16 trunc from 0xa8216f2 to 0xead7d93 2024-09-21T22:00:58.369 INFO:teuthology.orchestra.run.smithi102.stdout:18 trunc from 0xead7d93 to 0x2a5337c 2024-09-21T22:00:58.386 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:58.383+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:00:58.414 INFO:teuthology.orchestra.run.smithi102.stdout:19 read 0x52b099 thru 0x52eb14 (0x3a7c bytes) 2024-09-21T22:00:58.414 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:00:58.414 INFO:teuthology.orchestra.run.smithi102.stdout:21 clone 2 order 25 su 262144 sc 14 2024-09-21T22:00:58.483 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:58.481+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:58.484 INFO:tasks.ceph.mon.a.smithi102.stderr:2024-09-21T22:00:58.482+0000 7f46e9689640 -1 mon.a@0(leader).osd e27 definitely_dead 0 2024-09-21T22:00:58.494 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:58.494 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:58.502 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:00:58.589 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:58.585+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:00:58.646 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:58.646 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:58.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:00:58.696 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:00:58.694+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:00:58.785 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:58.783+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:00:58.797 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:58.798 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:58.806 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:00:58.886 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:58.884+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:58.910 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:58.911 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:58.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:00:58.986 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:00:58.984+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:00:58.992 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:00:59.024 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:00:59.024 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:00:59.033 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:00:59.087 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:59.086+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:59.114 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:00:59.114 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:00:59.133 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:00:59.133 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:00:59.150 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:00:59.150 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:00:59.180 INFO:teuthology.orchestra.run.smithi102.stderr:marked out osd.6. 2024-09-21T22:00:59.181 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:00:59.181 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:00:59.184 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:00:59.187 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:59.185+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:36 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'22, mlcod=16'15)", 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.362276+0000", 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.834123137999999, 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052927499999999997, 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362276+0000", 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362276+0000", 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362277+0000", 2024-09-21T22:00:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.68e-07 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362284+0000", 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5599999999999999e-06 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362294+0000", 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0947e-05 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362300+0000", 2024-09-21T22:00:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362352+0000", 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2079000000000001e-05 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362373+0000", 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.067e-05 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.367537+0000", 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051640130000000003 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.367569+0000", 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2551000000000001e-05 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'15)", 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.362757+0000", 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.833642888, 2024-09-21T22:00:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048471349999999998, 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362757+0000", 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362757+0000", 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362757+0000", 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.61e-07 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362763+0000", 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2800000000000003e-06 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362772+0000", 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4439999999999997e-06 2024-09-21T22:00:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362777+0000", 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3669999999999996e-06 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362823+0000", 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5836e-05 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.362841+0000", 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7906000000000001e-05 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.367572+0000", 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047307740000000001 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.367604+0000", 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1866999999999998e-05 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.402587+0000", 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.793812269, 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046722439999999999, 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402587+0000", 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402587+0000", 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402588+0000", 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9999999999999998e-07 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402630+0000", 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2670000000000003e-05 2024-09-21T22:00:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402642+0000", 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1561e-05 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402647+0000", 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402691+0000", 2024-09-21T22:00:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.456e-05 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.402710+0000", 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8695e-05 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.407215+0000", 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045050300000000001 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.407259+0000", 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4292000000000002e-05 2024-09-21T22:00:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:73 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'47, mlcod=16'43)", 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.403233+0000", 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.793166647, 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040598470000000001, 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403233+0000", 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403233+0000", 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403234+0000", 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9599999999999998e-07 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403284+0000", 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0337000000000003e-05 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403297+0000", 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3329999999999999e-05 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403303+0000", 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5849999999999999e-06 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403350+0000", 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6968999999999997e-05 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403368+0000", 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8436000000000001e-05 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.407263+0000", 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038949200000000001 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.407293+0000", 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9374e-05 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:74 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'48, mlcod=16'43)", 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.403783+0000", 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.792616419000002, 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062239929999999997, 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.216 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403783+0000", 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403783+0000", 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403784+0000", 2024-09-21T22:00:59.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.47e-07 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403791+0000", 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4379999999999998e-06 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403804+0000", 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2883e-05 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403810+0000", 2024-09-21T22:00:59.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403856+0000", 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5948999999999997e-05 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.403875+0000", 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.906e-05 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.409947+0000", 2024-09-21T22:00:59.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060721120000000002 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.410007+0000", 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0062000000000002e-05 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:87 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'57, mlcod=16'51)", 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.422922+0000", 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.773477294999999, 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047278959999999997, 2024-09-21T22:00:59.220 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.422922+0000", 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.422922+0000", 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.422923+0000", 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.422987+0000", 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3930999999999995e-05 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.422996+0000", 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9930000000000001e-06 2024-09-21T22:00:59.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.423001+0000", 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7949999999999998e-06 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.423042+0000", 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1523999999999997e-05 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.423056+0000", 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3927999999999999e-05 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.427610+0000", 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045538360000000003 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.427650+0000", 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0321999999999998e-05 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:110 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'72, mlcod=16'65)", 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.559628+0000", 2024-09-21T22:00:59.224 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.63677139, 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059335489999999998, 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559628+0000", 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559628+0000", 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559629+0000", 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559634+0000", 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6389999999999997e-06 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559642+0000", 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5179999999999998e-06 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559647+0000", 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1930000000000001e-06 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559679+0000", 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2085999999999997e-05 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.559690+0000", 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0849000000000001e-05 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565523+0000", 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058330980000000001 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565562+0000", 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8782999999999998e-05 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:111 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'73, mlcod=16'65)", 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.560244+0000", 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.636155719000001, 2024-09-21T22:00:59.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053515799999999999, 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560244+0000", 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560244+0000", 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560244+0000", 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5600000000000001e-07 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560248+0000", 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6219999999999998e-06 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560255+0000", 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3080000000000002e-06 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560266+0000", 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0764999999999999e-05 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560295+0000", 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9135000000000001e-05 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.560305+0000", 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0389e-05 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565564+0000", 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052588549999999998 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565595+0000", 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1050000000000003e-05 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:112 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'74, mlcod=16'69)", 2024-09-21T22:00:59.232 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.561376+0000", 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.635023753999999, 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004249063, 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561376+0000", 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561376+0000", 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561376+0000", 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561439+0000", 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3238999999999995e-05 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561447+0000", 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3499999999999999e-06 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561452+0000", 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1479999999999997e-06 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561487+0000", 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4561999999999999e-05 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.561497+0000", 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0193e-05 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565597+0000", 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004099882 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565625+0000", 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8249e-05 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.236 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:113 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'75, mlcod=16'69)", 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.562019+0000", 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.634380505999999, 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003636172, 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562019+0000", 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562019+0000", 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562019+0000", 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7999999999999996e-07 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562024+0000", 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1420000000000003e-06 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562030+0000", 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.64e-06 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562035+0000", 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8760000000000004e-06 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562074+0000", 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8931999999999999e-05 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562088+0000", 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3553000000000001e-05 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565626+0000", 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035384499999999998 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.565655+0000", 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9099e-05 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.240 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:114 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'76, mlcod=16'69)", 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.562517+0000", 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.633882122999999, 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005615063, 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562517+0000", 2024-09-21T22:00:59.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562517+0000", 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562518+0000", 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562526+0000", 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5029999999999997e-06 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562535+0000", 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3620000000000006e-06 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562539+0000", 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5900000000000001e-06 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562578+0000", 2024-09-21T22:00:59.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8627999999999997e-05 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.562596+0000", 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7958e-05 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568103+0000", 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055073800000000001 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568132+0000", 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9127000000000001e-05 2024-09-21T22:00:59.244 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:115 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'77, mlcod=16'69)", 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.563039+0000", 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.633360062000001, 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051092830000000001, 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563039+0000", 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563039+0000", 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563040+0000", 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563088+0000", 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.791e-05 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563094+0000", 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5239999999999997e-06 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563101+0000", 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9959999999999996e-06 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563138+0000", 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7230000000000001e-05 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563156+0000", 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7093000000000001e-05 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568135+0000", 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049789140000000001 2024-09-21T22:00:59.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568149+0000", 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4232e-05 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:116 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'78, mlcod=16'70)", 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.563717+0000", 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.632682087999999, 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044438400000000001, 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.249 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563717+0000", 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563717+0000", 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563718+0000", 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563721+0000", 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6710000000000001e-06 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563728+0000", 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1519999999999997e-06 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563733+0000", 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563764+0000", 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1814999999999999e-05 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.563778+0000", 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3879999999999999e-05 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568149+0000", 2024-09-21T22:00:59.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043712220000000001 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568161+0000", 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1790000000000001e-05 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:117 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'79, mlcod=16'70)", 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.564170+0000", 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.632229636000002, 2024-09-21T22:00:59.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040067870000000004, 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564170+0000", 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564170+0000", 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564170+0000", 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.53e-07 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564175+0000", 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4950000000000002e-06 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564180+0000", 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6520000000000003e-06 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564183+0000", 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9529999999999999e-06 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564218+0000", 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4779e-05 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.564237+0000", 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.916e-05 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568163+0000", 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039259129999999996 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.568177+0000", 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3582e-05 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:119 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'81, mlcod=16'78)", 2024-09-21T22:00:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.569879+0000", 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.626520864, 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039636979999999999, 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569879+0000", 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569879+0000", 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569879+0000", 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8100000000000002e-07 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569953+0000", 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4086999999999997e-05 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569964+0000", 2024-09-21T22:00:59.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0703000000000001e-05 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.569969+0000", 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7369999999999997e-06 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570000+0000", 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1340000000000001e-05 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570012+0000", 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1950000000000001e-05 2024-09-21T22:00:59.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.573797+0000", 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003785166 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.573842+0000", 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5034000000000003e-05 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.261 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:121 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'83, mlcod=16'78)", 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.570945+0000", 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.625454697999999, 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056196579999999996, 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570945+0000", 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570945+0000", 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.570945+0000", 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.96e-07 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.571058+0000", 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113304 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.571065+0000", 2024-09-21T22:00:59.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5740000000000001e-06 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.571068+0000", 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3529999999999999e-06 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.571096+0000", 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7450999999999999e-05 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.571106+0000", 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8640000000000008e-06 2024-09-21T22:00:59.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.576532+0000", 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0054258960000000004 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.576564+0000", 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2920000000000003e-05 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:122 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'84, mlcod=16'82)", 2024-09-21T22:00:59.265 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.577389+0000", 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.619010340999999, 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003600032, 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577389+0000", 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577389+0000", 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577390+0000", 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2699999999999999e-07 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577402+0000", 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2466000000000001e-05 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577412+0000", 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0222e-05 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577417+0000", 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.758e-06 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577450+0000", 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3201999999999998e-05 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.577463+0000", 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2126e-05 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.580959+0000", 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003496304 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.580989+0000", 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0326999999999999e-05 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:143 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'101, mlcod=16'98)", 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.924975+0000", 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.271424474, 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040259099999999997, 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.924975+0000", 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.924975+0000", 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.924975+0000", 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925027+0000", 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1165000000000002e-05 2024-09-21T22:00:59.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925034+0000", 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0280000000000003e-06 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925038+0000", 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0239999999999999e-06 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925067+0000", 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9635999999999999e-05 2024-09-21T22:00:59.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925079+0000", 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2021999999999999e-05 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.928965+0000", 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038860259999999999 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.929001+0000", 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5592000000000001e-05 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.273 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4212.0:144 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'102, mlcod=16'98)", 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:38.925506+0000", 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 20.270893473000001, 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035240219999999999, 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925506+0000", 2024-09-21T22:00:59.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925506+0000", 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925506+0000", 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925594+0000", 2024-09-21T22:00:59.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7701999999999995e-05 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925600+0000", 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0920000000000003e-06 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925607+0000", 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6279999999999999e-06 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925642+0000", 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5250000000000003e-05 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.925659+0000", 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6614000000000001e-05 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.929003+0000", 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033445020000000001 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:38.929030+0000", 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6834000000000001e-05 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:56.178604+0000", 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.0177953049999999, 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099090770000000005, 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.278 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 11 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.178604+0000", 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.178604+0000", 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.178606+0000", 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.148e-06 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.178619+0000", 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2301e-05 2024-09-21T22:00:59.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.178641+0000", 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2212e-05 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.178652+0000", 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1297e-05 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.178713+0000", 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1199999999999997e-05 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.178718+0000", 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3819999999999997e-06 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.180436+0000", 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001718638 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.180565+0000", 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012855899999999999 2024-09-21T22:00:59.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 5", 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.180751+0000", 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00018651299999999999 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.181651+0000", 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00089926700000000004 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.188422+0000", 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067714769999999997 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.188459+0000", 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6563999999999998e-05 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.188513+0000", 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4518999999999998e-05 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.284 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:59.286 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:00:59.286 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:00:59.287 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:00:59.287 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:00:59.287 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:00:59.288 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:00:59.288 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:00:59.288 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:00:59.289 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:00:59.327 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:00:59.325+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:00:59.391 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:00:59.390+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:00:59.429 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:59.429 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:59.429 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:00:59.429 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:59.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:00:59.492 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:59.491+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:59.540 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:59.540 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:59.540 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:00:59.540 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:00:59.541 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:59.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:00:59.593 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:59.592+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:59.652 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4223.0:5 2.2 e20/18 2:5cea7035:::rbd_info:head v 20'1, mlcod=0'0)", 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:45.117556+0000", 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.534363432999999, 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088378000000000003, 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117556+0000", 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117556+0000", 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117556+0000", 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9399999999999999e-07 2024-09-21T22:00:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117561+0000", 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.254e-06 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117575+0000", 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3464e-05 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117585+0000", 2024-09-21T22:00:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9210000000000004e-06 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117632+0000", 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6692e-05 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.117661+0000", 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9481000000000001e-05 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.118396+0000", 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073515799999999997 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:45.118440+0000", 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3615999999999997e-05 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4223.0:7 2.2 e21/18 2:5cea7035:::rbd_info:head v 21'2, mlcod=0'0)", 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:46.122478+0000", 2024-09-21T22:00:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.529441157000001, 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0012318959999999999, 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122478+0000", 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122478+0000", 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122479+0000", 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.35e-07 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122484+0000", 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6840000000000001e-06 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122498+0000", 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3643e-05 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122507+0000", 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2329999999999995e-06 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122560+0000", 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2543999999999997e-05 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.122575+0000", 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4972e-05 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.123669+0000", 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0010940380000000001 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:46.123710+0000", 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1547e-05 2024-09-21T22:00:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7 3.1a e25/23 3:5cea7035:::rbd_info:head v 25'1, mlcod=0'0)", 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:55.163598+0000", 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.4883209979999998, 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000697432, 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163598+0000", 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163598+0000", 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163599+0000", 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6299999999999999e-07 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163603+0000", 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6890000000000003e-06 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163616+0000", 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2631e-05 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163625+0000", 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8799999999999997e-06 2024-09-21T22:00:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163676+0000", 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1221000000000003e-05 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.163692+0000", 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5815999999999999e-05 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.164255+0000", 2024-09-21T22:00:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056331999999999997 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:55.164296+0000", 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0711999999999999e-05 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:56.165881+0000", 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.486038245, 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0011992890000000001, 2024-09-21T22:00:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165881+0000", 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165881+0000", 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165882+0000", 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165903+0000", 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1100000000000001e-05 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165916+0000", 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3594999999999999e-05 2024-09-21T22:00:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.165928+0000", 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1554e-05 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.166011+0000", 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3337999999999994e-05 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.166034+0000", 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3078000000000002e-05 2024-09-21T22:00:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.167038+0000", 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001003561 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:56.167081+0000", 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2679999999999998e-05 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:00:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:00:59.671 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:59.671 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:00:59.693 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:00:59.691+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:00:59.775 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:59.775 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:59.776 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:00:59.776 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:59.784 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:00:59.828 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:59.826+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:00:59.888 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:00:59.888 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:00:59.888 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:00:59.888 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:00:59.888 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:00:59.896 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:00:59.893+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:00:59.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:00:59.996 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:00:59.994+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4223.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:44.111294+0000", 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.928887921999999, 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043357339999999999, 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:00.041 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111294+0000", 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111294+0000", 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111295+0000", 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111305+0000", 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8859999999999999e-06 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111319+0000", 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4168000000000001e-05 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111330+0000", 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1615e-05 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111388+0000", 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7336999999999997e-05 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111422+0000", 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4663000000000003e-05 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.115586+0000", 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004163529 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.115630+0000", 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4135999999999999e-05 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:491 3.9 e28/23 3:907d2e6d:::rbd_object_map.1124354cd08a:head v 28'21, mlcod=27'19)", 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:59.190766+0000", 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.84941635500000001, 2024-09-21T22:01:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088341299999999999, 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.190766+0000", 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.190766+0000", 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.190766+0000", 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9399999999999999e-07 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.190780+0000", 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3557000000000001e-05 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.190799+0000", 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9851999999999999e-05 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.190809+0000", 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5119999999999997e-06 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.190870+0000", 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1434999999999997e-05 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.190896+0000", 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5612000000000001e-05 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.191593+0000", 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069721699999999998 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.191649+0000", 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6033999999999999e-05 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:00.049 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:00.050 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:00.098 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:00.096+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:00.198 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:00.198 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:00.198 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:00.198 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:00.198 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:00.196+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:00.207 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:00.299 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:00.298+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:00.308 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:00.308 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:00.309 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:00.309 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:00.309 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:00.317 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:00.400 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:00.398+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:00.419 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:00.419 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:00.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:00.419 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:00.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.419 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:488 3.15 e28/23 3:aaaf9251:::rbd_header.1124354cd08a:head v 28'11, mlcod=27'9)", 2024-09-21T22:01:00.419 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:59.184353+0000", 2024-09-21T22:01:00.419 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.2341552330000001, 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027861520000000001, 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.184353+0000", 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:00.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.184353+0000", 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.184353+0000", 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.184358+0000", 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2320000000000001e-06 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.184388+0000", 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0012e-05 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.184399+0000", 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0708e-05 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.184448+0000", 2024-09-21T22:01:00.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9548000000000001e-05 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.184483+0000", 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4122999999999998e-05 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.187086+0000", 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026036950000000001 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.187139+0000", 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2500999999999998e-05 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:502 3.15 e28/23 3:aaaf9251:::rbd_header.1124354cd08a:head v 28'12, mlcod=27'10)", 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:59.196452+0000", 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.2220559280000001, 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00067121100000000001, 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:00.424 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.196452+0000", 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.196452+0000", 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.196454+0000", 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.764e-06 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.196478+0000", 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3889000000000001e-05 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.196500+0000", 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2388999999999999e-05 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.196512+0000", 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2041e-05 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.196583+0000", 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0703000000000004e-05 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.196602+0000", 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9392e-05 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.197089+0000", 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048740900000000001 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:59.197123+0000", 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "MOSDPGPushReply(3.1e 29/28 [PushReplyOp(3:7ab5c62c:::rbd_data.1124354cd08a.000000000000001a:head)])", 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:00.190598+0000", 2024-09-21T22:01:00.428 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.227909893, 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00028639300000000002, 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:00.190598+0000", 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:00.190598+0000", 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:00.190598+0000", 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.23e-07 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:00.190602+0000", 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3869999999999999e-06 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:00.190607+0000", 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5110000000000003e-06 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:00.190625+0000", 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7824000000000001e-05 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:00.190672+0000", 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7286000000000001e-05 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:00.190884+0000", 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00021216200000000001 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:00.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.432 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:00.432 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:00.432 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:00.432 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:00.501 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:00.499+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3.ff1962ca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.3382977089999999, 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3383224920000001, 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "waiting for peered", 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.552 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:01:00.553 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:01:00.554 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.555 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.555 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.555 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.555 INFO:teuthology.orchestra.run.smithi184.stdout: ], 2024-09-21T22:01:00.555 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 1 2024-09-21T22:01:00.555 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:00.560 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:00.603 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:00.601+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:00.657 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone1 from 0x2a5337c (overlap 0x2a5337c) to 0x43b859 2024-09-21T22:01:00.702 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:00.701+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:00.716 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:00.716 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:00.716 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:00.716 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:00.716 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:00.726 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:00.736 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-21T22:01:00.804 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:00.802+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:00.831 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:55.158298+0000", 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6721736929999995, 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.006175392, 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:00.832 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158298+0000", 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158298+0000", 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158300+0000", 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3829999999999999e-06 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158312+0000", 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1457999999999999e-05 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158331+0000", 2024-09-21T22:01:00.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9312000000000001e-05 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158341+0000", 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4259999999999992e-06 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158402+0000", 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1525000000000005e-05 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:00.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158406+0000", 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2660000000000003e-06 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.163120+0000", 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047132149999999998 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.163238+0000", 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000118718 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.163393+0000", 2024-09-21T22:01:00.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015510099999999999 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164050+0000", 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00065685899999999998 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164415+0000", 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000364939 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:00.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164448+0000", 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2580000000000003e-05 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164473+0000", 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.561e-05 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop_reply(client.4388.0:7 3.1a e24/23 ondisk, result = 0)", 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:55.164335+0000", 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6661367619999998, 2024-09-21T22:01:00.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00014374099999999999, 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164335+0000", 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164335+0000", 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164336+0000", 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4100000000000001e-06 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164345+0000", 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6559999999999998e-06 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164358+0000", 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3278000000000001e-05 2024-09-21T22:01:00.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164369+0000", 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0988999999999999e-05 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164406+0000", 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6560000000000002e-05 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164412+0000", 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2450000000000003e-06 2024-09-21T22:01:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164479+0000", 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6602999999999999e-05 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.159333+0000", 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.6711391369999999, 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010895462, 2024-09-21T22:01:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 9 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159333+0000", 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159333+0000", 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159335+0000", 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159346+0000", 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1182999999999999e-05 2024-09-21T22:01:00.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159364+0000", 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8357000000000001e-05 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159375+0000", 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0815999999999999e-05 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159436+0000", 2024-09-21T22:01:00.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1508999999999997e-05 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159441+0000", 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.335e-06 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.165543+0000", 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0061017689999999999 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:00.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.165605+0000", 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2496999999999995e-05 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.165712+0000", 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010731899999999999 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167182+0000", 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0014701250000000001 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:00.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170163+0000", 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0029803249999999998 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170200+0000", 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6900000000000002e-05 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170228+0000", 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8334999999999999e-05 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop_reply(client.4388.0:9 3.1a e25/23 ondisk, result = 0)", 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.167112+0000", 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.6633598559999996, 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6249999999999997e-05, 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167112+0000", 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167112+0000", 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167113+0000", 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7800000000000001e-07 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167118+0000", 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0050000000000004e-06 2024-09-21T22:01:00.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167128+0000", 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0428000000000001e-05 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167135+0000", 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7100000000000001e-06 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167173+0000", 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8587999999999997e-05 2024-09-21T22:01:00.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167179+0000", 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7579999999999998e-06 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167188+0000", 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9830000000000002e-06 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:10 3.1c e26/23 3:3831950c:::rbd_directory:head v 26'1, mlcod=0'0)", 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.174974+0000", 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.6554981849999999, 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031760120000000002, 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.174974+0000", 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.174974+0000", 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.174974+0000", 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8199999999999999e-07 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.174978+0000", 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0860000000000004e-06 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.174988+0000", 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9979999999999998e-06 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.174995+0000", 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1550000000000001e-06 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.175045+0000", 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9641000000000001e-05 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.175071+0000", 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6665e-05 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.178109+0000", 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0030381760000000001 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.178150+0000", 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0108999999999998e-05 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:12 3.a e26/23 3:534698ff:::rbd_header.11243bc9e3dc:head v 26'1, mlcod=0'0)", 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.191040+0000", 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.6394317540000003, 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00056105100000000002, 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191040+0000", 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191040+0000", 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191040+0000", 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6399999999999998e-07 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191045+0000", 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5950000000000001e-06 2024-09-21T22:01:00.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191056+0000", 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1583000000000001e-05 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191065+0000", 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0690000000000002e-06 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191109+0000", 2024-09-21T22:01:00.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4246999999999998e-05 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191121+0000", 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2622e-05 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191576+0000", 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00045455199999999999 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:00.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191601+0000", 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5018999999999999e-05 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:13 3.1d e26/23 3:bca21f9c:::rbd_object_map.11243bc9e3dc:head v 26'1, mlcod=0'0)", 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.192248+0000", 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.6382241539999995, 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046043660000000004, 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:00.861 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.192248+0000", 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.192248+0000", 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.192248+0000", 2024-09-21T22:01:00.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6899999999999997e-07 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.192254+0000", 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.908e-06 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.192263+0000", 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0710000000000001e-06 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.192268+0000", 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.22e-06 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.192321+0000", 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2899000000000003e-05 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.192341+0000", 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9726999999999999e-05 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.196810+0000", 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0044686350000000003 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.196852+0000", 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2237000000000002e-05 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:23 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:00.865 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.202870+0000", 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.6276012870000001, 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00027333799999999998, 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 23 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.866 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202870+0000", 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202870+0000", 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202872+0000", 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.229e-06 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202877+0000", 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8910000000000003e-06 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202888+0000", 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.101e-05 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202893+0000", 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7379999999999999e-06 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202946+0000", 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3060999999999999e-05 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203028+0000", 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2144999999999994e-05 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203144+0000", 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000115264 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.869 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:25 3.a e26/23 3:534698ff:::rbd_header.11243bc9e3dc:head v 26'2, mlcod=0'0)", 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.203969+0000", 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.6265028680000002, 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00048441800000000002, 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203969+0000", 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203969+0000", 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203969+0000", 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0699999999999997e-07 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203975+0000", 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1760000000000001e-06 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203985+0000", 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0015e-05 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203990+0000", 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4299999999999997e-06 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204033+0000", 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3287000000000001e-05 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204047+0000", 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3193999999999999e-05 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204421+0000", 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00037418999999999999 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204453+0000", 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2518999999999998e-05 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:516 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.206471+0000", 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.624000492, 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000165728, 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 516 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.206471+0000", 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.206471+0000", 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.206472+0000", 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3500000000000005e-07 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.875 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.206476+0000", 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2150000000000003e-06 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.206486+0000", 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0046e-05 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.206492+0000", 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8989999999999998e-06 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:00.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.206533+0000", 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1257999999999997e-05 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.206579+0000", 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6001999999999998e-05 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.206637+0000", 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7472999999999997e-05 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:00.877 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:00.879 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:00.920 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:00.918+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:00.945 INFO:teuthology.orchestra.run.smithi102.stdout:22 write 0xa3af8a0 thru 0xa3afde0 (0x541 bytes) 2024-09-21T22:01:00.951 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:00.951 INFO:teuthology.orchestra.run.smithi102.stdout:24 read 0xa054e0c thru 0xa057590 (0x2785 bytes) 2024-09-21T22:01:00.952 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:00.952 INFO:teuthology.orchestra.run.smithi102.stdout:27 writesame 0x23bbbc0 thru 0x23bd7e0 data_size 0x1(0x1c21 bytes) 2024-09-21T22:01:00.960 INFO:teuthology.orchestra.run.smithi102.stdout:28 write 0x4fac489 thru 0x4fb3f30 (0x7aa8 bytes) 2024-09-21T22:01:00.962 INFO:teuthology.orchestra.run.smithi102.stdout:29 read 0xebbbcc thru 0xec5317 (0x974c bytes) 2024-09-21T22:01:00.964 INFO:teuthology.orchestra.run.smithi102.stdout:31 read 0x825dd56 thru 0x826579c (0x7a47 bytes) 2024-09-21T22:01:00.964 INFO:teuthology.orchestra.run.smithi102.stdout:32 read 0x6c0fc56 thru 0x6c1dca2 (0xe04d bytes) 2024-09-21T22:01:00.965 INFO:teuthology.orchestra.run.smithi102.stdout:33 clone 3 order 24 su 4194304 sc 10 2024-09-21T22:01:01.006 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:01.004+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:01.025 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:01.025 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:01.025 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:01.025 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:01.034 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:01.107 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:01.106+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:01.136 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:01.136 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:01.144 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:01.208 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:01.206+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:01.254 INFO:teuthology.orchestra.run.smithi102.stdout:leaving image image_client.0-clone2 intact 2024-09-21T22:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4223.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:44.107455+0000", 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 17.147609284000001, 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0083702059999999998, 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4223", 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/1556248237", 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107455+0000", 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107455+0000", 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107459+0000", 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5710000000000002e-06 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107465+0000", 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3999999999999997e-06 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107476+0000", 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0659000000000001e-05 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107487+0000", 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0885e-05 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107552+0000", 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4856000000000004e-05 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107560+0000", 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6819999999999992e-06 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.110716+0000", 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031552360000000001 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.110868+0000", 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015241199999999999 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.111016+0000", 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00014772299999999999 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.114858+0000", 2024-09-21T22:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0038420279999999999 2024-09-21T22:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.115761+0000", 2024-09-21T22:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00090352399999999995 2024-09-21T22:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.115795+0000", 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3877000000000001e-05 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.115825+0000", 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0352999999999999e-05 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4223.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-21T22:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:45.115252+0000", 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.139812309, 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0033641349999999999, 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4223", 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/1556248237", 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.115252+0000", 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.115252+0000", 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.115256+0000", 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.32e-06 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.115274+0000", 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8315999999999999e-05 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.115328+0000", 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4536000000000001e-05 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.115352+0000", 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3289e-05 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.115467+0000", 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000115685 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.115473+0000", 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.117051+0000", 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0015779839999999999 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.117162+0000", 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000111043 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.117286+0000", 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012407999999999999 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.118057+0000", 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00077133300000000002 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.118556+0000", 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049868999999999998 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.118588+0000", 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2042000000000003e-05 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:45.118616+0000", 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8518999999999999e-05 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4223.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:46.120213+0000", 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 15.134851451999999, 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0037230940000000001, 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4223", 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/1556248237", 2024-09-21T22:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.120213+0000", 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.120213+0000", 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.120215+0000", 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.875e-06 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.120224+0000", 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7560000000000005e-06 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.120240+0000", 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5755000000000001e-05 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.120251+0000", 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1283e-05 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.120338+0000", 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7343999999999996e-05 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.120343+0000", 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8110000000000002e-06 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.122034+0000", 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016906880000000001 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.122118+0000", 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4600999999999999e-05 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.122232+0000", 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0001142 2024-09-21T22:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.123005+0000", 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00077213 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.123866+0000", 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00086098299999999995 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.123904+0000", 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8899000000000001e-05 2024-09-21T22:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:46.123936+0000", 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1769e-05 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:10 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.170968+0000", 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.084096637, 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.007423781, 2024-09-21T22:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 10 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170968+0000", 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170968+0000", 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170969+0000", 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.432e-06 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170982+0000", 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2962000000000001e-05 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170990+0000", 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6580000000000002e-06 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170998+0000", 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0239999999999997e-06 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.171057+0000", 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9273e-05 2024-09-21T22:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.171061+0000", 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.929e-06 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.172632+0000", 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001570744 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.172744+0000", 2024-09-21T22:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112328 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.172900+0000", 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015537799999999999 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.178040+0000", 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0051403530000000003 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.178269+0000", 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000229445 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.178344+0000", 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4066999999999994e-05 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.178392+0000", 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8188e-05 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:13 3.1d 3:bca21f9c:::rbd_object_map.11243bc9e3dc:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.191911+0000", 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.063153207, 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0051174369999999999, 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 13 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191911+0000", 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191911+0000", 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191913+0000", 2024-09-21T22:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.268e-06 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191918+0000", 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4530000000000001e-06 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191929+0000", 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0749e-05 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191934+0000", 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5090000000000001e-06 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191979+0000", 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4944000000000002e-05 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.192069+0000", 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0063999999999997e-05 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.192179+0000", 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010972 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.196681+0000", 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045021339999999997 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.196957+0000", 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00027581300000000002 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.196990+0000", 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2957999999999999e-05 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.197029+0000", 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8825000000000002e-05 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:535 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.628477+0000", 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.62658729800000001, 2024-09-21T22:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001333807, 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 535 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.628477+0000", 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.628477+0000", 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.628479+0000", 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7120000000000001e-06 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.628494+0000", 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5284000000000001e-05 2024-09-21T22:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.628511+0000", 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6331e-05 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.628521+0000", 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0379e-05 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.628586+0000", 2024-09-21T22:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5448000000000001e-05 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.628675+0000", 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869999999999994e-05 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.628825+0000", 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00014922700000000001 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.629262+0000", 2024-09-21T22:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00043748600000000001 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.629749+0000", 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00048651100000000002 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.629783+0000", 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4462999999999999e-05 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.629811+0000", 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8096e-05 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:553 3.16 3:684c0bcb:::rbd_header.11247a6aa9e6:head [call rbd.parent_attach in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.644992+0000", 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.61007303300000004, 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0025158400000000001, 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.297 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 553 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.644992+0000", 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.644992+0000", 2024-09-21T22:01:01.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.644992+0000", 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.644996+0000", 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1489999999999996e-06 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.645005+0000", 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0790000000000007e-06 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.645011+0000", 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8969999999999996e-06 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.645047+0000", 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5961999999999999e-05 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.645089+0000", 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2088000000000001e-05 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.645215+0000", 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012520899999999999 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.647443+0000", 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022287230000000002 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.647456+0000", 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2493999999999999e-05 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.647484+0000", 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7835999999999999e-05 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.647507+0000", 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3751e-05 2024-09-21T22:01:01.302 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:571 3.16 3:6efed54a:::rbd_data.1124354cd08a.000000000000000e:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.659315+0000", 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.59574938200000005, 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0072942529999999997, 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 571 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659315+0000", 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659315+0000", 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659317+0000", 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.621e-06 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659321+0000", 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2200000000000003e-06 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659333+0000", 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1501000000000001e-05 2024-09-21T22:01:01.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659338+0000", 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7509999999999997e-06 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659404+0000", 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6019000000000006e-05 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659483+0000", 2024-09-21T22:01:01.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8543999999999999e-05 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659675+0000", 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000191862 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661341+0000", 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016665580000000001 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666513+0000", 2024-09-21T22:01:01.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0051719000000000001 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666565+0000", 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1583999999999999e-05 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666609+0000", 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4693000000000001e-05 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:575 3.c 3:3722f66b:::rbd_data.1124354cd08a.0000000000000012:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.659358+0000", 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.59570666299999997, 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0066120379999999998, 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 575 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659358+0000", 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659358+0000", 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659358+0000", 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5299999999999999e-07 2024-09-21T22:01:01.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659361+0000", 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.649e-06 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659367+0000", 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3489999999999997e-06 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659372+0000", 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7609999999999998e-06 2024-09-21T22:01:01.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659425+0000", 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2546999999999997e-05 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659506+0000", 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1261999999999995e-05 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659685+0000", 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00017929400000000001 2024-09-21T22:01:01.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661431+0000", 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001746095 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665873+0000", 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0044420179999999998 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665924+0000", 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1038999999999997e-05 2024-09-21T22:01:01.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665970+0000", 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5571000000000001e-05 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:576 3.16 3:6c9d92e4:::rbd_data.1124354cd08a.0000000000000013:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.659387+0000", 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.59567788300000002, 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.007532548, 2024-09-21T22:01:01.314 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 576 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659387+0000", 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659387+0000", 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659387+0000", 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659390+0000", 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5749999999999999e-06 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659396+0000", 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.494e-06 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659401+0000", 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660246+0000", 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00084501300000000004 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660335+0000", 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8893000000000004e-05 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660514+0000", 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00017934400000000001 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666642+0000", 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0061280199999999996 2024-09-21T22:01:01.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666825+0000", 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018291600000000001 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666869+0000", 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4388999999999998e-05 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666919+0000", 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9762999999999998e-05 2024-09-21T22:01:01.319 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:579 3.5 3:a1718368:::rbd_data.1124354cd08a.0000000000000016:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.659411+0000", 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.59565360000000001, 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0065828739999999998, 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.320 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 579 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659411+0000", 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659411+0000", 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659411+0000", 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4000000000000002e-07 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659414+0000", 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.368e-06 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659420+0000", 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1999999999999999e-06 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659426+0000", 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.57e-06 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659481+0000", 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5869000000000003e-05 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659560+0000", 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8670000000000004e-05 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659733+0000", 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000172549 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661711+0000", 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0019781909999999998 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665901+0000", 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0041897169999999999 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665950+0000", 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9781999999999999e-05 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665994+0000", 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3517999999999999e-05 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:574 3.10 e29/28 3:0ab619e6:::rbd_data.1124354cd08a.0000000000000011:head v 29'3, mlcod=0'0)", 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.660006+0000", 2024-09-21T22:01:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.59505830299999996, 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0068589649999999999, 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660006+0000", 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660006+0000", 2024-09-21T22:01:01.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660007+0000", 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7700000000000003e-07 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660014+0000", 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4760000000000003e-06 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660050+0000", 2024-09-21T22:01:01.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6319000000000002e-05 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660068+0000", 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8289000000000001e-05 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660133+0000", 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4863000000000006e-05 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660157+0000", 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4233e-05 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666836+0000", 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0066788350000000002 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666865+0000", 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9073000000000001e-05 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:582 3.16 3:6dae6730:::rbd_data.1124354cd08a.0000000000000019:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.661419+0000", 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.593646008, 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00728672, 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 582 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661419+0000", 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661419+0000", 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661422+0000", 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7440000000000001e-06 2024-09-21T22:01:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661428+0000", 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2560000000000002e-06 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661438+0000", 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0634e-05 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661446+0000", 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4420000000000001e-06 2024-09-21T22:01:01.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661480+0000", 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4722999999999999e-05 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661528+0000", 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8068999999999997e-05 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661635+0000", 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010618799999999999 2024-09-21T22:01:01.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.668526+0000", 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.006891777 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.668650+0000", 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012390599999999999 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.668680+0000", 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9980000000000001e-05 2024-09-21T22:01:01.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.668705+0000", 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5001e-05 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:602 3.1c 3:3c7b78ee:::rbd_data.1124354cd08a.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,truncate 327680] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.676510+0000", 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.57855504300000005, 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0021692, 2024-09-21T22:01:01.335 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 602 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676510+0000", 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676510+0000", 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676511+0000", 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.243e-06 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676516+0000", 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2789999999999998e-06 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676529+0000", 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3339999999999999e-05 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676539+0000", 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4269999999999997e-06 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676596+0000", 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7253000000000002e-05 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676739+0000", 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00014243900000000001 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676929+0000", 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00019037200000000001 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.677486+0000", 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00055724400000000003 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678565+0000", 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001078664 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678631+0000", 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6562000000000004e-05 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678679+0000", 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7376999999999997e-05 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.340 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:610 3.c 3:350c8cd6:::rbd_data.1124354cd08a.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,truncate 311296] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.682580+0000", 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.57248491199999996, 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0038441819999999998, 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 610 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.341 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682580+0000", 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682580+0000", 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682581+0000", 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3e-06 2024-09-21T22:01:01.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682588+0000", 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8889999999999996e-06 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682600+0000", 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2179e-05 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682608+0000", 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9400000000000002e-06 2024-09-21T22:01:01.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682680+0000", 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1575000000000005e-05 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682826+0000", 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00014683799999999999 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683018+0000", 2024-09-21T22:01:01.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00019197800000000001 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683911+0000", 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00089256199999999996 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.686322+0000", 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.002411566 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.686381+0000", 2024-09-21T22:01:01.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8026000000000003e-05 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.686424+0000", 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3328999999999998e-05 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:613 3.17 e29/23 3:e8b191fb:::rbd_data.1124354cd08a.000000000000000d:head v 29'2, mlcod=0'0)", 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.684398+0000", 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.57066672799999996, 2024-09-21T22:01:01.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0021982239999999999, 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.684398+0000", 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.684398+0000", 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.684399+0000", 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.68e-07 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.684405+0000", 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4629999999999998e-06 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.684414+0000", 2024-09-21T22:01:01.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.414e-06 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.684419+0000", 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5589999999999999e-06 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.684462+0000", 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3248999999999999e-05 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.684476+0000", 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3815000000000001e-05 2024-09-21T22:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.686564+0000", 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0020876689999999999 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.686596+0000", 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2387e-05 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.350 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:897 3.16 3:6c9d92e4:::rbd_data.1124354cd08a.0000000000000013:4 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.963240+0000", 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.29182466200000001, 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0014168519999999999, 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 897 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.963240+0000", 2024-09-21T22:01:01.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.963240+0000", 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.963240+0000", 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.963242+0000", 2024-09-21T22:01:01.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.075e-06 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.963249+0000", 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4779999999999996e-06 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.963254+0000", 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6450000000000002e-06 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.964472+0000", 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001217243 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.964548+0000", 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5882000000000003e-05 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.964657+0000", 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010914800000000001 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:921 3.16 3:6dae6730:::rbd_data.1124354cd08a.0000000000000019:4 [read 835584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.964008+0000", 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.29105692399999999, 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0013300709999999999, 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 921 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.964008+0000", 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.964008+0000", 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.964008+0000", 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2600000000000002e-07 2024-09-21T22:01:01.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.964011+0000", 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2040000000000002e-06 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.964019+0000", 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0330000000000003e-06 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.964024+0000", 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5149999999999997e-06 2024-09-21T22:01:01.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.965234+0000", 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0012102700000000001 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.965283+0000", 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8927000000000001e-05 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.965338+0000", 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4496000000000001e-05 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:935 3.16 3:684c0bcb:::rbd_header.11247a6aa9e6:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.190935+0000", 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.064129606000000006, 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0033294539999999999, 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.359 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 935 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.190935+0000", 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.190935+0000", 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.190937+0000", 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0080000000000001e-06 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.190947+0000", 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0441e-05 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.190966+0000", 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8096000000000001e-05 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.190978+0000", 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2033e-05 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.191030+0000", 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2957999999999997e-05 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.191036+0000", 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0930000000000002e-06 2024-09-21T22:01:01.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.192849+0000", 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018135950000000001 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.192909+0000", 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9858000000000002e-05 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.193127+0000", 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00021765099999999999 2024-09-21T22:01:01.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.193689+0000", 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00056276500000000001 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.194170+0000", 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00048058200000000001 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.194221+0000", 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0677000000000003e-05 2024-09-21T22:01:01.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.194264+0000", 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3696999999999999e-05 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:996 3.5 3:a7daa15d:::rbd_id.image_client.0-clone3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.232340+0000", 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.022724973999999998, 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0013365689999999999, 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:01.365 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 996 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.232340+0000", 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:01.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.232340+0000", 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.232340+0000", 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6599999999999995e-07 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.232345+0000", 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2300000000000002e-06 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:01.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.232354+0000", 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7079999999999992e-06 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.232361+0000", 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0859999999999996e-06 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.232408+0000", 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6421999999999997e-05 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.232500+0000", 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1794999999999998e-05 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.232616+0000", 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000116698 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.233230+0000", 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00061393899999999998 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.233624+0000", 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00039368200000000002 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.233653+0000", 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9448e-05 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.233676+0000", 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2795000000000001e-05 2024-09-21T22:01:01.370 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.371 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.371 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.371 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:01.371 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:01.371 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:01.371 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:01:01.371 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:01.373 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:01.370+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:01.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:01.395 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-21T22:01:01.411 INFO:teuthology.orchestra.run.smithi102.stdout:34 punch from 0x4b5d37e to 0x4b68bf8, (0xb87a bytes) 2024-09-21T22:01:01.416 INFO:teuthology.orchestra.run.smithi102.stdout:35 writesame 0x9057aa1 thru 0x9065060 data_size 0xc0(0xd5c0 bytes) 2024-09-21T22:01:01.425 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.425 INFO:teuthology.orchestra.run.smithi102.stdout:37 write 0xa32a5f7 thru 0xa32d631 (0x303b bytes) 2024-09-21T22:01:01.430 INFO:teuthology.orchestra.run.smithi102.stdout:38 write 0x1557aa4 thru 0x1567514 (0xfa71 bytes) 2024-09-21T22:01:01.438 INFO:teuthology.orchestra.run.smithi102.stdout:39 write 0x3d9c411 thru 0x3dab352 (0xef42 bytes) 2024-09-21T22:01:01.440 INFO:teuthology.orchestra.run.smithi102.stdout:40 writesame 0x1822c92 thru 0x1824b31 data_size 0x28(0x1ea0 bytes) 2024-09-21T22:01:01.449 INFO:teuthology.orchestra.run.smithi102.stdout:41 trunc from 0xa3afde1 to 0x3c46945 2024-09-21T22:01:01.475 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:01.473+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:01.522 INFO:teuthology.orchestra.run.smithi102.stdout:42 read 0x286c03e thru 0x2871630 (0x55f3 bytes) 2024-09-21T22:01:01.522 INFO:teuthology.orchestra.run.smithi102.stdout:43 read 0x2f908a0 thru 0x2f98cc3 (0x8424 bytes) 2024-09-21T22:01:01.527 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:01.527 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:01.537 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:01.537 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:01.537 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:01.537 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:01.541 INFO:teuthology.orchestra.run.smithi102.stdout:44 write 0xa9bf056 thru 0xa9cb0c4 (0xc06f bytes) 2024-09-21T22:01:01.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:01.547 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:01.547 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:01.547 INFO:teuthology.orchestra.run.smithi102.stdout:45 punch from 0x8f7cb8e to 0x8f8584e, (0x8cc0 bytes) 2024-09-21T22:01:01.547 INFO:teuthology.orchestra.run.smithi102.stdout:46 write 0x38b7320 thru 0x38c0865 (0x9546 bytes) 2024-09-21T22:01:01.549 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.550 INFO:teuthology.orchestra.run.smithi102.stdout:48 write 0x8339736 thru 0x83457bd (0xc088 bytes) 2024-09-21T22:01:01.552 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.552 INFO:teuthology.orchestra.run.smithi102.stdout:50 read 0x7a495a9 thru 0x7a54f5a (0xb9b2 bytes) 2024-09-21T22:01:01.563 INFO:teuthology.orchestra.run.smithi102.stdout:53 write 0xe837341 thru 0xe845bc1 (0xe881 bytes) 2024-09-21T22:01:01.564 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:01.564 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:01.566 INFO:teuthology.orchestra.run.smithi102.stdout:54 read 0xb0bae04 thru 0xb0c0f76 (0x6173 bytes) 2024-09-21T22:01:01.567 INFO:teuthology.orchestra.run.smithi102.stdout:55 punch from 0x59946d8 to 0x599c17f, (0x7aa7 bytes) 2024-09-21T22:01:01.567 INFO:teuthology.orchestra.run.smithi102.stdout:56 write 0xcfec6f3 thru 0xcff068b (0x3f99 bytes) 2024-09-21T22:01:01.570 INFO:teuthology.orchestra.run.smithi102.stdout:58 write 0xd2deda7 thru 0xd2e0075 (0x12cf bytes) 2024-09-21T22:01:01.571 INFO:teuthology.orchestra.run.smithi102.stdout:60 writesame 0x17a1dd5 thru 0x17a20e6 data_size 0x1(0x312 bytes) 2024-09-21T22:01:01.574 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:01.572+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:01.581 INFO:teuthology.orchestra.run.smithi102.stdout:61 trunc from 0xe845bc2 to 0x77f4470 2024-09-21T22:01:01.582 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:01.600 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:01.600 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:01.618 INFO:teuthology.orchestra.run.smithi102.stdout:63 writesame 0xea64687 thru 0xea69fee data_size 0x4(0x5968 bytes) 2024-09-21T22:01:01.629 INFO:teuthology.orchestra.run.smithi102.stdout:64 trunc from 0xea69fef to 0x5d259fa 2024-09-21T22:01:01.632 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:01.633 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:01.653 INFO:teuthology.orchestra.run.smithi102.stdout:68 write 0x90c1c70 thru 0x90cdb9d (0xbf2e bytes) 2024-09-21T22:01:01.653 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:01.653 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:01.655 INFO:teuthology.orchestra.run.smithi102.stdout:70 write 0x5e497c8 thru 0x5e5106f (0x78a8 bytes) 2024-09-21T22:01:01.656 INFO:teuthology.orchestra.run.smithi102.stdout:71 punch from 0x2968929 to 0x296cea3, (0x457a bytes) 2024-09-21T22:01:01.657 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.657 INFO:teuthology.orchestra.run.smithi102.stdout:73 write 0xaad60e thru 0xabd4d2 (0xfec5 bytes) 2024-09-21T22:01:01.657 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:01.657 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:01.659 INFO:teuthology.orchestra.run.smithi102.stdout:74 punch from 0x8061e0b to 0x806a57b, (0x8770 bytes) 2024-09-21T22:01:01.659 INFO:teuthology.orchestra.run.smithi102.stdout:75 read 0xa02cd4 thru 0xa11f6a (0xf297 bytes) 2024-09-21T22:01:01.659 INFO:teuthology.orchestra.run.smithi102.stdout:77 read 0x4551989 thru 0x4552d7d (0x13f5 bytes) 2024-09-21T22:01:01.660 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.665 INFO:teuthology.orchestra.run.smithi102.stdout:79 trunc from 0x90cdb9e to 0xcf5bfb3 2024-09-21T22:01:01.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:01.670 INFO:teuthology.orchestra.run.smithi102.stdout:80 read 0x89b5657 thru 0x89bebb8 (0x9562 bytes) 2024-09-21T22:01:01.670 INFO:teuthology.orchestra.run.smithi102.stdout:81 write 0x7964aff thru 0x7966035 (0x1537 bytes) 2024-09-21T22:01:01.672 INFO:teuthology.orchestra.run.smithi102.stdout:82 write 0x9ceac1 thru 0x9d93bb (0xa8fb bytes) 2024-09-21T22:01:01.673 INFO:teuthology.orchestra.run.smithi102.stdout:83 write 0x3a07626 thru 0x3a119a8 (0xa383 bytes) 2024-09-21T22:01:01.674 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:01.674 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:01.675 INFO:teuthology.orchestra.run.smithi102.stdout:86 punch from 0x126da24 to 0x127c81e, (0xedfa bytes) 2024-09-21T22:01:01.675 INFO:teuthology.orchestra.run.smithi102.stdout:87 read 0xba0dc8f thru 0xba1550f (0x7881 bytes) 2024-09-21T22:01:01.675 INFO:teuthology.orchestra.run.smithi102.stdout:88 write 0x2ae4b62 thru 0x2af00f1 (0xb590 bytes) 2024-09-21T22:01:01.676 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.677 INFO:teuthology.orchestra.run.smithi102.stdout:91 trunc from 0xcf5bfb3 to 0xd5232c7 2024-09-21T22:01:01.688 INFO:teuthology.orchestra.run.smithi102.stdout:92 trunc from 0xd5232c7 to 0x833bcb6 2024-09-21T22:01:01.696 INFO:teuthology.orchestra.run.smithi102.stdout:93 punch from 0x64970e7 to 0x649e567, (0x7480 bytes) 2024-09-21T22:01:01.696 INFO:teuthology.orchestra.run.smithi102.stdout:94 write 0x6867cde thru 0x6873da7 (0xc0ca bytes) 2024-09-21T22:01:01.698 INFO:teuthology.orchestra.run.smithi102.stdout:95 trunc from 0x833bcb6 to 0x8a0cc52 2024-09-21T22:01:01.703 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.703 INFO:teuthology.orchestra.run.smithi102.stdout:97 read 0x3fa2036 thru 0x3fabdba (0x9d85 bytes) 2024-09-21T22:01:01.703 INFO:teuthology.orchestra.run.smithi102.stdout:98 writesame 0x56b2ec1 thru 0x56c0d65 data_size 0x9(0xdea5 bytes) 2024-09-21T22:01:01.706 INFO:teuthology.orchestra.run.smithi102.stdout:99 writesame 0x4055bb2 thru 0x40585bd data_size 0xd(0x2a0c bytes) 2024-09-21T22:01:01.708 INFO:teuthology.orchestra.run.smithi102.stdout:100 punch from 0x2f9d449 to 0x2faae51, (0xda08 bytes) 2024-09-21T22:01:01.708 INFO:teuthology.orchestra.run.smithi102.stdout:101 punch from 0x5f052af to 0x5f0872d, (0x347e bytes) 2024-09-21T22:01:01.708 INFO:teuthology.orchestra.run.smithi102.stdout:102 writesame 0x4f519d6 thru 0x4f585bf data_size 0x13(0x6bea bytes) 2024-09-21T22:01:01.709 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:01.708+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:01.718 INFO:teuthology.orchestra.run.smithi102.stdout:104 trunc from 0x8a0cc52 to 0x15884d5 2024-09-21T22:01:01.762 INFO:teuthology.orchestra.run.smithi102.stdout:105 write 0xe76ec56 thru 0xe7796bf (0xaa6a bytes) 2024-09-21T22:01:01.765 INFO:teuthology.orchestra.run.smithi102.stdout:107 writesame 0x771cbac thru 0x772b2b5 data_size 0x1(0xe70a bytes) 2024-09-21T22:01:01.775 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:01.773+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:01.779 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:01.779 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:01.788 INFO:teuthology.orchestra.run.smithi102.stdout:108 read 0x988e800 thru 0x989447a (0x5c7b bytes) 2024-09-21T22:01:01.789 INFO:teuthology.orchestra.run.smithi102.stdout:110 read 0x10bafc0 thru 0x10bdfc3 (0x3004 bytes) 2024-09-21T22:01:01.789 INFO:teuthology.orchestra.run.smithi102.stdout:112 punch from 0xc312af0 to 0xc31f114, (0xc624 bytes) 2024-09-21T22:01:01.789 INFO:teuthology.orchestra.run.smithi102.stdout:113 punch from 0x15e658e to 0x15e8d3f, (0x27b1 bytes) 2024-09-21T22:01:01.790 INFO:teuthology.orchestra.run.smithi102.stdout:116 read 0x988a98c thru 0x9898594 (0xdc09 bytes) 2024-09-21T22:01:01.790 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.790 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.790 INFO:teuthology.orchestra.run.smithi102.stdout:120 read 0x7aa82a3 thru 0x7aa92b4 (0x1012 bytes) 2024-09-21T22:01:01.790 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.790 INFO:teuthology.orchestra.run.smithi102.stdout:124 write 0xa0bc890 thru 0xa0cbcf8 (0xf469 bytes) 2024-09-21T22:01:01.791 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:01.793 INFO:teuthology.orchestra.run.smithi102.stdout:127 writesame 0x3710ab3 thru 0x371ee37 data_size 0xb(0xe385 bytes) 2024-09-21T22:01:01.796 INFO:teuthology.orchestra.run.smithi102.stdout:129 write 0x1f7c569 thru 0x1f89ee4 (0xd97c bytes) 2024-09-21T22:01:01.799 INFO:teuthology.orchestra.run.smithi102.stdout:130 read 0x84a125f thru 0x84a9d1f (0x8ac1 bytes) 2024-09-21T22:01:01.799 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.799 INFO:teuthology.orchestra.run.smithi102.stdout:132 read 0x202642e thru 0x202f7fd (0x93d0 bytes) 2024-09-21T22:01:01.799 INFO:teuthology.orchestra.run.smithi102.stdout:133 punch from 0x1d5813a to 0x1d5ac3f, (0x2b05 bytes) 2024-09-21T22:01:01.799 INFO:teuthology.orchestra.run.smithi102.stdout:134 write 0xe1ec1b0 thru 0xe1f6bbc (0xaa0d bytes) 2024-09-21T22:01:01.802 INFO:teuthology.orchestra.run.smithi102.stdout:135 read 0xabf27c0 thru 0xac01c4f (0xf490 bytes) 2024-09-21T22:01:01.803 INFO:teuthology.orchestra.run.smithi102.stdout:136 write 0x15c4ca thru 0x168358 (0xbe8f bytes) 2024-09-21T22:01:01.804 INFO:teuthology.orchestra.run.smithi102.stdout:137 write 0xbcdbfdc thru 0xbce2e08 (0x6e2d bytes) 2024-09-21T22:01:01.806 INFO:teuthology.orchestra.run.smithi102.stdout:140 read 0xab108d5 thru 0xab17fb9 (0x76e5 bytes) 2024-09-21T22:01:01.806 INFO:teuthology.orchestra.run.smithi102.stdout:141 write 0x1ce1a8e thru 0x1ce6ef4 (0x5467 bytes) 2024-09-21T22:01:01.807 INFO:teuthology.orchestra.run.smithi102.stdout:144 write 0x830e5d thru 0x8365c8 (0x576c bytes) 2024-09-21T22:01:01.808 INFO:teuthology.orchestra.run.smithi102.stdout:145 write 0x3468840 thru 0x346cd02 (0x44c3 bytes) 2024-09-21T22:01:01.810 INFO:teuthology.orchestra.run.smithi102.stdout:146 read 0xa980d47 thru 0xa9825fb (0x18b5 bytes) 2024-09-21T22:01:01.810 INFO:teuthology.orchestra.run.smithi102.stdout:148 punch from 0x78884a4 to 0x7892abb, (0xa617 bytes) 2024-09-21T22:01:01.810 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.810 INFO:teuthology.orchestra.run.smithi102.stdout:152 read 0x91a84dc thru 0x91b0a54 (0x8579 bytes) 2024-09-21T22:01:01.810 INFO:teuthology.orchestra.run.smithi102.stdout:153 write 0x4f04287 thru 0x4f095b0 (0x532a bytes) 2024-09-21T22:01:01.812 INFO:teuthology.orchestra.run.smithi102.stdout:154 read 0xb6e0ab5 thru 0xb6e2e7b (0x23c7 bytes) 2024-09-21T22:01:01.812 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.812 INFO:teuthology.orchestra.run.smithi102.stdout:158 write 0xe5f3af3 thru 0xe5f79eb (0x3ef9 bytes) 2024-09-21T22:01:01.813 INFO:teuthology.orchestra.run.smithi102.stdout:160 read 0xc31eb39 thru 0xc321da4 (0x326c bytes) 2024-09-21T22:01:01.813 INFO:teuthology.orchestra.run.smithi102.stdout:161 write 0x2c36c6f thru 0x2c37c22 (0xfb4 bytes) 2024-09-21T22:01:01.815 INFO:teuthology.orchestra.run.smithi102.stdout:162 punch from 0xb0f3a29 to 0xb100e30, (0xd407 bytes) 2024-09-21T22:01:01.815 INFO:teuthology.orchestra.run.smithi102.stdout:163 write 0x5336ac0 thru 0x5345ea1 (0xf3e2 bytes) 2024-09-21T22:01:01.816 INFO:teuthology.orchestra.run.smithi102.stdout:164 read 0x81fb2b5 thru 0x82092a6 (0xdff2 bytes) 2024-09-21T22:01:01.817 INFO:teuthology.orchestra.run.smithi102.stdout:165 trunc from 0xe7796c0 to 0xe359900 2024-09-21T22:01:01.823 INFO:teuthology.orchestra.run.smithi102.stdout:166 read 0x988ee73 thru 0x9894f53 (0x60e1 bytes) 2024-09-21T22:01:01.824 INFO:teuthology.orchestra.run.smithi102.stdout:167 read 0x7f24058 thru 0x7f339e9 (0xf992 bytes) 2024-09-21T22:01:01.825 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.825 INFO:teuthology.orchestra.run.smithi102.stdout:170 read 0xa92d8c7 thru 0xa936d8b (0x94c5 bytes) 2024-09-21T22:01:01.837 INFO:teuthology.orchestra.run.smithi102.stdout:172 trunc from 0xe359900 to 0x38989a9 2024-09-21T22:01:01.857 INFO:teuthology.orchestra.run.smithi102.stdout:174 read 0x30db8ce thru 0x30dd13e (0x1871 bytes) 2024-09-21T22:01:01.857 INFO:teuthology.orchestra.run.smithi102.stdout:175 read 0x2b95b8d thru 0x2ba1499 (0xb90d bytes) 2024-09-21T22:01:01.858 INFO:teuthology.orchestra.run.smithi102.stdout:176 punch from 0x2cf8015 to 0x2cff338, (0x7323 bytes) 2024-09-21T22:01:01.858 INFO:teuthology.orchestra.run.smithi102.stdout:177 read 0x3bda90 thru 0x3cc01c (0xe58d bytes) 2024-09-21T22:01:01.858 INFO:teuthology.orchestra.run.smithi102.stdout:178 read 0x855b0b thru 0x85eec5 (0x93bb bytes) 2024-09-21T22:01:01.871 INFO:teuthology.orchestra.run.smithi102.stdout:179 trunc from 0x38989a9 to 0xe2a9e09 2024-09-21T22:01:01.875 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:01.873+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:01.878 INFO:teuthology.orchestra.run.smithi102.stdout:181 write 0x647ef1b thru 0x64849c9 (0x5aaf bytes) 2024-09-21T22:01:01.879 INFO:teuthology.orchestra.run.smithi102.stdout:184 writesame 0x9d96422 thru 0x9d9f6d9 data_size 0x1e(0x92b8 bytes) 2024-09-21T22:01:01.882 INFO:teuthology.orchestra.run.smithi102.stdout:185 trunc from 0xe2a9e09 to 0xd90c00d 2024-09-21T22:01:01.887 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:01.887 INFO:teuthology.orchestra.run.smithi102.stdout:189 punch from 0x1ef3ab2 to 0x1efc041, (0x858f bytes) 2024-09-21T22:01:01.900 INFO:teuthology.orchestra.run.smithi102.stdout:190 trunc from 0xd90c00d to 0x29af530 2024-09-21T22:01:01.923 INFO:teuthology.orchestra.run.smithi102.stdout:191 write 0x6dedf62 thru 0x6df4ae8 (0x6b87 bytes) 2024-09-21T22:01:01.938 INFO:teuthology.orchestra.run.smithi102.stdout:193 writesame 0xd4136cb thru 0xd421de7 data_size 0x1(0xe71d bytes) 2024-09-21T22:01:01.940 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:01.940 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:01.949 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:01.949 INFO:teuthology.orchestra.run.smithi102.stdout:194 trunc from 0xd421de8 to 0x396c076 2024-09-21T22:01:01.958 INFO:teuthology.orchestra.run.smithi102.stdout:195 punch from 0x1bcd489 to 0x1bdcba0, (0xf717 bytes) 2024-09-21T22:01:01.958 INFO:teuthology.orchestra.run.smithi102.stdout:196 trunc from 0x396c076 to 0x3085f74 2024-09-21T22:01:01.974 INFO:teuthology.orchestra.run.smithi102.stdout:197 write 0x3cef4b6 thru 0x3cf6b30 (0x767b bytes) 2024-09-21T22:01:01.975 INFO:teuthology.orchestra.run.smithi102.stdout:198 write 0x3ca4c54 thru 0x3cb2fc6 (0xe373 bytes) 2024-09-21T22:01:01.987 INFO:teuthology.orchestra.run.smithi102.stdout:199 trunc from 0x3cf6b31 to 0xc8c2c51 2024-09-21T22:01:01.993 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:01.991+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:01.993 INFO:teuthology.orchestra.run.smithi102.stdout:200 write 0x292ab2f thru 0x2939fe2 (0xf4b4 bytes) 2024-09-21T22:01:01.994 INFO:teuthology.orchestra.run.smithi102.stdout:201 read 0x1fbfcb9 thru 0x1fcdd40 (0xe088 bytes) 2024-09-21T22:01:01.995 INFO:teuthology.orchestra.run.smithi102.stdout:202 writesame 0x858be65 thru 0x8594fb9 data_size 0x7(0x9155 bytes) 2024-09-21T22:01:01.997 INFO:teuthology.orchestra.run.smithi102.stdout:203 writesame 0x77fe192 thru 0x780d667 data_size 0x4a(0xf4d6 bytes) 2024-09-21T22:01:02.003 INFO:teuthology.orchestra.run.smithi102.stdout:206 write 0x4dd09f3 thru 0x4ddd768 (0xcd76 bytes) 2024-09-21T22:01:02.004 INFO:teuthology.orchestra.run.smithi102.stdout:207 read 0x6aefcd8 thru 0x6af26fc (0x2a25 bytes) 2024-09-21T22:01:02.017 INFO:teuthology.orchestra.run.smithi102.stdout:209 trunc from 0xc8c2c51 to 0x20414cf 2024-09-21T22:01:02.028 INFO:teuthology.orchestra.run.smithi102.stdout:210 punch from 0x182abc5 to 0x1837e5e, (0xd299 bytes) 2024-09-21T22:01:02.035 INFO:teuthology.orchestra.run.smithi102.stdout:211 trunc from 0x20414cf to 0x74d2f7c 2024-09-21T22:01:02.040 INFO:teuthology.orchestra.run.smithi102.stdout:213 read 0x2f0bd60 thru 0x2f138ca (0x7b6b bytes) 2024-09-21T22:01:02.054 INFO:teuthology.orchestra.run.smithi102.stdout:214 writesame 0xe38cd22 thru 0xe39a077 data_size 0x8e(0xd356 bytes) 2024-09-21T22:01:02.054 INFO:teuthology.orchestra.run.smithi102.stdout:215 punch from 0x2b897ad to 0x2b8ca4c, (0x329f bytes) 2024-09-21T22:01:02.055 INFO:teuthology.orchestra.run.smithi102.stdout:217 read 0x4a1f9d6 thru 0x4a25ea5 (0x64d0 bytes) 2024-09-21T22:01:02.055 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.055 INFO:teuthology.orchestra.run.smithi102.stdout:220 writesame 0xca3bd13 thru 0xca4a7b1 data_size 0x1(0xea9f bytes) 2024-09-21T22:01:02.058 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:02.058 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:02.068 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:02.077 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:02.075+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:02.083 INFO:teuthology.orchestra.run.smithi102.stdout:221 punch from 0xac0b198 to 0xac156f7, (0xa55f bytes) 2024-09-21T22:01:02.083 INFO:teuthology.orchestra.run.smithi102.stdout:223 punch from 0x53a3baa to 0x53b3274, (0xf6ca bytes) 2024-09-21T22:01:02.083 INFO:teuthology.orchestra.run.smithi102.stdout:224 punch from 0xd21f148 to 0xd22715c, (0x8014 bytes) 2024-09-21T22:01:02.083 INFO:teuthology.orchestra.run.smithi102.stdout:226 write 0x2a04e11 thru 0x2a09424 (0x4614 bytes) 2024-09-21T22:01:02.099 INFO:teuthology.orchestra.run.smithi102.stdout:227 trunc from 0xe39a078 to 0x18c94b6 2024-09-21T22:01:02.139 INFO:teuthology.orchestra.run.smithi102.stdout:228 write 0xdd3bad9 thru 0xdd3ef27 (0x344f bytes) 2024-09-21T22:01:02.142 INFO:teuthology.orchestra.run.smithi102.stdout:229 writesame 0xc06aa23 thru 0xc074bf4 data_size 0x4d(0xa1d2 bytes) 2024-09-21T22:01:02.145 INFO:teuthology.orchestra.run.smithi102.stdout:230 read 0xb86c755 thru 0xb871b04 (0x53b0 bytes) 2024-09-21T22:01:02.150 INFO:teuthology.orchestra.run.smithi102.stdout:232 write 0xe1da45f thru 0xe1de592 (0x4134 bytes) 2024-09-21T22:01:02.153 INFO:teuthology.orchestra.run.smithi102.stdout:233 read 0xde9f06a thru 0xdeac84d (0xd7e4 bytes) 2024-09-21T22:01:02.154 INFO:teuthology.orchestra.run.smithi102.stdout:234 read 0x4bd4a8d thru 0x4bd58fb (0xe6f bytes) 2024-09-21T22:01:02.154 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.154 INFO:teuthology.orchestra.run.smithi102.stdout:237 read 0x8846b11 thru 0x8853aa9 (0xcf99 bytes) 2024-09-21T22:01:02.154 INFO:teuthology.orchestra.run.smithi102.stdout:238 read 0x85f3cea thru 0x85f7d54 (0x406b bytes) 2024-09-21T22:01:02.159 INFO:teuthology.orchestra.run.smithi102.stdout:239 trunc from 0xe1de593 to 0x9e2e921 2024-09-21T22:01:02.172 INFO:teuthology.orchestra.run.smithi102.stdout:241 write 0x5002531 thru 0x5004a8f (0x255f bytes) 2024-09-21T22:01:02.178 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:02.176+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:02.185 INFO:teuthology.orchestra.run.smithi102.stdout:242 writesame 0xed37cff thru 0xed4194a data_size 0xe(0x9c4c bytes) 2024-09-21T22:01:02.185 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.185 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.185 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.185 INFO:teuthology.orchestra.run.smithi102.stdout:246 read 0x761710c thru 0x761961d (0x2512 bytes) 2024-09-21T22:01:02.185 INFO:teuthology.orchestra.run.smithi102.stdout:247 read 0xcc862db thru 0xcc93d09 (0xda2f bytes) 2024-09-21T22:01:02.185 INFO:teuthology.orchestra.run.smithi102.stdout:248 punch from 0x83c3587 to 0x83d2fd4, (0xfa4d bytes) 2024-09-21T22:01:02.185 INFO:teuthology.orchestra.run.smithi102.stdout:251 writesame 0x73e336c thru 0x73e81f2 data_size 0x1(0x4e87 bytes) 2024-09-21T22:01:02.196 INFO:teuthology.orchestra.run.smithi102.stdout:252 read 0x529f59 thru 0x533f4a (0x9ff2 bytes) 2024-09-21T22:01:02.196 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:01:02.196 INFO:teuthology.orchestra.run.smithi102.stdout:253 writesame 0xb42d7a1 thru 0xb438104 data_size 0x4a(0xa964 bytes) 2024-09-21T22:01:02.201 INFO:teuthology.orchestra.run.smithi102.stdout:254 read 0xb47fb7f thru 0xb48b2b7 (0xb739 bytes) 2024-09-21T22:01:02.202 INFO:teuthology.orchestra.run.smithi102.stdout:256 read 0x29d11f6 thru 0x29e036a (0xf175 bytes) 2024-09-21T22:01:02.202 INFO:teuthology.orchestra.run.smithi102.stdout:257 punch from 0x10793b6 to 0x10870cb, (0xdd15 bytes) 2024-09-21T22:01:02.202 INFO:teuthology.orchestra.run.smithi102.stdout:258 writesame 0xc800f4e thru 0xc80576b data_size 0x33(0x481e bytes) 2024-09-21T22:01:02.207 INFO:teuthology.orchestra.run.smithi102.stdout:260 read 0xc012616 thru 0xc017f7f (0x596a bytes) 2024-09-21T22:01:02.207 INFO:teuthology.orchestra.run.smithi102.stdout:261 write 0x53f6cce thru 0x54014c5 (0xa7f8 bytes) 2024-09-21T22:01:02.209 INFO:teuthology.orchestra.run.smithi102.stdout:263 punch from 0x27692df to 0x27740d5, (0xadf6 bytes) 2024-09-21T22:01:02.209 INFO:teuthology.orchestra.run.smithi102.stdout:264 read 0x98f101c thru 0x98fff24 (0xef09 bytes) 2024-09-21T22:01:02.210 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.210 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.210 INFO:teuthology.orchestra.run.smithi102.stdout:268 punch from 0xa0c0443 to 0xa0c21f3, (0x1db0 bytes) 2024-09-21T22:01:02.210 INFO:teuthology.orchestra.run.smithi102.stdout:269 write 0x24d4361 thru 0x24de1f1 (0x9e91 bytes) 2024-09-21T22:01:02.214 INFO:teuthology.orchestra.run.smithi102.stdout:270 write 0x53e38d3 thru 0x53ee575 (0xaca3 bytes) 2024-09-21T22:01:02.221 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:02.221 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:02.222 INFO:teuthology.orchestra.run.smithi102.stdout:272 trunc from 0xed4194b to 0x9720a19 2024-09-21T22:01:02.231 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:02.238 INFO:teuthology.orchestra.run.smithi102.stdout:273 read 0x772c636 thru 0x7733ac4 (0x748f bytes) 2024-09-21T22:01:02.238 INFO:teuthology.orchestra.run.smithi102.stdout:274 writesame 0x889b030 thru 0x889cec1 data_size 0x2b(0x1e92 bytes) 2024-09-21T22:01:02.247 INFO:teuthology.orchestra.run.smithi102.stdout:276 trunc from 0x9720a19 to 0x2b1a2f7 2024-09-21T22:01:02.263 INFO:teuthology.orchestra.run.smithi102.stdout:277 write 0x38a0cbc thru 0x38a6098 (0x53dd bytes) 2024-09-21T22:01:02.264 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.264 INFO:teuthology.orchestra.run.smithi102.stdout:280 read 0x2ce33d9 thru 0x2cf1efc (0xeb24 bytes) 2024-09-21T22:01:02.278 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:02.277+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:02.282 INFO:teuthology.orchestra.run.smithi102.stdout:281 writesame 0xd0e1c29 thru 0xd0efa4f data_size 0x59(0xde27 bytes) 2024-09-21T22:01:02.282 INFO:teuthology.orchestra.run.smithi102.stdout:283 write 0xa0da7cd thru 0xa0ea47d (0xfcb1 bytes) 2024-09-21T22:01:02.295 INFO:teuthology.orchestra.run.smithi102.stdout:284 write 0xe5fcd65 thru 0xe60b162 (0xe3fe bytes) 2024-09-21T22:01:02.300 INFO:teuthology.orchestra.run.smithi102.stdout:285 write 0x4e7cd13 thru 0x4e8a61e (0xd90c bytes) 2024-09-21T22:01:02.302 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.311 INFO:teuthology.orchestra.run.smithi102.stdout:288 trunc from 0xe60b163 to 0x6e03fe1 2024-09-21T22:01:02.340 INFO:teuthology.orchestra.run.smithi102.stdout:289 trunc from 0x6e03fe1 to 0xd60dac1 2024-09-21T22:01:02.346 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.346 INFO:teuthology.orchestra.run.smithi102.stdout:291 read 0xa701662 thru 0xa71002b (0xe9ca bytes) 2024-09-21T22:01:02.346 INFO:teuthology.orchestra.run.smithi102.stdout:292 read 0x369cfe thru 0x36d603 (0x3906 bytes) 2024-09-21T22:01:02.346 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:02.346 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:02.347 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.347 INFO:teuthology.orchestra.run.smithi102.stdout:294 punch from 0x1d87a33 to 0x1d8df00, (0x64cd bytes) 2024-09-21T22:01:02.347 INFO:teuthology.orchestra.run.smithi102.stdout:295 trunc from 0xd60dac1 to 0xe601c90 2024-09-21T22:01:02.353 INFO:teuthology.orchestra.run.smithi102.stdout:296 write 0x13c2081 thru 0x13cbdcd (0x9d4d bytes) 2024-09-21T22:01:02.355 INFO:teuthology.orchestra.run.smithi102.stdout:297 writesame 0x4759e54 thru 0x4768b6e data_size 0x1(0xed1b bytes) 2024-09-21T22:01:02.356 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:02.383 INFO:teuthology.orchestra.run.smithi102.stdout:298 write 0x203274f thru 0x203fb3c (0xd3ee bytes) 2024-09-21T22:01:02.385 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:02.382+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:02.386 INFO:teuthology.orchestra.run.smithi102.stdout:300 punch from 0x2b5c0f9 to 0x2b6b046, (0xef4d bytes) 2024-09-21T22:01:02.386 INFO:teuthology.orchestra.run.smithi102.stdout:301 punch from 0x774eaec to 0x7753b53, (0x5067 bytes) 2024-09-21T22:01:02.386 INFO:teuthology.orchestra.run.smithi102.stdout:302 punch from 0x2adcb09 to 0x2ae339e, (0x6895 bytes) 2024-09-21T22:01:02.386 INFO:teuthology.orchestra.run.smithi102.stdout:303 writesame 0xe1843ae thru 0xe188095 data_size 0x4(0x3ce8 bytes) 2024-09-21T22:01:02.389 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.389 INFO:teuthology.orchestra.run.smithi102.stdout:306 read 0xe1447dc thru 0xe15045e (0xbc83 bytes) 2024-09-21T22:01:02.389 INFO:teuthology.orchestra.run.smithi102.stdout:307 punch from 0xdad2658 to 0xdae1243, (0xebeb bytes) 2024-09-21T22:01:02.389 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.392 INFO:teuthology.orchestra.run.smithi102.stdout:309 trunc from 0xe601c90 to 0xc121fe3 2024-09-21T22:01:02.404 INFO:teuthology.orchestra.run.smithi102.stdout:310 trunc from 0xc121fe3 to 0x749b8c8 2024-09-21T22:01:02.417 INFO:teuthology.orchestra.run.smithi102.stdout:311 write 0x2796cb2 thru 0x27a4fae (0xe2fd bytes) 2024-09-21T22:01:02.424 INFO:teuthology.orchestra.run.smithi102.stdout:312 trunc from 0x749b8c8 to 0x2740c8c 2024-09-21T22:01:02.442 INFO:teuthology.orchestra.run.smithi102.stdout:313 trunc from 0x2740c8c to 0xb3feb2b 2024-09-21T22:01:02.448 INFO:teuthology.orchestra.run.smithi102.stdout:314 write 0x186343e thru 0x1868daf (0x5972 bytes) 2024-09-21T22:01:02.451 INFO:teuthology.orchestra.run.smithi102.stdout:316 read 0x6904f69 thru 0x6907245 (0x22dd bytes) 2024-09-21T22:01:02.451 INFO:teuthology.orchestra.run.smithi102.stdout:317 read 0x8e44cfc thru 0x8e5313a (0xe43f bytes) 2024-09-21T22:01:02.452 INFO:teuthology.orchestra.run.smithi102.stdout:320 writesame 0x73f625e thru 0x73fe70d data_size 0x2c(0x84b0 bytes) 2024-09-21T22:01:02.454 INFO:teuthology.orchestra.run.smithi102.stdout:321 read 0xb2e2a4a thru 0xb2ebbeb (0x91a2 bytes) 2024-09-21T22:01:02.454 INFO:teuthology.orchestra.run.smithi102.stdout:323 read 0x542b5a1 thru 0x5439a44 (0xe4a4 bytes) 2024-09-21T22:01:02.454 INFO:teuthology.orchestra.run.smithi102.stdout:324 read 0x225a4b3 thru 0x225d834 (0x3382 bytes) 2024-09-21T22:01:02.455 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.466 INFO:teuthology.orchestra.run.smithi102.stdout:326 trunc from 0xb3feb2b to 0x165087c 2024-09-21T22:01:02.480 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:02.479+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:02.489 INFO:teuthology.orchestra.run.smithi102.stdout:327 writesame 0xaf5f3f thru 0xafa9e9 data_size 0x1(0x4aab bytes) 2024-09-21T22:01:02.499 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:02.499 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:02.504 INFO:teuthology.orchestra.run.smithi102.stdout:328 write 0x2258001 thru 0x225bfd6 (0x3fd6 bytes) 2024-09-21T22:01:02.507 INFO:teuthology.orchestra.run.smithi102.stdout:329 read 0x2bff26 thru 0x2c0cc0 (0xd9b bytes) 2024-09-21T22:01:02.507 INFO:teuthology.orchestra.run.smithi102.stdout:330 read 0x73de8b thru 0x742ea6 (0x501c bytes) 2024-09-21T22:01:02.507 INFO:teuthology.orchestra.run.smithi102.stdout:331 read 0x20a384b thru 0x20b356a (0xfd20 bytes) 2024-09-21T22:01:02.508 INFO:teuthology.orchestra.run.smithi102.stdout:332 punch from 0x3d77c0 to 0x3e773b, (0xff7b bytes) 2024-09-21T22:01:02.509 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:02.523 INFO:teuthology.orchestra.run.smithi102.stdout:333 write 0x92ce38f thru 0x92d5b31 (0x77a3 bytes) 2024-09-21T22:01:02.533 INFO:teuthology.orchestra.run.smithi102.stdout:334 write 0x9999df6 thru 0x99a9de2 (0xffed bytes) 2024-09-21T22:01:02.534 INFO:teuthology.orchestra.run.smithi102.stdout:335 read 0x7949022 thru 0x7951511 (0x84f0 bytes) 2024-09-21T22:01:02.534 INFO:teuthology.orchestra.run.smithi102.stdout:337 read 0x6d06d0e thru 0x6d113e0 (0xa6d3 bytes) 2024-09-21T22:01:02.536 INFO:teuthology.orchestra.run.smithi102.stdout:338 trunc from 0x99a9de3 to 0x875579a 2024-09-21T22:01:02.544 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.549 INFO:teuthology.orchestra.run.smithi102.stdout:340 write 0x8b854eb thru 0x8b92ea2 (0xd9b8 bytes) 2024-09-21T22:01:02.551 INFO:teuthology.orchestra.run.smithi102.stdout:341 punch from 0x3eeadfc to 0x3eec1ac, (0x13b0 bytes) 2024-09-21T22:01:02.554 INFO:teuthology.orchestra.run.smithi102.stdout:342 trunc from 0x8b92ea3 to 0x60a1db3 2024-09-21T22:01:02.562 INFO:teuthology.orchestra.run.smithi102.stdout:343 read 0x2270564 thru 0x227b742 (0xb1df bytes) 2024-09-21T22:01:02.570 INFO:teuthology.orchestra.run.smithi102.stdout:344 write 0x70e0d74 thru 0x70e1394 (0x621 bytes) 2024-09-21T22:01:02.571 INFO:teuthology.orchestra.run.smithi102.stdout:345 read 0xe20829 thru 0xe219ab (0x1183 bytes) 2024-09-21T22:01:02.571 INFO:teuthology.orchestra.run.smithi102.stdout:348 punch from 0x58e61c0 to 0x58e87ea, (0x262a bytes) 2024-09-21T22:01:02.571 INFO:teuthology.orchestra.run.smithi102.stdout:349 punch from 0x2e9ccc2 to 0x2ea098f, (0x3ccd bytes) 2024-09-21T22:01:02.571 INFO:teuthology.orchestra.run.smithi102.stdout:350 write 0x6d9c230 thru 0x6da8999 (0xc76a bytes) 2024-09-21T22:01:02.581 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:02.579+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:02.583 INFO:teuthology.orchestra.run.smithi102.stdout:351 write 0xa14336e thru 0xa149281 (0x5f14 bytes) 2024-09-21T22:01:02.587 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.587 INFO:teuthology.orchestra.run.smithi102.stdout:354 punch from 0x159032e to 0x159828d, (0x7f5f bytes) 2024-09-21T22:01:02.587 INFO:teuthology.orchestra.run.smithi102.stdout:355 writesame 0xeac3e2 thru 0xeaf2f2 data_size 0x1(0x2f11 bytes) 2024-09-21T22:01:02.594 INFO:teuthology.orchestra.run.smithi102.stdout:356 trunc from 0xa149282 to 0xbf270a7 2024-09-21T22:01:02.599 INFO:teuthology.orchestra.run.smithi102.stdout:358 writesame 0x8353933 thru 0x835d455 data_size 0x41(0x9b23 bytes) 2024-09-21T22:01:02.601 INFO:teuthology.orchestra.run.smithi102.stdout:359 read 0xbe365ad thru 0xbe3ebd7 (0x862b bytes) 2024-09-21T22:01:02.601 INFO:teuthology.orchestra.run.smithi102.stdout:361 punch from 0x5830c50 to 0x58330d6, (0x2486 bytes) 2024-09-21T22:01:02.601 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.601 INFO:teuthology.orchestra.run.smithi102.stdout:366 punch from 0x12ed746 to 0x12fc6aa, (0xef64 bytes) 2024-09-21T22:01:02.601 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.601 INFO:teuthology.orchestra.run.smithi102.stdout:370 write 0x3223058 thru 0x3230ada (0xda83 bytes) 2024-09-21T22:01:02.603 INFO:teuthology.orchestra.run.smithi102.stdout:371 read 0x4def73b thru 0x4dfd00e (0xd8d4 bytes) 2024-09-21T22:01:02.603 INFO:teuthology.orchestra.run.smithi102.stdout:373 read 0x509b842 thru 0x50aacab (0xf46a bytes) 2024-09-21T22:01:02.604 INFO:teuthology.orchestra.run.smithi102.stdout:374 punch from 0x98a4245 to 0x98a639f, (0x215a bytes) 2024-09-21T22:01:02.604 INFO:teuthology.orchestra.run.smithi102.stdout:375 write 0x657c885 thru 0x658545b (0x8bd7 bytes) 2024-09-21T22:01:02.605 INFO:teuthology.orchestra.run.smithi102.stdout:376 punch from 0x6e1b950 to 0x6e292f5, (0xd9a5 bytes) 2024-09-21T22:01:02.607 INFO:teuthology.orchestra.run.smithi102.stdout:377 trunc from 0xbf270a7 to 0xd935b5d 2024-09-21T22:01:02.611 INFO:teuthology.orchestra.run.smithi102.stdout:379 read 0x453c074 thru 0x453fd40 (0x3ccd bytes) 2024-09-21T22:01:02.612 INFO:teuthology.orchestra.run.smithi102.stdout:380 write 0x3d783f6 thru 0x3d7b5a9 (0x31b4 bytes) 2024-09-21T22:01:02.613 INFO:teuthology.orchestra.run.smithi102.stdout:382 punch from 0x684bc17 to 0x68594ff, (0xd8e8 bytes) 2024-09-21T22:01:02.614 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.614 INFO:teuthology.orchestra.run.smithi102.stdout:386 writesame 0x20f051d thru 0x20f4d1c data_size 0x30(0x4800 bytes) 2024-09-21T22:01:02.621 INFO:teuthology.orchestra.run.smithi102.stdout:387 write 0xea8de67 thru 0xea9dd77 (0xff11 bytes) 2024-09-21T22:01:02.624 INFO:teuthology.orchestra.run.smithi102.stdout:388 write 0xd0b62f7 thru 0xd0b6c03 (0x90d bytes) 2024-09-21T22:01:02.628 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.628 INFO:teuthology.orchestra.run.smithi102.stdout:390 write 0xb4d47c9 thru 0xb4d50d3 (0x90b bytes) 2024-09-21T22:01:02.632 INFO:teuthology.orchestra.run.smithi102.stdout:391 punch from 0x34f32fd to 0x34ffe43, (0xcb46 bytes) 2024-09-21T22:01:02.632 INFO:teuthology.orchestra.run.smithi102.stdout:393 read 0xd20d3f1 thru 0xd21b772 (0xe382 bytes) 2024-09-21T22:01:02.632 INFO:teuthology.orchestra.run.smithi102.stdout:394 writesame 0x9cff2ab thru 0x9d0c26b data_size 0xb(0xcfc1 bytes) 2024-09-21T22:01:02.635 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:02.635 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:02.637 INFO:teuthology.orchestra.run.smithi102.stdout:395 read 0x6fa8830 thru 0x6fb861a (0xfdeb bytes) 2024-09-21T22:01:02.638 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.638 INFO:teuthology.orchestra.run.smithi102.stdout:398 punch from 0x220a168 to 0x2217af7, (0xd98f bytes) 2024-09-21T22:01:02.638 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.639 INFO:teuthology.orchestra.run.smithi102.stdout:401 trunc from 0xea9dd78 to 0xdb26ffb 2024-09-21T22:01:02.646 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:02.646 INFO:teuthology.orchestra.run.smithi102.stdout:402 write 0x719d38d thru 0x71aa2f9 (0xcf6d bytes) 2024-09-21T22:01:02.647 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:02.647 INFO:teuthology.orchestra.run.smithi102.stdout:404 punch from 0x2ba928 to 0x2c5347, (0xaa1f bytes) 2024-09-21T22:01:02.647 INFO:teuthology.orchestra.run.smithi102.stdout:405 read 0xac97186 thru 0xac991f2 (0x206d bytes) 2024-09-21T22:01:02.647 INFO:teuthology.orchestra.run.smithi102.stdout:406 write 0x73f9a98 thru 0x73fd951 (0x3eba bytes) 2024-09-21T22:01:02.656 INFO:teuthology.orchestra.run.smithi102.stdout:407 trunc from 0xdb26ffb to 0x6c7f114 2024-09-21T22:01:02.682 INFO:teuthology.orchestra.run.smithi102.stdout:409 trunc from 0x6c7f114 to 0xb15bc69 2024-09-21T22:01:02.683 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:02.681+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:02.687 INFO:teuthology.orchestra.run.smithi102.stdout:411 read 0x8687127 thru 0x868d1fb (0x60d5 bytes) 2024-09-21T22:01:02.687 INFO:teuthology.orchestra.run.smithi102.stdout:412 write 0x397ca32 thru 0x397f9f0 (0x2fbf bytes) 2024-09-21T22:01:02.691 INFO:teuthology.orchestra.run.smithi102.stdout:414 trunc from 0xb15bc69 to 0x92b6214 2024-09-21T22:01:02.707 INFO:teuthology.orchestra.run.smithi102.stdout:415 trunc from 0x92b6214 to 0x3e59906 2024-09-21T22:01:02.723 INFO:teuthology.orchestra.run.smithi102.stdout:418 read 0x12f4b0a thru 0x12fd648 (0x8b3f bytes) 2024-09-21T22:01:02.724 INFO:teuthology.orchestra.run.smithi102.stdout:419 write 0xe92061 thru 0xe9d61e (0xb5be bytes) 2024-09-21T22:01:02.729 INFO:teuthology.orchestra.run.smithi102.stdout:420 trunc from 0x3e59906 to 0x67f3d4d 2024-09-21T22:01:02.734 INFO:teuthology.orchestra.run.smithi102.stdout:421 read 0x243f116 thru 0x244b5a8 (0xc493 bytes) 2024-09-21T22:01:02.734 INFO:teuthology.orchestra.run.smithi102.stdout:422 writesame 0x5442249 thru 0x544c4cb data_size 0x1(0xa283 bytes) 2024-09-21T22:01:02.753 INFO:teuthology.orchestra.run.smithi102.stdout:423 trunc from 0x67f3d4d to 0x5ef4df9 2024-09-21T22:01:02.761 INFO:teuthology.orchestra.run.smithi102.stdout:424 read 0x31ab8e0 thru 0x31b111e (0x583f bytes) 2024-09-21T22:01:02.761 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:02.761 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:02.761 INFO:teuthology.orchestra.run.smithi102.stdout:427 write 0x52637e9 thru 0x526c45d (0x8c75 bytes) 2024-09-21T22:01:02.769 INFO:teuthology.orchestra.run.smithi102.stdout:428 write 0x6e68d0f thru 0x6e707bf (0x7ab1 bytes) 2024-09-21T22:01:02.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:02.783 INFO:teuthology.orchestra.run.smithi102.stdout:430 writesame 0xcef8c59 thru 0xcefef37 data_size 0x3(0x62df bytes) 2024-09-21T22:01:02.783 INFO:teuthology.orchestra.run.smithi102.stdout:432 clone 4 order 22 su 262144 sc 14 2024-09-21T22:01:02.784 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:02.781+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:02.884 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:02.882+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:02.885 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:02.885 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:02.894 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:02.985 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:02.983+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:02.997 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:02.997 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:03.006 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:03.086 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:03.084+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:03.109 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:03.109 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:03.118 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:03.187 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:03.186+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:03.270 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:03.270 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:03.271 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone3 from 0xcefef38 (overlap 0x15884d5) to 0x89cebb 2024-09-21T22:01:03.279 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:03.288 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:03.286+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:03.367 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-21T22:01:03.389 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:03.387+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:03.389 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:03.390 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:03.402 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:03.490 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:03.488+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:03.547 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:03.548 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:03.557 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:03.600 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:03.598+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:03.644 INFO:teuthology.orchestra.run.smithi102.stdout:433 write 0xdab1b2d thru 0xdab4ab0 (0x2f84 bytes) 2024-09-21T22:01:03.646 INFO:teuthology.orchestra.run.smithi102.stdout:434 read 0x4a71852 thru 0x4a76caf (0x545e bytes) 2024-09-21T22:01:03.657 INFO:teuthology.orchestra.run.smithi102.stdout:435 trunc from 0xdab4ab1 to 0x56d4e1c 2024-09-21T22:01:03.672 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:03.672 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:03.683 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:03.687 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:03.689 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:03.690 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:03.690 INFO:teuthology.orchestra.run.smithi102.stdout:440 punch from 0x339a41f to 0x33a01bd, (0x5d9e bytes) 2024-09-21T22:01:03.690 INFO:teuthology.orchestra.run.smithi102.stdout:442 read 0x129ff54 thru 0x12aaa48 (0xaaf5 bytes) 2024-09-21T22:01:03.692 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:03.690+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:03.702 INFO:teuthology.orchestra.run.smithi102.stdout:443 write 0x7010946 thru 0x70164fa (0x5bb5 bytes) 2024-09-21T22:01:03.705 INFO:teuthology.orchestra.run.smithi102.stdout:444 punch from 0x4dbd1f to 0x4de9b8, (0x2c99 bytes) 2024-09-21T22:01:03.709 INFO:teuthology.orchestra.run.smithi102.stdout:445 trunc from 0x70164fb to 0x36e0867 2024-09-21T22:01:03.739 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:03.740 INFO:teuthology.orchestra.run.smithi102.stdout:447 read 0x201e346 thru 0x201ef7d (0xc38 bytes) 2024-09-21T22:01:03.740 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:03.761 INFO:teuthology.orchestra.run.smithi102.stdout:451 writesame 0xe754bdd thru 0xe75ab7a data_size 0x1(0x5f9e bytes) 2024-09-21T22:01:03.768 INFO:teuthology.orchestra.run.smithi102.stdout:453 trunc from 0xe75ab7b to 0x83864df 2024-09-21T22:01:03.781 INFO:teuthology.orchestra.run.smithi102.stdout:454 writesame 0x96b16d1 thru 0x96b1818 data_size 0x4(0x148 bytes) 2024-09-21T22:01:03.781 INFO:teuthology.orchestra.run.smithi102.stdout:455 punch from 0x79f4c44 to 0x79fa1bd, (0x5579 bytes) 2024-09-21T22:01:03.781 INFO:teuthology.orchestra.run.smithi102.stdout:457 read 0x35b6041 thru 0x35bc187 (0x6147 bytes) 2024-09-21T22:01:03.788 INFO:teuthology.orchestra.run.smithi102.stdout:459 write 0xa74e036 thru 0xa758bfc (0xabc7 bytes) 2024-09-21T22:01:03.791 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:03.791 INFO:teuthology.orchestra.run.smithi102.stdout:462 write 0x11acc9f thru 0x11b53d2 (0x8734 bytes) 2024-09-21T22:01:03.793 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:03.791+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:03.796 INFO:teuthology.orchestra.run.smithi102.stdout:463 read 0x78e6697 thru 0x78e9cef (0x3659 bytes) 2024-09-21T22:01:03.803 INFO:teuthology.orchestra.run.smithi102.stdout:464 write 0xc1cb6a4 thru 0xc1d6439 (0xad96 bytes) 2024-09-21T22:01:03.813 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:03.813 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:03.820 INFO:teuthology.orchestra.run.smithi102.stdout:465 trunc from 0xc1d643a to 0x122b480 2024-09-21T22:01:03.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:03.839 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:03.850 INFO:teuthology.orchestra.run.smithi102.stdout:466 write 0x3013864 thru 0x3019e9b (0x6638 bytes) 2024-09-21T22:01:03.861 INFO:teuthology.orchestra.run.smithi102.stdout:467 write 0x576674e thru 0x5769959 (0x320c bytes) 2024-09-21T22:01:03.862 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:03.864 INFO:teuthology.orchestra.run.smithi102.stdout:468 punch from 0x2006c28 to 0x200ae3e, (0x4216 bytes) 2024-09-21T22:01:03.864 INFO:teuthology.orchestra.run.smithi102.stdout:470 write 0x3ce186d thru 0x3ce8bd7 (0x736b bytes) 2024-09-21T22:01:03.867 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:03.867 INFO:teuthology.orchestra.run.smithi102.stdout:474 writesame 0x2ebe07 thru 0x2f7cff data_size 0x1(0xbef9 bytes) 2024-09-21T22:01:03.878 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:03.890 INFO:teuthology.orchestra.run.smithi102.stdout:475 read 0x3917cd5 thru 0x3923598 (0xb8c4 bytes) 2024-09-21T22:01:03.890 INFO:teuthology.orchestra.run.smithi102.stdout:476 write 0x15f6b64 thru 0x15fa541 (0x39de bytes) 2024-09-21T22:01:03.891 INFO:teuthology.orchestra.run.smithi102.stdout:477 punch from 0x2f67d8b to 0x2f72816, (0xaa8b bytes) 2024-09-21T22:01:03.893 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:03.892+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:03.895 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:03.895 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:03.901 INFO:teuthology.orchestra.run.smithi102.stdout:478 write 0x8fe465f thru 0x8feb79e (0x7140 bytes) 2024-09-21T22:01:03.904 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:03.904 INFO:teuthology.orchestra.run.smithi102.stdout:483 read 0xd8367f thru 0xd8b342 (0x7cc4 bytes) 2024-09-21T22:01:03.909 INFO:teuthology.orchestra.run.smithi102.stdout:485 trunc from 0x8feb79f to 0xc5d564e 2024-09-21T22:01:03.914 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:03.914 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:03.927 INFO:teuthology.orchestra.run.smithi102.stdout:486 trunc from 0xc5d564e to 0x2423de0 2024-09-21T22:01:03.932 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:03.932 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:03.943 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:03.944 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:03.944 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:03.944 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:03.944 INFO:teuthology.orchestra.run.smithi102.stdout:487 writesame 0x338728 thru 0x344c39 data_size 0x19(0xc512 bytes) 2024-09-21T22:01:03.947 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:03.948 INFO:teuthology.orchestra.run.smithi102.stdout:490 trunc from 0x2423de0 to 0xe4be07 2024-09-21T22:01:03.953 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:03.956 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:03.974 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:03.974 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:03.980 INFO:teuthology.orchestra.run.smithi102.stdout:492 write 0xc91155b thru 0xc919160 (0x7c06 bytes) 2024-09-21T22:01:03.985 INFO:teuthology.orchestra.run.smithi102.stdout:494 read 0x89068a8 thru 0x8915d80 (0xf4d9 bytes) 2024-09-21T22:01:03.985 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:03.986 INFO:teuthology.orchestra.run.smithi102.stdout:497 write 0x33a5eee thru 0x33ad19b (0x72ae bytes) 2024-09-21T22:01:03.986 INFO:teuthology.orchestra.run.smithi102.stdout:498 read 0xaac05c4 thru 0xaac7889 (0x72c6 bytes) 2024-09-21T22:01:03.986 INFO:teuthology.orchestra.run.smithi102.stdout:500 read 0x9509536 thru 0x9511774 (0x823f bytes) 2024-09-21T22:01:03.987 INFO:teuthology.orchestra.run.smithi102.stdout:501 read 0x1b645c3 thru 0x1b658f9 (0x1337 bytes) 2024-09-21T22:01:03.987 INFO:teuthology.orchestra.run.smithi102.stdout:503 read 0x6c08ddc thru 0x6c12764 (0x9989 bytes) 2024-09-21T22:01:03.989 INFO:teuthology.orchestra.run.smithi102.stdout:505 trunc from 0xc919161 to 0xe33145a 2024-09-21T22:01:03.995 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:03.993+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:03.995 INFO:teuthology.orchestra.run.smithi102.stdout:506 write 0xb58b69a thru 0xb591da6 (0x670d bytes) 2024-09-21T22:01:03.998 INFO:teuthology.orchestra.run.smithi102.stdout:507 write 0x5a21e55 thru 0x5a29d68 (0x7f14 bytes) 2024-09-21T22:01:04.002 INFO:teuthology.orchestra.run.smithi102.stdout:508 write 0xd8e8a0e thru 0xd8f71af (0xe7a2 bytes) 2024-09-21T22:01:04.006 INFO:teuthology.orchestra.run.smithi102.stdout:510 trunc from 0xe33145a to 0xd24de44 2024-09-21T22:01:04.019 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:04.019 INFO:teuthology.orchestra.run.smithi102.stdout:512 read 0x264ba4f thru 0x2653efa (0x84ac bytes) 2024-09-21T22:01:04.019 INFO:teuthology.orchestra.run.smithi102.stdout:513 punch from 0x42e06af to 0x42e118b, (0xadc bytes) 2024-09-21T22:01:04.027 INFO:teuthology.orchestra.run.smithi102.stdout:514 writesame 0xeb5e2c0 thru 0xeb609a0 data_size 0x1(0x26e1 bytes) 2024-09-21T22:01:04.027 INFO:teuthology.orchestra.run.smithi102.stdout:515 punch from 0x9da6dcf to 0x9dae5e4, (0x7815 bytes) 2024-09-21T22:01:04.027 INFO:teuthology.orchestra.run.smithi102.stdout:517 write 0x66d80b1 thru 0x66df866 (0x77b6 bytes) 2024-09-21T22:01:04.030 INFO:teuthology.orchestra.run.smithi102.stdout:518 read 0xd2134d8 thru 0xd220b6e (0xd697 bytes) 2024-09-21T22:01:04.030 INFO:teuthology.orchestra.run.smithi102.stdout:519 writesame 0x9ffd8ba thru 0xa0000fc data_size 0x1(0x2843 bytes) 2024-09-21T22:01:04.036 INFO:teuthology.orchestra.run.smithi102.stdout:520 read 0x7d01aa3 thru 0x7d0ce29 (0xb387 bytes) 2024-09-21T22:01:04.036 INFO:teuthology.orchestra.run.smithi102.stdout:521 write 0xc3ac550 thru 0xc3ace0b (0x8bc bytes) 2024-09-21T22:01:04.041 INFO:teuthology.orchestra.run.smithi102.stdout:522 trunc from 0xeb609a1 to 0xc2243e4 2024-09-21T22:01:04.052 INFO:teuthology.orchestra.run.smithi102.stdout:523 writesame 0x36a2839 thru 0x36af543 data_size 0x1(0xcd0b bytes) 2024-09-21T22:01:04.089 INFO:teuthology.orchestra.run.smithi102.stdout:524 write 0xd53ec2b thru 0xd544a70 (0x5e46 bytes) 2024-09-21T22:01:04.093 INFO:teuthology.orchestra.run.smithi102.stdout:526 write 0x49e6528 thru 0x49ee476 (0x7f4f bytes) 2024-09-21T22:01:04.095 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:04.093+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:04.099 INFO:teuthology.orchestra.run.smithi102.stdout:527 writesame 0x9aca744 thru 0x9ad0e3f data_size 0x27(0x66fc bytes) 2024-09-21T22:01:04.102 INFO:teuthology.orchestra.run.smithi102.stdout:528 read 0x516f19 thru 0x51af0c (0x3ff4 bytes) 2024-09-21T22:01:04.102 INFO:teuthology.orchestra.run.smithi102.stdout:529 write 0x1744605 thru 0x174a2d5 (0x5cd1 bytes) 2024-09-21T22:01:04.105 INFO:teuthology.orchestra.run.smithi102.stdout:533 writesame 0xcdfb794 thru 0xcdfe231 data_size 0x5(0x2a9e bytes) 2024-09-21T22:01:04.108 INFO:teuthology.orchestra.run.smithi102.stdout:534 writesame 0xadcd21d thru 0xadcf2c7 data_size 0x1(0x20ab bytes) 2024-09-21T22:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:04.113 INFO:teuthology.orchestra.run.smithi102.stdout:535 clone 5 order 25 su 16777216 sc 10 2024-09-21T22:01:04.122 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:04.196 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:04.194+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:04.211 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:01:04.230 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:55.158298+0000", 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0700856909999992, 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.006175392, 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158298+0000", 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158298+0000", 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158300+0000", 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3829999999999999e-06 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158312+0000", 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1457999999999999e-05 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158331+0000", 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9312000000000001e-05 2024-09-21T22:01:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158341+0000", 2024-09-21T22:01:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4259999999999992e-06 2024-09-21T22:01:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158402+0000", 2024-09-21T22:01:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1525000000000005e-05 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.158406+0000", 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2660000000000003e-06 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.163120+0000", 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047132149999999998 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.163238+0000", 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000118718 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.163393+0000", 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015510099999999999 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164050+0000", 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00065685899999999998 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164415+0000", 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000364939 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164448+0000", 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2580000000000003e-05 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:55.164473+0000", 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.561e-05 2024-09-21T22:01:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.159333+0000", 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 8.0690511350000005, 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010895462, 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 9 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159333+0000", 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159333+0000", 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159335+0000", 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9920000000000002e-06 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159346+0000", 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1182999999999999e-05 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159364+0000", 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8357000000000001e-05 2024-09-21T22:01:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159375+0000", 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0815999999999999e-05 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159436+0000", 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1508999999999997e-05 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.159441+0000", 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.335e-06 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.165543+0000", 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0061017689999999999 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.165605+0000", 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2496999999999995e-05 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.165712+0000", 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010731899999999999 2024-09-21T22:01:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.167182+0000", 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0014701250000000001 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170163+0000", 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0029803249999999998 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170200+0000", 2024-09-21T22:01:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6900000000000002e-05 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170228+0000", 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8334999999999999e-05 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.0166298610000002, 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:01:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:01:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:572 3.11 e29/23 3:8e92e4d9:::rbd_data.1124354cd08a.000000000000000f:head v 29'3, mlcod=0'0)", 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.660249+0000", 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.5681344099999999, 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0060317460000000002, 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660249+0000", 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660249+0000", 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660250+0000", 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660255+0000", 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7139999999999998e-06 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660263+0000", 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.328e-06 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660284+0000", 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0927000000000001e-05 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660347+0000", 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3079999999999999e-05 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660370+0000", 2024-09-21T22:01:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3719000000000001e-05 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666229+0000", 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0058580969999999996 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666281+0000", 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2491000000000003e-05 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:573 3.1 e29/23 3:844f91b9:::rbd_data.1124354cd08a.0000000000000010:head v 29'3, mlcod=0'0)", 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.660356+0000", 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.5680274600000002, 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0054729640000000003, 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660356+0000", 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660356+0000", 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660357+0000", 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6000000000000004e-07 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660362+0000", 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3159999999999996e-06 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660371+0000", 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5040000000000002e-06 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660377+0000", 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9159999999999998e-06 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660417+0000", 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0244999999999998e-05 2024-09-21T22:01:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660436+0000", 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9082000000000001e-05 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665784+0000", 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0053480740000000004 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665829+0000", 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5266999999999999e-05 2024-09-21T22:01:04.257 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:589 3.9 3:907d2e6d:::rbd_object_map.1124354cd08a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.672074+0000", 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.5563101690000001, 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0053695390000000004, 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.258 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 589 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672074+0000", 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672074+0000", 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672074+0000", 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.34e-07 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672076+0000", 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2259999999999999e-06 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672081+0000", 2024-09-21T22:01:04.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0549999999999999e-06 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672085+0000", 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2660000000000002e-06 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673981+0000", 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001896797 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.674060+0000", 2024-09-21T22:01:04.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8817000000000001e-05 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.674258+0000", 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00019800699999999999 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.675514+0000", 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001255606 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.677342+0000", 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018282629999999999 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.677397+0000", 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4920000000000003e-05 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.677443+0000", 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6147999999999999e-05 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.263 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:591 3.9 3:907d2e6d:::rbd_object_map.1124354cd08a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.672396+0000", 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.5559872810000002, 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0058609839999999996, 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 591 2024-09-21T22:01:04.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672396+0000", 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672396+0000", 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672397+0000", 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4000000000000001e-07 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672401+0000", 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1969999999999998e-06 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672410+0000", 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1929999999999993e-06 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672415+0000", 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6550000000000001e-06 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.675564+0000", 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031485160000000001 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.675654+0000", 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0526999999999996e-05 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.675994+0000", 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00033965800000000001 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678140+0000", 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00214621 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678155+0000", 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4962e-05 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678209+0000", 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3705999999999997e-05 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678257+0000", 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8619999999999999e-05 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:592 3.9 3:907d2e6d:::rbd_object_map.1124354cd08a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.672574+0000", 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.5558097589999997, 2024-09-21T22:01:04.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0064571400000000001, 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 592 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672574+0000", 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672574+0000", 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672575+0000", 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.51e-07 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672584+0000", 2024-09-21T22:01:04.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.645e-06 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672592+0000", 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7870000000000002e-06 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672598+0000", 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6999999999999996e-06 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676454+0000", 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0038561350000000001 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676513+0000", 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8921000000000001e-05 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.676903+0000", 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00039066900000000001 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678310+0000", 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001407033 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678939+0000", 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00062898100000000003 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678993+0000", 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3869000000000002e-05 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.679031+0000", 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7849000000000003e-05 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:593 3.9 3:907d2e6d:::rbd_object_map.1124354cd08a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.672725+0000", 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.5556586860000001, 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087676119999999993, 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.275 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 593 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672725+0000", 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672725+0000", 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672726+0000", 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7000000000000005e-07 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672729+0000", 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2160000000000002e-06 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672736+0000", 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0299999999999996e-06 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672747+0000", 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1327e-05 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.677571+0000", 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0048242789999999999 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.677650+0000", 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8221999999999997e-05 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.677866+0000", 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000215835 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.679074+0000", 2024-09-21T22:01:04.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0012089379999999999 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.681390+0000", 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0023151370000000001 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.681446+0000", 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6662000000000001e-05 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.681493+0000", 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6396000000000001e-05 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:594 3.9 3:907d2e6d:::rbd_object_map.1124354cd08a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.672762+0000", 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.5556221409999997, 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095318869999999993, 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.281 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 594 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672762+0000", 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672762+0000", 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672762+0000", 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672765+0000", 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6800000000000002e-06 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672772+0000", 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4309999999999997e-06 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672777+0000", 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4739999999999999e-06 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678333+0000", 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0055560649999999998 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678388+0000", 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5148000000000001e-05 2024-09-21T22:01:04.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.678702+0000", 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00031442699999999999 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.681535+0000", 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028331179999999999 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682177+0000", 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00064167599999999999 2024-09-21T22:01:04.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682233+0000", 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5575000000000002e-05 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682293+0000", 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0869000000000003e-05 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.286 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:595 3.9 3:907d2e6d:::rbd_object_map.1124354cd08a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.672784+0000", 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.555599247, 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096186190000000001, 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 595 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.287 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672784+0000", 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672784+0000", 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672785+0000", 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0400000000000002e-07 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672787+0000", 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1909999999999999e-06 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672793+0000", 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.682e-06 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672798+0000", 2024-09-21T22:01:04.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1279999999999999e-06 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.679118+0000", 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0063207209999999996 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.679198+0000", 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9505999999999994e-05 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.679575+0000", 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000376766 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.681594+0000", 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.002019608 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682303+0000", 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00070912199999999996 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682351+0000", 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7456000000000001e-05 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682403+0000", 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2135000000000001e-05 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.292 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:596 3.9 3:907d2e6d:::rbd_object_map.1124354cd08a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.672950+0000", 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.5554340849999999, 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095565419999999995, 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 596 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672950+0000", 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672950+0000", 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672950+0000", 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6199999999999997e-07 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672954+0000", 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4910000000000001e-06 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672961+0000", 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8469999999999998e-06 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.672965+0000", 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8509999999999998e-06 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.679954+0000", 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.006988368 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.680006+0000", 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2435999999999997e-05 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.680246+0000", 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00023992999999999999 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.681621+0000", 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001374873 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682412+0000", 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00079093200000000005 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682458+0000", 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6417e-05 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682506+0000", 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7735000000000003e-05 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:597 3.9 3:907d2e6d:::rbd_object_map.1124354cd08a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.673102+0000", 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.5552814970000002, 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010181755000000001, 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.298 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 597 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673102+0000", 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673102+0000", 2024-09-21T22:01:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673103+0000", 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7800000000000001e-07 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673106+0000", 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2559999999999998e-06 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673124+0000", 2024-09-21T22:01:04.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8377e-05 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673130+0000", 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.366e-06 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.680563+0000", 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0074332139999999996 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.680652+0000", 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9142999999999997e-05 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.681020+0000", 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00036830800000000003 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682156+0000", 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011358640000000001 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683206+0000", 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0010501320000000001 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683240+0000", 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3728e-05 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683284+0000", 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3788999999999997e-05 2024-09-21T22:01:04.303 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:598 3.9 3:907d2e6d:::rbd_object_map.1124354cd08a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.673267+0000", 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.555117171, 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010117068, 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.304 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 598 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673267+0000", 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673267+0000", 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673267+0000", 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6199999999999997e-07 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673271+0000", 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6660000000000001e-06 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673284+0000", 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3383999999999999e-05 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673289+0000", 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.826e-06 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.681647+0000", 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.008357883 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.681700+0000", 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2571999999999997e-05 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.681900+0000", 2024-09-21T22:01:04.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00020016500000000001 2024-09-21T22:01:04.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683293+0000", 2024-09-21T22:01:04.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001393579 2024-09-21T22:01:04.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683329+0000", 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5453000000000001e-05 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683359+0000", 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0088000000000001e-05 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683384+0000", 2024-09-21T22:01:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4790000000000002e-05 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:599 3.9 3:907d2e6d:::rbd_object_map.1124354cd08a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.673425+0000", 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.5549585810000002, 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010553760000000001, 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.311 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 599 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673425+0000", 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673425+0000", 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673426+0000", 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0699999999999996e-07 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673431+0000", 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0289999999999996e-06 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673439+0000", 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3159999999999997e-06 2024-09-21T22:01:04.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.673445+0000", 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8889999999999999e-06 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682534+0000", 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0090888510000000002 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682580+0000", 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6295000000000003e-05 2024-09-21T22:01:04.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.682889+0000", 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030914099999999997 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683812+0000", 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00092254100000000003 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683915+0000", 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103006 2024-09-21T22:01:04.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683944+0000", 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9150999999999999e-05 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.683979+0000", 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4833999999999999e-05 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.316 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:2095 3.f e30/23 3:f1bf288a:::rbd_object_map.1124ebe77597:head v 30'13, mlcod=30'7)", 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.498058+0000", 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 2.730325814, 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0082536239999999993, 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498058+0000", 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498058+0000", 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498059+0000", 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9999999999999997e-07 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498064+0000", 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9230000000000001e-06 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498073+0000", 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3719999999999994e-06 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498078+0000", 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.69e-06 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498123+0000", 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5500000000000001e-05 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498136+0000", 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2658e-05 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506260+0000", 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081243930000000006 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506312+0000", 2024-09-21T22:01:04.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1388000000000003e-05 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:2096 3.f e30/23 3:f1bf288a:::rbd_object_map.1124ebe77597:head v 30'14, mlcod=30'7)", 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.498781+0000", 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 2.7296031570000001, 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0075618990000000004, 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498781+0000", 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498781+0000", 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498781+0000", 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3200000000000005e-07 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498786+0000", 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498794+0000", 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9179999999999994e-06 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498799+0000", 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8629999999999999e-06 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498839+0000", 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0638e-05 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498851+0000", 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1457999999999999e-05 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506314+0000", 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0074631250000000001 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506342+0000", 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8643e-05 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:2097 3.f e30/23 3:f408e78a:::rbd_data.1124ebe77597.0000000000000000:head v 30'15, mlcod=30'7)", 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.499387+0000", 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 2.728996934, 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0069876740000000001, 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499387+0000", 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499387+0000", 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499387+0000", 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.37e-07 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499392+0000", 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9729999999999997e-06 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499402+0000", 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1200000000000008e-06 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499408+0000", 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2349999999999996e-06 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499450+0000", 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2605000000000003e-05 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499471+0000", 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.022e-05 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506345+0000", 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0068744160000000004 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506374+0000", 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9468e-05 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:2098 3.f e30/23 3:f7e44f71:::rbd_data.1124ebe77597.0000000000000002:head v 30'16, mlcod=30'8)", 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.500197+0000", 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 2.7281864090000001, 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0062127399999999996, 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.329 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500197+0000", 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500197+0000", 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500198+0000", 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5799999999999998e-07 2024-09-21T22:01:04.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500204+0000", 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8900000000000004e-06 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500213+0000", 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3810000000000005e-06 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500218+0000", 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6410000000000001e-06 2024-09-21T22:01:04.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500260+0000", 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1847000000000001e-05 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500283+0000", 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2915999999999999e-05 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506376+0000", 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0060934589999999999 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506410+0000", 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3847999999999998e-05 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:2099 3.f e30/23 3:f1bf288a:::rbd_object_map.1124ebe77597:head v 30'17, mlcod=30'8)", 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.500996+0000", 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 2.7273881759999998, 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00571537, 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.333 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500996+0000", 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500996+0000", 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.500996+0000", 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.569999999999999e-07 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.501002+0000", 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8000000000000004e-06 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.501016+0000", 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4070000000000001e-05 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.501023+0000", 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0350000000000004e-06 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.501083+0000", 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9477e-05 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.501101+0000", 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8550999999999999e-05 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506669+0000", 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.005567921 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506711+0000", 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1559e-05 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.337 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:04.337 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:01:04.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T22:01:04.339 INFO:teuthology.orchestra.run.smithi102.stdout:flattening image image_client.0-clone4 2024-09-21T22:01:04.339 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:04.337+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:04.340 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:04.440 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:04.438+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:04.446 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:04.446 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:04.446 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:04.446 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:04.455 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:04.456 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-21T22:01:04.480 INFO:teuthology.orchestra.run.smithi102.stdout:536 clone 6 order 22 su 131072 sc 12 2024-09-21T22:01:04.541 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:04.539+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:04.599 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:04.599 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:04.599 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:04.599 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:04.599 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:04.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:04.650 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:04.648+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:04.710 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:01:04.711 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T22:01:04.727 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T22:01:04.760 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4223.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-21T22:01:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:44.107455+0000", 2024-09-21T22:01:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.650191513999999, 2024-09-21T22:01:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0083702059999999998, 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4223", 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/1556248237", 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107455+0000", 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107455+0000", 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107459+0000", 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5710000000000002e-06 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107465+0000", 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3999999999999997e-06 2024-09-21T22:01:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107476+0000", 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0659000000000001e-05 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107487+0000", 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0885e-05 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107552+0000", 2024-09-21T22:01:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4856000000000004e-05 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.107560+0000", 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6819999999999992e-06 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.110716+0000", 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031552360000000001 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.110868+0000", 2024-09-21T22:01:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015241199999999999 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.111016+0000", 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00014772299999999999 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.114858+0000", 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0038420279999999999 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.115761+0000", 2024-09-21T22:01:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00090352399999999995 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.115795+0000", 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3877000000000001e-05 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:44.115825+0000", 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0352999999999999e-05 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:10 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.170968+0000", 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 8.5866788669999998, 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.007423781, 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 10 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170968+0000", 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170968+0000", 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170969+0000", 2024-09-21T22:01:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.432e-06 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170982+0000", 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2962000000000001e-05 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170990+0000", 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6580000000000002e-06 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.170998+0000", 2024-09-21T22:01:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0239999999999997e-06 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.171057+0000", 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9273e-05 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.171061+0000", 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.929e-06 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.172632+0000", 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001570744 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.172744+0000", 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112328 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.172900+0000", 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015537799999999999 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.178040+0000", 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0051403530000000003 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.178269+0000", 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000229445 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.178344+0000", 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4066999999999994e-05 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.178392+0000", 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8188e-05 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:571 3.16 3:6efed54a:::rbd_data.1124354cd08a.000000000000000e:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.659315+0000", 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.098331612, 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0072942529999999997, 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 571 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659315+0000", 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659315+0000", 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659317+0000", 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.621e-06 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659321+0000", 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2200000000000003e-06 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659333+0000", 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1501000000000001e-05 2024-09-21T22:01:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659338+0000", 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7509999999999997e-06 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659404+0000", 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6019000000000006e-05 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659483+0000", 2024-09-21T22:01:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8543999999999999e-05 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659675+0000", 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000191862 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661341+0000", 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016665580000000001 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666513+0000", 2024-09-21T22:01:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0051719000000000001 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666565+0000", 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1583999999999999e-05 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666609+0000", 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4693000000000001e-05 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:575 3.c 3:3722f66b:::rbd_data.1124354cd08a.0000000000000012:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.659358+0000", 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0982888930000003, 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0066120379999999998, 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 575 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659358+0000", 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659358+0000", 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659358+0000", 2024-09-21T22:01:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5299999999999999e-07 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659361+0000", 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.649e-06 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659367+0000", 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3489999999999997e-06 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659372+0000", 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7609999999999998e-06 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659425+0000", 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2546999999999997e-05 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659506+0000", 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1261999999999995e-05 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659685+0000", 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00017929400000000001 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661431+0000", 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001746095 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665873+0000", 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0044420179999999998 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665924+0000", 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1038999999999997e-05 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.665970+0000", 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5571000000000001e-05 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:576 3.16 3:6c9d92e4:::rbd_data.1124354cd08a.0000000000000013:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.659387+0000", 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0982601130000003, 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.007532548, 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 576 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659387+0000", 2024-09-21T22:01:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659387+0000", 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659387+0000", 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2899999999999999e-07 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659390+0000", 2024-09-21T22:01:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5749999999999999e-06 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659396+0000", 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.494e-06 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.659401+0000", 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660246+0000", 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00084501300000000004 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660335+0000", 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8893000000000004e-05 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660514+0000", 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00017934400000000001 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666642+0000", 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0061280199999999996 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666825+0000", 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018291600000000001 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666869+0000", 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4388999999999998e-05 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666919+0000", 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9762999999999998e-05 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:574 3.10 e29/28 3:0ab619e6:::rbd_data.1124354cd08a.0000000000000011:head v 29'3, mlcod=0'0)", 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.660006+0000", 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0976405329999999, 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0068589649999999999, 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660006+0000", 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660006+0000", 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660007+0000", 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7700000000000003e-07 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660014+0000", 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4760000000000003e-06 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660050+0000", 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6319000000000002e-05 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660068+0000", 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8289000000000001e-05 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660133+0000", 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4863000000000006e-05 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.660157+0000", 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4233e-05 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666836+0000", 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0066788350000000002 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.666865+0000", 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9073000000000001e-05 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:582 3.16 3:6dae6730:::rbd_data.1124354cd08a.0000000000000019:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T22:01:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:00.661419+0000", 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0962282380000001, 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00728672, 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 582 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661419+0000", 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661419+0000", 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661422+0000", 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7440000000000001e-06 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661428+0000", 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2560000000000002e-06 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661438+0000", 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0634e-05 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661446+0000", 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4420000000000001e-06 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661480+0000", 2024-09-21T22:01:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4722999999999999e-05 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661528+0000", 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8068999999999997e-05 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.661635+0000", 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010618799999999999 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.668526+0000", 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.006891777 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.668650+0000", 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012390599999999999 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.668680+0000", 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9980000000000001e-05 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.668705+0000", 2024-09-21T22:01:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5001e-05 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2053 3.16 3:6c9d92e4:::rbd_data.1124354cd08a.0000000000000013:4 [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.475993+0000", 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.281653913, 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0066676590000000003, 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2053 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.475993+0000", 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.475993+0000", 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.475993+0000", 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.46e-07 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.475995+0000", 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9300000000000002e-06 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476001+0000", 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476005+0000", 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5449999999999997e-06 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482565+0000", 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0065592810000000001 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482609+0000", 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4477000000000001e-05 2024-09-21T22:01:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482661+0000", 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1480999999999997e-05 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2059 3.16 3:6dae6730:::rbd_data.1124354cd08a.0000000000000019:4 [read 720896~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.476036+0000", 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.2816107360000002, 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.006736138, 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2059 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476036+0000", 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476036+0000", 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476036+0000", 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476039+0000", 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1280000000000002e-06 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476045+0000", 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9499999999999998e-06 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476049+0000", 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5349999999999998e-06 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482677+0000", 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0066277369999999999 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482720+0000", 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3169e-05 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482772+0000", 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2240000000000001e-05 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2062 3.16 3:6efed54a:::rbd_data.1124354cd08a.000000000000000e:4 [read 753664~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.476055+0000", 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.2815919760000001, 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0068641179999999998, 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2062 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476055+0000", 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476055+0000", 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476055+0000", 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476057+0000", 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9690000000000001e-06 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476063+0000", 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5310000000000001e-06 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476067+0000", 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.267e-06 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482804+0000", 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0067370190000000003 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482857+0000", 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3013000000000002e-05 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482919+0000", 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1877000000000004e-05 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2067 3.16 3:6c9d92e4:::rbd_data.1124354cd08a.0000000000000013:4 [read 753664~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.476089+0000", 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.2815574280000002, 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0069486970000000002, 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2067 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.813 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476089+0000", 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476089+0000", 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476090+0000", 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476092+0000", 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2529999999999999e-06 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476098+0000", 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1109999999999996e-06 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476103+0000", 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5889999999999996e-06 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482942+0000", 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00683952 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.482985+0000", 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3216000000000001e-05 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483038+0000", 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2648999999999997e-05 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2073 3.16 3:6dae6730:::rbd_data.1124354cd08a.0000000000000019:4 [read 737280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.476132+0000", 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.281514611, 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0070307069999999998, 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.817 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2073 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476132+0000", 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476132+0000", 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476133+0000", 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476135+0000", 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.891e-06 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476140+0000", 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4840000000000003e-06 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476144+0000", 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3239999999999996e-06 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483059+0000", 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0069144339999999997 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483105+0000", 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6041999999999997e-05 2024-09-21T22:01:04.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483163+0000", 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8031000000000001e-05 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2076 3.16 3:6efed54a:::rbd_data.1124354cd08a.000000000000000e:4 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.476150+0000", 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.281497141, 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0071425450000000001, 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.821 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2076 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476150+0000", 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476150+0000", 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476150+0000", 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.15e-07 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476152+0000", 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8109999999999999e-06 2024-09-21T22:01:04.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476157+0000", 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.446e-06 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476162+0000", 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.42e-06 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483187+0000", 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0070250950000000003 2024-09-21T22:01:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483230+0000", 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3652999999999997e-05 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483292+0000", 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1804999999999995e-05 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.825 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2081 3.16 3:6c9d92e4:::rbd_data.1124354cd08a.0000000000000013:4 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.476190+0000", 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.2814571589999999, 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0072240339999999998, 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2081 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476190+0000", 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476190+0000", 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476190+0000", 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6199999999999998e-07 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476192+0000", 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9199999999999998e-06 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476198+0000", 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4750000000000001e-06 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476202+0000", 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3030000000000001e-06 2024-09-21T22:01:04.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483314+0000", 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0071122240000000003 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483359+0000", 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5272000000000003e-05 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483414+0000", 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4277999999999998e-05 2024-09-21T22:01:04.829 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2087 3.16 3:6dae6730:::rbd_data.1124354cd08a.0000000000000019:4 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.476231+0000", 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.2814155380000001, 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0072915109999999997, 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.830 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2087 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476231+0000", 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476231+0000", 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476232+0000", 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476234+0000", 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0030000000000001e-06 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476239+0000", 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.587e-06 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.476244+0000", 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5600000000000004e-06 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483428+0000", 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0071838229999999998 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483471+0000", 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3207000000000002e-05 2024-09-21T22:01:04.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.483523+0000", 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1792000000000002e-05 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2104 3.16 3:695fac6f:::rbd_data.1124ebe77597.0000000000000008:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.507307+0000", 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.250340284, 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0080482569999999996, 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.834 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2104 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.507307+0000", 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.507307+0000", 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.507308+0000", 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2869999999999999e-06 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.510115+0000", 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.002807159 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.510129+0000", 2024-09-21T22:01:04.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3949e-05 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.510137+0000", 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7270000000000007e-06 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.510193+0000", 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6780999999999997e-05 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.510315+0000", 2024-09-21T22:01:04.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000121758 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.510470+0000", 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015469400000000001 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.514420+0000", 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0039504759999999996 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.515281+0000", 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00086037799999999997 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.515317+0000", 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6545000000000003e-05 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.515355+0000", 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7503000000000003e-05 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5736 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:03.948448+0000", 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.80919919699999998, 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0067845800000000001, 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5736 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.948448+0000", 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.948448+0000", 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.948449+0000", 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0669999999999999e-06 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.948454+0000", 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6370000000000004e-06 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.948466+0000", 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1739000000000001e-05 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.948474+0000", 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.695e-06 2024-09-21T22:01:04.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.948540+0000", 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6107999999999998e-05 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.948628+0000", 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8596000000000004e-05 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.949536+0000", 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00090794699999999999 2024-09-21T22:01:04.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.950957+0000", 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001420122 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.955160+0000", 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0042034860000000002 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.955205+0000", 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5380999999999998e-05 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:03.955232+0000", 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6801999999999999e-05 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.70575860499999998, 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.845 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:01:04.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:01:04.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.850 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop_reply(client.4388.0:5821 3.c e32/23 ondisk, result = 0)", 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.069900+0000", 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.687746788, 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010977045, 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.069900+0000", 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.069900+0000", 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.069901+0000", 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4169999999999999e-06 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.069908+0000", 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3670000000000002e-06 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.069923+0000", 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4922999999999999e-05 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.069949+0000", 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6129e-05 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080777+0000", 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010827695 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080784+0000", 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5499999999999997e-06 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080877+0000", 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2964e-05 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5846 3.5 3:a3645b25:::rbd_header.11241aed97b:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.200908+0000", 2024-09-21T22:01:04.854 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.55673910400000004, 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0070992329999999999, 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5846 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.200908+0000", 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.200908+0000", 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.200910+0000", 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9489999999999999e-06 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.200919+0000", 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8330000000000006e-06 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.200938+0000", 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8125999999999999e-05 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.200947+0000", 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2439999999999999e-06 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.201013+0000", 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6283000000000002e-05 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:04.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.201018+0000", 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9799999999999998e-06 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.205785+0000", 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047672900000000004 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.205884+0000", 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8760999999999999e-05 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.206274+0000", 2024-09-21T22:01:04.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00038971900000000001 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.207122+0000", 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00084809900000000005 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.207945+0000", 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00082335299999999998 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:04.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.207979+0000", 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3247000000000002e-05 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.208007+0000", 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8348999999999999e-05 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:04.860 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:04.861 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:04.767+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:04.862 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone5 from 0xd544a71 (overlap 0xd544a71) to 0x2aa7549 2024-09-21T22:01:04.862 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-21T22:01:04.862 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:04.859+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:04.863 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:04.962 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:04.960+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:04.969 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:04.969 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:04.969 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:04.969 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:04.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:05.062 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:05.060+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:05.104 INFO:teuthology.orchestra.run.smithi102.stdout:540 read 0xb8affe1 thru 0xb8b3e65 (0x3e85 bytes) 2024-09-21T22:01:05.109 INFO:teuthology.orchestra.run.smithi102.stdout:541 read 0x6c2a550 thru 0x6c35bcf (0xb680 bytes) 2024-09-21T22:01:05.119 INFO:teuthology.orchestra.run.smithi102.stdout:542 write 0xe5ad200 thru 0xe5b7d48 (0xab49 bytes) 2024-09-21T22:01:05.124 INFO:teuthology.orchestra.run.smithi102.stdout:543 read 0x49017c8 thru 0x490229f (0xad8 bytes) 2024-09-21T22:01:05.124 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.124 INFO:teuthology.orchestra.run.smithi102.stdout:546 read 0x73a08c6 thru 0x73aee9d (0xe5d8 bytes) 2024-09-21T22:01:05.125 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.125 INFO:teuthology.orchestra.run.smithi102.stdout:549 punch from 0x591a497 to 0x5925714, (0xb27d bytes) 2024-09-21T22:01:05.125 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:05.125 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:05.126 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:05.126 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:05.126 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:05.135 INFO:teuthology.orchestra.run.smithi102.stdout:550 write 0xe8fe81a thru 0xe90d515 (0xecfc bytes) 2024-09-21T22:01:05.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:05.144 INFO:teuthology.orchestra.run.smithi102.stdout:551 read 0xc36f17b thru 0xc379e5c (0xace2 bytes) 2024-09-21T22:01:05.145 INFO:teuthology.orchestra.run.smithi102.stdout:552 write 0x7be0df7 thru 0x7be8afe (0x7d08 bytes) 2024-09-21T22:01:05.150 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.150 INFO:teuthology.orchestra.run.smithi102.stdout:554 write 0xdaf36f3 thru 0xdaf3d24 (0x632 bytes) 2024-09-21T22:01:05.156 INFO:teuthology.orchestra.run.smithi102.stdout:555 read 0xdc81754 thru 0xdc81ec9 (0x776 bytes) 2024-09-21T22:01:05.156 INFO:teuthology.orchestra.run.smithi102.stdout:556 read 0xb212978 thru 0xb2176b8 (0x4d41 bytes) 2024-09-21T22:01:05.157 INFO:teuthology.orchestra.run.smithi102.stdout:557 write 0x37a4a39 thru 0x37a9236 (0x47fe bytes) 2024-09-21T22:01:05.166 INFO:teuthology.orchestra.run.smithi102.stdout:559 read 0xab2e7a thru 0xabaa09 (0x7b90 bytes) 2024-09-21T22:01:05.167 INFO:teuthology.orchestra.run.smithi102.stdout:562 writesame 0x9fab6fd thru 0x9fb4a4f data_size 0x13(0x9353 bytes) 2024-09-21T22:01:05.174 INFO:teuthology.orchestra.run.smithi102.stdout:565 read 0x16aa4fd thru 0x16b4b1e (0xa622 bytes) 2024-09-21T22:01:05.179 INFO:teuthology.orchestra.run.smithi102.stdout:566 trunc from 0xe90d516 to 0xad09b26 2024-09-21T22:01:05.180 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:05.178+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:05.225 INFO:teuthology.orchestra.run.smithi102.stdout:567 writesame 0xe20fec6 thru 0xe21222a data_size 0x29(0x2365 bytes) 2024-09-21T22:01:05.225 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.225 INFO:teuthology.orchestra.run.smithi102.stdout:570 write 0x13014d1 thru 0x130936c (0x7e9c bytes) 2024-09-21T22:01:05.230 INFO:teuthology.orchestra.run.smithi102.stdout:571 write 0xcd57eb4 thru 0xcd5fb63 (0x7cb0 bytes) 2024-09-21T22:01:05.234 INFO:teuthology.orchestra.run.smithi102.stdout:572 write 0x96b0323 thru 0x96ba24f (0x9f2d bytes) 2024-09-21T22:01:05.236 INFO:teuthology.orchestra.run.smithi102.stdout:573 write 0x59f0743 thru 0x59f1630 (0xeee bytes) 2024-09-21T22:01:05.244 INFO:teuthology.orchestra.run.smithi102.stdout:574 trunc from 0xe21222b to 0xc10cd6f 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:12 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.189175+0000", 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0691398230000004, 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0025887610000000002, 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.260 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 12 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189175+0000", 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189175+0000", 2024-09-21T22:01:05.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189176+0000", 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.319e-06 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189182+0000", 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4399999999999996e-06 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189189+0000", 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9270000000000005e-06 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189196+0000", 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5400000000000001e-06 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189255+0000", 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8839999999999999e-05 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189261+0000", 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6710000000000004e-06 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.190669+0000", 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001408732 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.190775+0000", 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000105936 2024-09-21T22:01:05.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.190910+0000", 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000134671 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191489+0000", 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00057885 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191700+0000", 2024-09-21T22:01:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00021092100000000001 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191732+0000", 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2592000000000002e-05 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191764+0000", 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1322000000000003e-05 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop_reply(client.4388.0:12 3.a e26/23 ondisk, result = 0)", 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.191637+0000", 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0666779389999999, 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013295599999999999, 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191637+0000", 2024-09-21T22:01:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191637+0000", 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191637+0000", 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1800000000000005e-07 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191641+0000", 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8600000000000003e-06 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191650+0000", 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8559999999999996e-06 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191658+0000", 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4730000000000003e-06 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191692+0000", 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4267999999999998e-05 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191696+0000", 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.549e-06 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191770+0000", 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3132000000000004e-05 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:16 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.200109+0000", 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0582059509999997, 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00028054300000000001, 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 16 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200109+0000", 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200109+0000", 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200110+0000", 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9999999999999996e-07 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200115+0000", 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0479999999999998e-06 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200125+0000", 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.039e-05 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200131+0000", 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6919999999999999e-06 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200182+0000", 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1459000000000003e-05 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200237+0000", 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4395999999999999e-05 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200389+0000", 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015265799999999999 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:17 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.200495+0000", 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0578195650000008, 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018783299999999999, 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 17 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200495+0000", 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200495+0000", 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200496+0000", 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200499+0000", 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9960000000000002e-06 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200506+0000", 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6890000000000004e-06 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200511+0000", 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.848e-06 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200552+0000", 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0710999999999997e-05 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200603+0000", 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1471000000000002e-05 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200683+0000", 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9550999999999998e-05 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:18 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call,call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.200773+0000", 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0575416769999997, 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00016977999999999999, 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 18 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200773+0000", 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200773+0000", 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200774+0000", 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1799999999999995e-07 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200777+0000", 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5099999999999999e-06 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200783+0000", 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3759999999999996e-06 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200787+0000", 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7529999999999999e-06 2024-09-21T22:01:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200814+0000", 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6842000000000002e-05 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200858+0000", 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3949000000000002e-05 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200943+0000", 2024-09-21T22:01:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:19 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.201025+0000", 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.057289742, 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000148548, 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 19 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201025+0000", 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201025+0000", 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201026+0000", 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5700000000000002e-07 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201028+0000", 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8399999999999999e-06 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201034+0000", 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201038+0000", 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5279999999999999e-06 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201066+0000", 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7715000000000001e-05 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201108+0000", 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1986000000000001e-05 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201173+0000", 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5835999999999998e-05 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:20 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.201536+0000", 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0567786580000007, 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00053722700000000004, 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 20 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201536+0000", 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201536+0000", 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201537+0000", 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.04e-06 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201543+0000", 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8039999999999998e-06 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201558+0000", 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201585+0000", 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6889999999999998e-05 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201652+0000", 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6835000000000006e-05 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201775+0000", 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012348700000000001 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202073+0000", 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029806199999999998 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:21 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.202228+0000", 2024-09-21T22:01:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0560867250000001, 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000246825, 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 21 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202228+0000", 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202228+0000", 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202229+0000", 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7300000000000005e-07 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202234+0000", 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0869999999999997e-06 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202246+0000", 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1761e-05 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202251+0000", 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202294+0000", 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2846000000000003e-05 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202336+0000", 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.227e-05 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202475+0000", 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000138727 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:22 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.202574+0000", 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0557408489999993, 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015582700000000001, 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 22 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202574+0000", 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202574+0000", 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202574+0000", 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3099999999999997e-07 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202578+0000", 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1269999999999999e-06 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202584+0000", 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7580000000000003e-06 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202588+0000", 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8800000000000001e-06 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202617+0000", 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8912999999999999e-05 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202658+0000", 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0837000000000002e-05 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202730+0000", 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1680999999999994e-05 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:24 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.203353+0000", 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0549615659999994, 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00020157899999999999, 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 24 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203353+0000", 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203353+0000", 2024-09-21T22:01:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203354+0000", 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4300000000000003e-07 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203358+0000", 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203367+0000", 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9619999999999999e-06 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203371+0000", 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3229999999999999e-06 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203413+0000", 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1999000000000002e-05 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203459+0000", 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6202000000000003e-05 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203555+0000", 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.5122000000000002e-05 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:25 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [watch watch cookie 140678969439376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.203732+0000", 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0545823530000007, 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00095077200000000001, 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 25 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203732+0000", 2024-09-21T22:01:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203732+0000", 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203733+0000", 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9999999999999997e-07 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203735+0000", 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6299999999999998e-06 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203742+0000", 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.348e-06 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203746+0000", 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9400000000000004e-06 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203773+0000", 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7200999999999999e-05 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203816+0000", 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3337000000000002e-05 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203905+0000", 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8727999999999995e-05 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204365+0000", 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000459634 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204563+0000", 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000197927 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204616+0000", 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3794e-05 2024-09-21T22:01:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204683+0000", 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6632999999999997e-05 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop_reply(client.4388.0:25 3.a e26/23 ondisk, result = 0)", 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.204485+0000", 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0538297409999995, 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00020383599999999999, 2024-09-21T22:01:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204485+0000", 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204485+0000", 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204486+0000", 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999999e-07 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204489+0000", 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8249999999999998e-06 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204499+0000", 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1400000000000006e-06 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204503+0000", 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204547+0000", 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3426000000000001e-05 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204555+0000", 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7819999999999999e-06 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204689+0000", 2024-09-21T22:01:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013329300000000001 2024-09-21T22:01:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.316 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:05.318 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:05.319 INFO:teuthology.orchestra.run.smithi102.stdout:575 write 0xc35737c thru 0xc35a37e (0x3003 bytes) 2024-09-21T22:01:05.319 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:578 read 0x3aa994f thru 0x3ab3a65 (0xa117 bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:579 read 0x72ed867 thru 0x72f6d33 (0x94cd bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:580 read 0x627684b thru 0x6283e40 (0xd5f6 bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:582 write 0x5abb42f thru 0x5ac2eb9 (0x7a8b bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:584 write 0xeb97cbc thru 0xeb9ad89 (0x30ce bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:586 punch from 0xd6831ea to 0xd687c05, (0x4a1b bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:588 read 0x3e876f6 thru 0x3e93fa0 (0xc8ab bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:590 read 0x476f594 thru 0x477ef0a (0xf977 bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:591 write 0x50ca3f2 thru 0x50d2e8a (0x8a99 bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:592 read 0xbfa9b7a thru 0xbfb5de4 (0xc26b bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:593 write 0x4698f7 thru 0x46dd7e (0x4488 bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:594 read 0x2935d9f thru 0x2943a9e (0xdd00 bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:596 read 0x6da08ab thru 0x6da69d5 (0x612b bytes) 2024-09-21T22:01:05.320 INFO:teuthology.orchestra.run.smithi102.stdout:597 writesame 0xd45e71c thru 0xd4666d6 data_size 0x1(0x7fbb bytes) 2024-09-21T22:01:05.321 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:05.315+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:05.330 INFO:teuthology.orchestra.run.smithi102.stdout:598 trunc from 0xeb9ad8a to 0x3bbe22c 2024-09-21T22:01:05.379 INFO:teuthology.orchestra.run.smithi102.stdout:599 write 0xd40e91e thru 0xd4107ac (0x1e8f bytes) 2024-09-21T22:01:05.382 INFO:teuthology.orchestra.run.smithi102.stdout:601 punch from 0xc7253f0 to 0xc72e8b6, (0x94c6 bytes) 2024-09-21T22:01:05.382 INFO:teuthology.orchestra.run.smithi102.stdout:602 read 0xc025c44 thru 0xc029c74 (0x4031 bytes) 2024-09-21T22:01:05.382 INFO:teuthology.orchestra.run.smithi102.stdout:603 writesame 0x8cf2fb2 thru 0x8cf880a data_size 0x15(0x5859 bytes) 2024-09-21T22:01:05.385 INFO:teuthology.orchestra.run.smithi102.stdout:604 read 0x83e3bb1 thru 0x83f26ec (0xeb3c bytes) 2024-09-21T22:01:05.385 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.385 INFO:teuthology.orchestra.run.smithi102.stdout:606 punch from 0x6cfcaa7 to 0x6d02783, (0x5cdc bytes) 2024-09-21T22:01:05.389 INFO:teuthology.orchestra.run.smithi102.stdout:607 writesame 0xd420481 thru 0xd42c9bb data_size 0x1(0xc53b bytes) 2024-09-21T22:01:05.394 INFO:teuthology.orchestra.run.smithi102.stdout:608 writesame 0xd472728 thru 0xd47e47c data_size 0x1(0xbd55 bytes) 2024-09-21T22:01:05.395 INFO:teuthology.orchestra.run.smithi102.stdout:610 trunc from 0xd47e47d to 0xccd16a2 2024-09-21T22:01:05.401 INFO:teuthology.orchestra.run.smithi102.stdout:612 write 0x9cd9cf9 thru 0x9cdd820 (0x3b28 bytes) 2024-09-21T22:01:05.404 INFO:teuthology.orchestra.run.smithi102.stdout:613 write 0x90977a thru 0x910ca1 (0x7528 bytes) 2024-09-21T22:01:05.411 INFO:teuthology.orchestra.run.smithi102.stdout:614 punch from 0x9aa2b17 to 0x9aa8aab, (0x5f94 bytes) 2024-09-21T22:01:05.411 INFO:teuthology.orchestra.run.smithi102.stdout:615 punch from 0x857b73e to 0x8586ffb, (0xb8bd bytes) 2024-09-21T22:01:05.418 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:05.416+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:05.418 INFO:teuthology.orchestra.run.smithi102.stdout:616 trunc from 0xccd16a2 to 0x64e79c6 2024-09-21T22:01:05.439 INFO:teuthology.orchestra.run.smithi102.stdout:618 writesame 0x9299b16 thru 0x92a51a0 data_size 0x25(0xb68b bytes) 2024-09-21T22:01:05.444 INFO:teuthology.orchestra.run.smithi102.stdout:620 write 0x9325278 thru 0x933381d (0xe5a6 bytes) 2024-09-21T22:01:05.447 INFO:teuthology.orchestra.run.smithi102.stdout:623 read 0x8dfb32 thru 0x8eeb99 (0xf068 bytes) 2024-09-21T22:01:05.447 INFO:teuthology.orchestra.run.smithi102.stdout:625 read 0x6d237e3 thru 0x6d2a85c (0x707a bytes) 2024-09-21T22:01:05.457 INFO:teuthology.orchestra.run.smithi102.stdout:626 write 0xae9f8cd thru 0xaea3c89 (0x43bd bytes) 2024-09-21T22:01:05.461 INFO:teuthology.orchestra.run.smithi102.stdout:627 write 0x3b6bc45 thru 0x3b6ef12 (0x32ce bytes) 2024-09-21T22:01:05.462 INFO:teuthology.orchestra.run.smithi102.stdout:628 write 0xa928edc thru 0xa929dbc (0xee1 bytes) 2024-09-21T22:01:05.466 INFO:teuthology.orchestra.run.smithi102.stdout:630 writesame 0x105fb97 thru 0x10609d3 data_size 0xf(0xe3d bytes) 2024-09-21T22:01:05.467 INFO:teuthology.orchestra.run.smithi102.stdout:631 write 0x2d16ec3 thru 0x2d253b7 (0xe4f5 bytes) 2024-09-21T22:01:05.470 INFO:teuthology.orchestra.run.smithi102.stdout:632 punch from 0x1f7c3bc to 0x1f83987, (0x75cb bytes) 2024-09-21T22:01:05.470 INFO:teuthology.orchestra.run.smithi102.stdout:633 writesame 0x9fa8317 thru 0x9faeb06 data_size 0x1(0x67f0 bytes) 2024-09-21T22:01:05.471 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:05.471 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:05.472 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:05.472 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:05.481 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:05.482 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.482 INFO:teuthology.orchestra.run.smithi102.stdout:638 write 0xa264d6 thru 0xa2dddf (0x790a bytes) 2024-09-21T22:01:05.489 INFO:teuthology.orchestra.run.smithi102.stdout:640 trunc from 0xaea3c8a to 0xccac964 2024-09-21T22:01:05.494 INFO:teuthology.orchestra.run.smithi102.stdout:641 read 0x5d2d7cf thru 0x5d343e4 (0x6c16 bytes) 2024-09-21T22:01:05.495 INFO:teuthology.orchestra.run.smithi102.stdout:642 writesame 0x1aa0417 thru 0x1aaf5bd data_size 0x11(0xf1a7 bytes) 2024-09-21T22:01:05.497 INFO:teuthology.orchestra.run.smithi102.stdout:643 read 0x3e8e0f thru 0x3ef09e (0x6290 bytes) 2024-09-21T22:01:05.498 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.498 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.498 INFO:teuthology.orchestra.run.smithi102.stdout:647 read 0x92b5399 thru 0x92b7af3 (0x275b bytes) 2024-09-21T22:01:05.498 INFO:teuthology.orchestra.run.smithi102.stdout:649 write 0x82940 thru 0x85640 (0x2d01 bytes) 2024-09-21T22:01:05.505 INFO:teuthology.orchestra.run.smithi102.stdout:650 writesame 0x1101ec7 thru 0x1111b85 data_size 0x1(0xfcbf bytes) 2024-09-21T22:01:05.522 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:05.520+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:05.541 INFO:teuthology.orchestra.run.smithi102.stdout:651 write 0xdac1f13 thru 0xdac4c81 (0x2d6f bytes) 2024-09-21T22:01:05.544 INFO:teuthology.orchestra.run.smithi102.stdout:652 write 0x5194581 thru 0x51a01c6 (0xbc46 bytes) 2024-09-21T22:01:05.546 INFO:teuthology.orchestra.run.smithi102.stdout:653 read 0x8ec5cdf thru 0x8ec65b8 (0x8da bytes) 2024-09-21T22:01:05.546 INFO:teuthology.orchestra.run.smithi102.stdout:656 punch from 0x969c568 to 0x96a99e1, (0xd479 bytes) 2024-09-21T22:01:05.551 INFO:teuthology.orchestra.run.smithi102.stdout:657 write 0xe7aea4b thru 0xe7b5f8c (0x7542 bytes) 2024-09-21T22:01:05.554 INFO:teuthology.orchestra.run.smithi102.stdout:658 read 0x4b724a6 thru 0x4b7e59c (0xc0f7 bytes) 2024-09-21T22:01:05.565 INFO:teuthology.orchestra.run.smithi102.stdout:660 trunc from 0xe7b5f8d to 0x55b5730 2024-09-21T22:01:05.599 INFO:teuthology.orchestra.run.smithi102.stdout:661 writesame 0xb0cf752 thru 0xb0d4b05 data_size 0x16(0x53b4 bytes) 2024-09-21T22:01:05.599 INFO:teuthology.orchestra.run.smithi102.stdout:662 punch from 0x52e9c81 to 0x52eda45, (0x3dc4 bytes) 2024-09-21T22:01:05.599 INFO:teuthology.orchestra.run.smithi102.stdout:663 read 0x21f84a2 thru 0x22073e3 (0xef42 bytes) 2024-09-21T22:01:05.599 INFO:teuthology.orchestra.run.smithi102.stdout:664 write 0x44a9a7d thru 0x44b2471 (0x89f5 bytes) 2024-09-21T22:01:05.601 INFO:teuthology.orchestra.run.smithi102.stdout:665 write 0x598ee3f thru 0x5995548 (0x670a bytes) 2024-09-21T22:01:05.602 INFO:teuthology.orchestra.run.smithi102.stdout:667 punch from 0x5505c22 to 0x550981e, (0x3bfc bytes) 2024-09-21T22:01:05.607 INFO:teuthology.orchestra.run.smithi102.stdout:668 write 0xb0d2860 thru 0xb0d5a6b (0x320c bytes) 2024-09-21T22:01:05.619 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:05.617+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:05.621 INFO:teuthology.orchestra.run.smithi102.stdout:669 write 0xee2b576 thru 0xee2eabe (0x3549 bytes) 2024-09-21T22:01:05.624 INFO:teuthology.orchestra.run.smithi102.stdout:671 punch from 0x30890f to 0x30923b, (0x92c bytes) 2024-09-21T22:01:05.624 INFO:teuthology.orchestra.run.smithi102.stdout:672 punch from 0x94d14cb to 0x94d5e9a, (0x49cf bytes) 2024-09-21T22:01:05.624 INFO:teuthology.orchestra.run.smithi102.stdout:674 write 0xdbd6f81 thru 0xdbda9d4 (0x3a54 bytes) 2024-09-21T22:01:05.627 INFO:teuthology.orchestra.run.smithi102.stdout:675 read 0x2675e50 thru 0x2679db4 (0x3f65 bytes) 2024-09-21T22:01:05.627 INFO:teuthology.orchestra.run.smithi102.stdout:676 read 0x6f46fee thru 0x6f4add7 (0x3dea bytes) 2024-09-21T22:01:05.627 INFO:teuthology.orchestra.run.smithi102.stdout:677 read 0x1e19c5a thru 0x1e22ecc (0x9273 bytes) 2024-09-21T22:01:05.627 INFO:teuthology.orchestra.run.smithi102.stdout:678 read 0x3e2e744 thru 0x3e2ec2b (0x4e8 bytes) 2024-09-21T22:01:05.628 INFO:teuthology.orchestra.run.smithi102.stdout:680 read 0xb717566 thru 0xb724adf (0xd57a bytes) 2024-09-21T22:01:05.628 INFO:teuthology.orchestra.run.smithi102.stdout:681 punch from 0x45f6faa to 0x45fa159, (0x31af bytes) 2024-09-21T22:01:05.633 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:05.633 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:05.633 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:05.634 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:05.634 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:05.636 INFO:teuthology.orchestra.run.smithi102.stdout:682 trunc from 0xee2eabf to 0x7f720db 2024-09-21T22:01:05.643 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:05.648 INFO:teuthology.orchestra.run.smithi102.stdout:683 read 0x262388 thru 0x268677 (0x62f0 bytes) 2024-09-21T22:01:05.648 INFO:teuthology.orchestra.run.smithi102.stdout:685 punch from 0xa77cd6 to 0xa7bd5c, (0x4086 bytes) 2024-09-21T22:01:05.652 INFO:teuthology.orchestra.run.smithi102.stdout:686 trunc from 0x7f720db to 0x5603ecc 2024-09-21T22:01:05.660 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.660 INFO:teuthology.orchestra.run.smithi102.stdout:690 read 0x42447d0 thru 0x424cde6 (0x8617 bytes) 2024-09-21T22:01:05.661 INFO:teuthology.orchestra.run.smithi102.stdout:691 punch from 0xadd89e to 0xae0145, (0x28a7 bytes) 2024-09-21T22:01:05.661 INFO:teuthology.orchestra.run.smithi102.stdout:692 read 0x4581a86 thru 0x45910e1 (0xf65c bytes) 2024-09-21T22:01:05.667 INFO:teuthology.orchestra.run.smithi102.stdout:693 trunc from 0x5603ecc to 0xa830131 2024-09-21T22:01:05.672 INFO:teuthology.orchestra.run.smithi102.stdout:694 write 0x4a4f24e thru 0x4a4fa9b (0x84e bytes) 2024-09-21T22:01:05.673 INFO:teuthology.orchestra.run.smithi102.stdout:695 write 0x6bee47b thru 0x6bf071c (0x22a2 bytes) 2024-09-21T22:01:05.676 INFO:teuthology.orchestra.run.smithi102.stdout:696 write 0x6f15f3e thru 0x6f210c8 (0xb18b bytes) 2024-09-21T22:01:05.680 INFO:teuthology.orchestra.run.smithi102.stdout:697 trunc from 0xa830131 to 0xb8722da 2024-09-21T22:01:05.693 INFO:teuthology.orchestra.run.smithi102.stdout:698 trunc from 0xb8722da to 0x522875f 2024-09-21T22:01:05.706 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T22:01:05.724 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T22:01:05.725 INFO:teuthology.orchestra.run.smithi102.stdout:699 write 0xe24b5f8 thru 0xe25a0de (0xeae7 bytes) 2024-09-21T22:01:05.727 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:05.725+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:05.734 INFO:teuthology.orchestra.run.smithi102.stdout:701 trunc from 0xe25a0df to 0xae99ddb 2024-09-21T22:01:05.756 INFO:teuthology.orchestra.run.smithi102.stdout:702 trunc from 0xae99ddb to 0x133b76f 2024-09-21T22:01:05.798 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:05.798 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:05.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:05.798 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.722391572999999, 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.799 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:01:05.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:01:05.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.437896281, 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099026370000000006, 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.806 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 36 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:01:05.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357881+0000", 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3139999999999999e-06 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357884+0000", 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6799999999999999e-06 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357888+0000", 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.286e-06 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.361833+0000", 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0039451979999999996 2024-09-21T22:01:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.361912+0000", 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8916000000000001e-05 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362042+0000", 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013033700000000001 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.364625+0000", 2024-09-21T22:01:05.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0025829170000000001 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367727+0000", 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031021540000000002 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367759+0000", 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1711999999999997e-05 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367779+0000", 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0726000000000001e-05 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.357896+0000", 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.437876632999998, 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099972970000000005, 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.812 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 37 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357896+0000", 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357896+0000", 2024-09-21T22:01:05.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357897+0000", 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9999999999999999e-07 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357900+0000", 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.768e-06 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357903+0000", 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8500000000000004e-06 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357907+0000", 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2710000000000001e-06 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362472+0000", 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045652560000000002 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362538+0000", 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6078e-05 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362624+0000", 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5958999999999995e-05 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.364646+0000", 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.002022041 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367814+0000", 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031681880000000002 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367850+0000", 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6248999999999998e-05 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367894+0000", 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3337000000000002e-05 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.817 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.239561551000001, 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095823990000000001, 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 110 2024-09-21T22:01:05.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556217+0000", 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5889999999999996e-06 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556226+0000", 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3910000000000004e-06 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556232+0000", 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8089999999999998e-06 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559353+0000", 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031209219999999999 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559420+0000", 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7195999999999998e-05 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559525+0000", 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000104947 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.560853+0000", 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0013283170000000001 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565693+0000", 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0048393050000000003 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565755+0000", 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2360000000000006e-05 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565794+0000", 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8859000000000002e-05 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.23952938, 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096657129999999994, 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 111 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0699999999999996e-07 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556249+0000", 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6120000000000001e-06 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556257+0000", 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8220000000000007e-06 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556292+0000", 2024-09-21T22:01:05.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5439999999999999e-05 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559894+0000", 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003601599 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559981+0000", 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7082000000000004e-05 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.560150+0000", 2024-09-21T22:01:05.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00016919299999999999 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562194+0000", 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.002043572 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565841+0000", 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0036475610000000001 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565878+0000", 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6681000000000003e-05 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565909+0000", 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1443999999999999e-05 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556312+0000", 2024-09-21T22:01:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.239461170999999, 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096874349999999994, 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 112 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556312+0000", 2024-09-21T22:01:05.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556312+0000", 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556313+0000", 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3799999999999996e-07 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556412+0000", 2024-09-21T22:01:05.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9259999999999995e-05 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556422+0000", 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0413e-05 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556430+0000", 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2300000000000002e-06 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561110+0000", 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046802759999999997 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561160+0000", 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0611e-05 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561250+0000", 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9979e-05 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563304+0000", 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0020534220000000001 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565948+0000", 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0026440790000000001 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565978+0000", 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0357000000000001e-05 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565999+0000", 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.107e-05 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556443+0000", 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.239330040999999, 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096365949999999995, 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.835 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 113 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556443+0000", 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556443+0000", 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556444+0000", 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0999999999999997e-07 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556450+0000", 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8259999999999998e-06 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556462+0000", 2024-09-21T22:01:05.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2588999999999999e-05 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556468+0000", 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9290000000000003e-06 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561729+0000", 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0052607690000000002 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561822+0000", 2024-09-21T22:01:05.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2948000000000005e-05 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561925+0000", 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103379 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563890+0000", 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0019645169999999998 2024-09-21T22:01:05.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.566029+0000", 2024-09-21T22:01:05.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0021388869999999999 2024-09-21T22:01:05.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.566058+0000", 2024-09-21T22:01:05.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9014999999999999e-05 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.566080+0000", 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1826000000000001e-05 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556481+0000", 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.239291922, 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011982389, 2024-09-21T22:01:05.843 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 114 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556481+0000", 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556481+0000", 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556482+0000", 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2099999999999996e-07 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556488+0000", 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5950000000000004e-06 2024-09-21T22:01:05.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556495+0000", 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556501+0000", 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4110000000000004e-06 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562235+0000", 2024-09-21T22:01:05.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0057339399999999999 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562311+0000", 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6307e-05 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562408+0000", 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7388999999999999e-05 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563894+0000", 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0014856699999999999 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568375+0000", 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0044804830000000004 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568427+0000", 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2462e-05 2024-09-21T22:01:05.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568464+0000", 2024-09-21T22:01:05.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6529000000000002e-05 2024-09-21T22:01:05.850 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.850 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.851 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.851 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.851 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556511+0000", 2024-09-21T22:01:05.851 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.239262156999999, 2024-09-21T22:01:05.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012065541000000001, 2024-09-21T22:01:05.851 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 115 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556511+0000", 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556511+0000", 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556512+0000", 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6599999999999996e-07 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556585+0000", 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3905000000000005e-05 2024-09-21T22:01:05.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556596+0000", 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0549e-05 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556602+0000", 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0090000000000004e-06 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562744+0000", 2024-09-21T22:01:05.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0061415410000000004 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562801+0000", 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7499e-05 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562887+0000", 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5549000000000004e-05 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563902+0000", 2024-09-21T22:01:05.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0010152749999999999 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568513+0000", 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.004611118 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568548+0000", 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5261e-05 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568577+0000", 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8269e-05 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556616+0000", 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.239157185, 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012059043, 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.857 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 116 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556616+0000", 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556616+0000", 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556617+0000", 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6899999999999996e-07 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556622+0000", 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1719999999999998e-06 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556632+0000", 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0284e-05 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556639+0000", 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0110000000000003e-06 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563457+0000", 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0068177769999999997 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563534+0000", 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7453999999999994e-05 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563625+0000", 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0243999999999999e-05 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.564337+0000", 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00071240099999999998 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568622+0000", 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0042851169999999997 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568652+0000", 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0179e-05 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568675+0000", 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2634999999999999e-05 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.862 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.239122385000002, 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012111705, 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.863 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 117 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3499999999999996e-07 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556656+0000", 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3000000000000003e-06 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556666+0000", 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0020999999999999e-05 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556673+0000", 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1810000000000004e-06 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563928+0000", 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0072551129999999997 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563984+0000", 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6267000000000002e-05 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.564080+0000", 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6211000000000004e-05 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.564582+0000", 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00050163599999999997 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568709+0000", 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.004126785 2024-09-21T22:01:05.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568740+0000", 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0657999999999997e-05 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568762+0000", 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2898e-05 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.868 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 26.883157081, 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010152499000000001, 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 138 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912619+0000", 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9490000000000001e-06 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912628+0000", 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1699999999999997e-06 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912631+0000", 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4939999999999999e-06 2024-09-21T22:01:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.917688+0000", 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0050565999999999996 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.917751+0000", 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3359000000000001e-05 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.917835+0000", 2024-09-21T22:01:05.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4027e-05 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922655+0000", 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0048200079999999998 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922709+0000", 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4320999999999997e-05 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922742+0000", 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2308999999999998e-05 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922769+0000", 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6911e-05 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:01:05.874 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 26.883137257000001, 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010189116999999999, 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 139 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912639+0000", 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.774e-06 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912643+0000", 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.687e-06 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912646+0000", 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1779999999999999e-06 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.918591+0000", 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0059446209999999998 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.918641+0000", 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9985000000000003e-05 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.918724+0000", 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3718e-05 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.878 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922698+0000", 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003973903 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922775+0000", 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7212000000000005e-05 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922805+0000", 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9955999999999999e-05 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.879 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922825+0000", 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9624999999999999e-05 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912656+0000", 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 26.883116919999999, 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010746136, 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.880 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 140 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912656+0000", 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912656+0000", 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912657+0000", 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1e-07 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912696+0000", 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9632000000000003e-05 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912703+0000", 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912708+0000", 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3440000000000003e-06 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.919071+0000", 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0063632480000000002 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.919130+0000", 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8779000000000001e-05 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.883 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.919214+0000", 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4456999999999995e-05 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922886+0000", 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003672228 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923339+0000", 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00045238100000000002 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.884 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923376+0000", 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7431999999999997e-05 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923402+0000", 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.614e-05 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:01:05.885 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 26.883058087999999, 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011180765, 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 141 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:01:05.886 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.887 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912718+0000", 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7709999999999998e-06 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912722+0000", 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7629999999999998e-06 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912725+0000", 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0699999999999998e-06 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.888 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922910+0000", 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010185318 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922974+0000", 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3836000000000003e-05 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923060+0000", 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5714e-05 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923672+0000", 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000612467 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923838+0000", 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00016549499999999999 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923873+0000", 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5055999999999998e-05 2024-09-21T22:01:05.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923896+0000", 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2908000000000002e-05 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2095 3.f 3:f1bf288a:::rbd_object_map.1124ebe77597:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.496847+0000", 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.2989262159999999, 2024-09-21T22:01:05.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096887840000000006, 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2095 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496847+0000", 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.892 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496847+0000", 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496848+0000", 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1200000000000001e-06 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496854+0000", 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.893 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496865+0000", 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0862e-05 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496872+0000", 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1539999999999996e-06 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497710+0000", 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00083737600000000003 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497770+0000", 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0180999999999999e-05 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497997+0000", 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00022681700000000001 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.501350+0000", 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0033537250000000001 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506444+0000", 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0050937209999999998 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506491+0000", 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7224000000000001e-05 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506536+0000", 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4434999999999997e-05 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.896 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2096 3.f 3:f1bf288a:::rbd_object_map.1124ebe77597:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.497003+0000", 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.2987704979999997, 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096287950000000008, 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2096 2024-09-21T22:01:05.897 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497003+0000", 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497003+0000", 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.898 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497003+0000", 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9299999999999997e-07 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497017+0000", 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3767e-05 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497027+0000", 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4530000000000008e-06 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.899 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497034+0000", 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6739999999999997e-06 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498298+0000", 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0012633480000000001 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498382+0000", 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4746000000000005e-05 2024-09-21T22:01:05.900 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498728+0000", 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034568199999999999 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.503698+0000", 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0049698839999999999 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506569+0000", 2024-09-21T22:01:05.901 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028709489999999998 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506598+0000", 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9084000000000001e-05 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506631+0000", 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3414999999999998e-05 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.902 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2097 3.f 3:f408e78a:::rbd_data.1124ebe77597.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.497941+0000", 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.2978326060000001, 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0088259480000000001, 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2097 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.903 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497941+0000", 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497941+0000", 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497941+0000", 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3900000000000004e-07 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.904 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497946+0000", 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8790000000000002e-06 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497956+0000", 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.5959999999999993e-06 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497969+0000", 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2670999999999999e-05 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499116+0000", 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011474720000000001 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499212+0000", 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.5878999999999995e-05 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499325+0000", 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011351199999999999 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.906 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.503705+0000", 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.004379979 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506673+0000", 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0029678389999999999 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506728+0000", 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5114999999999997e-05 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.907 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506766+0000", 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8167000000000002e-05 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.29035532200000003, 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:05.908 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.909 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.910 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:01:05.911 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:01:05.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop_reply(client.4388.0:7933 3.11 e34/23 ondisk, result = 0)", 2024-09-21T22:01:05.913 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.525618+0000", 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.270154805, 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0085979960000000001, 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525618+0000", 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525618+0000", 2024-09-21T22:01:05.914 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525619+0000", 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0780000000000001e-06 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525625+0000", 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9460000000000003e-06 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525641+0000", 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5471000000000001e-05 2024-09-21T22:01:05.915 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525650+0000", 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9439999999999994e-06 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534125+0000", 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0084754519999999996 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534133+0000", 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0600000000000008e-06 2024-09-21T22:01:05.916 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:05.917 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:05.917 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:05.917 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534216+0000", 2024-09-21T22:01:05.917 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3045000000000002e-05 2024-09-21T22:01:05.917 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.917 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.917 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.917 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:05.917 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:05.917 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:05.919 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:05.916+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:05.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:05.922 INFO:teuthology.orchestra.run.smithi102.stdout:703 writesame 0xaf9a8c5 thru 0xafa71a3 data_size 0x3d(0xc8df bytes) 2024-09-21T22:01:05.922 INFO:teuthology.orchestra.run.smithi102.stdout:704 punch from 0x3b7aa4a to 0x3b7e1ca, (0x3780 bytes) 2024-09-21T22:01:05.922 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.922 INFO:teuthology.orchestra.run.smithi102.stdout:707 read 0x30922ce thru 0x30a0b8e (0xe8c1 bytes) 2024-09-21T22:01:05.922 INFO:teuthology.orchestra.run.smithi102.stdout:708 punch from 0x1f7eb6 to 0x1fb4da, (0x3624 bytes) 2024-09-21T22:01:05.922 INFO:teuthology.orchestra.run.smithi102.stdout:709 read 0xa1cfb46 thru 0xa1dd694 (0xdb4f bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:711 read 0x8f71ed5 thru 0x8f7d05f (0xb18b bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:713 punch from 0x66e7ce8 to 0x66f33fc, (0xb714 bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:714 trunc from 0xafa71a4 to 0x14452f2 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:716 writesame 0x2213c64 thru 0x221a584 data_size 0x1(0x6921 bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:720 writesame 0xa8bb491 thru 0xa8c1a99 data_size 0x1(0x6609 bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:722 read 0xbf5cf7 thru 0xbfa0b3 (0x43bd bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:723 write 0x5b041c4 thru 0x5b0b7ee (0x762b bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:724 writesame 0x63dea1e thru 0x63df0fa data_size 0x7(0x6dd bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:726 write 0x2c95342 thru 0x2ca32f3 (0xdfb2 bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:727 write 0x2471a0f thru 0x247224b (0x83d bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:729 write 0x508eae5 thru 0x509a573 (0xba8f bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:730 read 0x1a36df8 thru 0x1a3b627 (0x4830 bytes) 2024-09-21T22:01:05.923 INFO:teuthology.orchestra.run.smithi102.stdout:731 writesame 0xc6a2b8d thru 0xc6b05d6 data_size 0x1(0xda4a bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:732 write 0xb7330b3 thru 0xb741be3 (0xeb31 bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:734 punch from 0xc431d96 to 0xc441092, (0xf2fc bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:735 writesame 0xb923006 thru 0xb927cff data_size 0x3b(0x4cfa bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:737 trunc from 0xc6b05d7 to 0x883fb3a 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:739 read 0x59ebe91 thru 0x59ecef6 (0x1066 bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:740 read 0x367e806 thru 0x3683a2f (0x522a bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:741 punch from 0x873b305 to 0x87455bb, (0xa2b6 bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:742 read 0x2f1412a thru 0x2f1c14e (0x8025 bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:743 write 0xb67e34e thru 0xb67f847 (0x14fa bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:746 write 0xa340b20 thru 0xa343f8c (0x346d bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:747 read 0x88faab8 thru 0x8903f1f (0x9468 bytes) 2024-09-21T22:01:05.924 INFO:teuthology.orchestra.run.smithi102.stdout:749 writesame 0x96032e1 thru 0x960d971 data_size 0x1(0xa691 bytes) 2024-09-21T22:01:05.931 INFO:teuthology.orchestra.run.smithi102.stdout:750 write 0xb162b0d thru 0xb16b0db (0x85cf bytes) 2024-09-21T22:01:05.934 INFO:teuthology.orchestra.run.smithi102.stdout:752 writesame 0x268bb3d thru 0x26981dc data_size 0x20(0xc6a0 bytes) 2024-09-21T22:01:05.936 INFO:teuthology.orchestra.run.smithi102.stdout:753 read 0x285bfe6 thru 0x28664e1 (0xa4fc bytes) 2024-09-21T22:01:05.936 INFO:teuthology.orchestra.run.smithi102.stdout:754 read 0x1ce138 thru 0x1d658c (0x8455 bytes) 2024-09-21T22:01:05.937 INFO:teuthology.orchestra.run.smithi102.stdout:756 write 0x38951ef thru 0x38a236d (0xd17f bytes) 2024-09-21T22:01:05.943 INFO:teuthology.orchestra.run.smithi102.stdout:757 write 0xb2d4f70 thru 0xb2e4f47 (0xffd8 bytes) 2024-09-21T22:01:05.947 INFO:teuthology.orchestra.run.smithi102.stdout:758 writesame 0xadf1bd0 thru 0xadf26b3 data_size 0x22(0xae4 bytes) 2024-09-21T22:01:05.952 INFO:teuthology.orchestra.run.smithi102.stdout:759 writesame 0x234f1dd thru 0x235aae5 data_size 0x43(0xb909 bytes) 2024-09-21T22:01:05.953 INFO:teuthology.orchestra.run.smithi102.stdout:762 read 0x53d6346 thru 0x53d9b2d (0x37e8 bytes) 2024-09-21T22:01:05.955 INFO:teuthology.orchestra.run.smithi102.stdout:763 trunc from 0xb67f848 to 0xa419d6e 2024-09-21T22:01:05.963 INFO:teuthology.orchestra.run.smithi102.stdout:764 read 0x1490401 thru 0x14915ba (0x11ba bytes) 2024-09-21T22:01:05.973 INFO:teuthology.orchestra.run.smithi102.stdout:765 writesame 0xcce038a thru 0xcce84e9 data_size 0xa0(0x8160 bytes) 2024-09-21T22:01:05.973 INFO:teuthology.orchestra.run.smithi102.stdout:766 write 0x1b2e31 thru 0x1baa8f (0x7c5f bytes) 2024-09-21T22:01:05.980 INFO:teuthology.orchestra.run.smithi102.stdout:767 trunc from 0xcce84ea to 0x8284591 2024-09-21T22:01:05.986 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:05.993 INFO:teuthology.orchestra.run.smithi102.stdout:768 write 0x537089f thru 0x537d90f (0xd071 bytes) 2024-09-21T22:01:05.996 INFO:teuthology.orchestra.run.smithi102.stdout:770 read 0x96629f thru 0x97510d (0xee6f bytes) 2024-09-21T22:01:05.996 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.997 INFO:teuthology.orchestra.run.smithi102.stdout:772 punch from 0x26d8ed to 0x27bafb, (0xe20e bytes) 2024-09-21T22:01:05.997 INFO:teuthology.orchestra.run.smithi102.stdout:773 read 0x44934c thru 0x450abf (0x7774 bytes) 2024-09-21T22:01:05.997 INFO:teuthology.orchestra.run.smithi102.stdout:774 read 0x180e856 thru 0x1817701 (0x8eac bytes) 2024-09-21T22:01:05.997 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:05.997 INFO:teuthology.orchestra.run.smithi102.stdout:776 write 0x70cd52d thru 0x70d3a20 (0x64f4 bytes) 2024-09-21T22:01:06.001 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.001 INFO:teuthology.orchestra.run.smithi102.stdout:778 write 0x2ead949 thru 0x2eb240e (0x4ac6 bytes) 2024-09-21T22:01:06.002 INFO:teuthology.orchestra.run.smithi102.stdout:779 punch from 0x69faeb9 to 0x6a00d19, (0x5e60 bytes) 2024-09-21T22:01:06.003 INFO:teuthology.orchestra.run.smithi102.stdout:780 read 0xa717ac thru 0xa78519 (0x6d6e bytes) 2024-09-21T22:01:06.003 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.003 INFO:teuthology.orchestra.run.smithi102.stdout:782 punch from 0x112e865 to 0x113d306, (0xeaa1 bytes) 2024-09-21T22:01:06.003 INFO:teuthology.orchestra.run.smithi102.stdout:783 punch from 0x4e27ef8 to 0x4e28ff4, (0x10fc bytes) 2024-09-21T22:01:06.003 INFO:teuthology.orchestra.run.smithi102.stdout:784 punch from 0x820cc8e to 0x8217991, (0xad03 bytes) 2024-09-21T22:01:06.006 INFO:teuthology.orchestra.run.smithi102.stdout:786 trunc from 0x8284591 to 0xadc9a4c 2024-09-21T22:01:06.011 INFO:teuthology.orchestra.run.smithi102.stdout:787 read 0x3545839 thru 0x354c302 (0x6aca bytes) 2024-09-21T22:01:06.011 INFO:teuthology.orchestra.run.smithi102.stdout:788 read 0x553b3cd thru 0x5546af6 (0xb72a bytes) 2024-09-21T22:01:06.019 INFO:teuthology.orchestra.run.smithi102.stdout:790 write 0xcb2f1ed thru 0xcb3d2ec (0xe100 bytes) 2024-09-21T22:01:06.020 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:06.017+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:06.022 INFO:teuthology.orchestra.run.smithi102.stdout:793 write 0xc8bea16 thru 0xc8ce728 (0xfd13 bytes) 2024-09-21T22:01:06.027 INFO:teuthology.orchestra.run.smithi102.stdout:794 read 0x225bfee thru 0x22613e7 (0x53fa bytes) 2024-09-21T22:01:06.027 INFO:teuthology.orchestra.run.smithi102.stdout:796 write 0xf9500b thru 0xfa462b (0xf621 bytes) 2024-09-21T22:01:06.029 INFO:teuthology.orchestra.run.smithi102.stdout:797 punch from 0x220033c to 0x220052f, (0x1f3 bytes) 2024-09-21T22:01:06.035 INFO:teuthology.orchestra.run.smithi102.stdout:799 trunc from 0xcb3d2ed to 0x7d6360e 2024-09-21T22:01:06.047 INFO:teuthology.orchestra.run.smithi102.stdout:802 write 0x31fe19b thru 0x3205a3a (0x78a0 bytes) 2024-09-21T22:01:06.048 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:06.048 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:06.048 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:06.048 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:06.051 INFO:teuthology.orchestra.run.smithi102.stdout:803 punch from 0x671cfbc to 0x6727ccc, (0xad10 bytes) 2024-09-21T22:01:06.052 INFO:teuthology.orchestra.run.smithi102.stdout:804 read 0x23991e2 thru 0x239ba7a (0x2899 bytes) 2024-09-21T22:01:06.052 INFO:teuthology.orchestra.run.smithi102.stdout:805 writesame 0x65af63d thru 0x65bd0cd data_size 0x3(0xda91 bytes) 2024-09-21T22:01:06.058 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:06.063 INFO:teuthology.orchestra.run.smithi102.stdout:806 read 0x301442c thru 0x301a09d (0x5c72 bytes) 2024-09-21T22:01:06.063 INFO:teuthology.orchestra.run.smithi102.stdout:808 write 0xa7bffd thru 0xa84ec2 (0x8ec6 bytes) 2024-09-21T22:01:06.065 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.065 INFO:teuthology.orchestra.run.smithi102.stdout:810 punch from 0x59c835b to 0x59cdd6a, (0x5a0f bytes) 2024-09-21T22:01:06.065 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.066 INFO:teuthology.orchestra.run.smithi102.stdout:813 punch from 0x68c5a5e to 0x68d3c20, (0xe1c2 bytes) 2024-09-21T22:01:06.066 INFO:teuthology.orchestra.run.smithi102.stdout:814 read 0x7cf8de9 thru 0x7cfbf07 (0x311f bytes) 2024-09-21T22:01:06.066 INFO:teuthology.orchestra.run.smithi102.stdout:815 write 0x13c68b9 thru 0x13d462d (0xdd75 bytes) 2024-09-21T22:01:06.067 INFO:teuthology.orchestra.run.smithi102.stdout:816 punch from 0x5c50ad1 to 0x5c5b210, (0xa73f bytes) 2024-09-21T22:01:06.078 INFO:teuthology.orchestra.run.smithi102.stdout:817 write 0xc9fcb11 thru 0xc9fe9c9 (0x1eb9 bytes) 2024-09-21T22:01:06.081 INFO:teuthology.orchestra.run.smithi102.stdout:819 punch from 0x5099416 to 0x509a390, (0xf7a bytes) 2024-09-21T22:01:06.092 INFO:teuthology.orchestra.run.smithi102.stdout:820 trunc from 0xc9fe9ca to 0x41e8d97 2024-09-21T22:01:06.106 INFO:teuthology.orchestra.run.smithi102.stdout:824 punch from 0x16b48d5 to 0x16b702b, (0x2756 bytes) 2024-09-21T22:01:06.118 INFO:teuthology.orchestra.run.smithi102.stdout:825 trunc from 0x41e8d97 to 0xe4c9410 2024-09-21T22:01:06.120 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:06.118+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:06.123 INFO:teuthology.orchestra.run.smithi102.stdout:830 write 0x6bf6924 thru 0x6c04531 (0xdc0e bytes) 2024-09-21T22:01:06.127 INFO:teuthology.orchestra.run.smithi102.stdout:831 read 0x73c5088 thru 0x73cc066 (0x6fdf bytes) 2024-09-21T22:01:06.127 INFO:teuthology.orchestra.run.smithi102.stdout:832 punch from 0xc227ce9 to 0xc22e0b2, (0x63c9 bytes) 2024-09-21T22:01:06.127 INFO:teuthology.orchestra.run.smithi102.stdout:835 read 0x75e60d6 thru 0x75f07b2 (0xa6dd bytes) 2024-09-21T22:01:06.127 INFO:teuthology.orchestra.run.smithi102.stdout:836 write 0x929c249 thru 0x92a07a5 (0x455d bytes) 2024-09-21T22:01:06.130 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:06.130 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:06.130 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.144 INFO:teuthology.orchestra.run.smithi102.stdout:839 trunc from 0xe4c9410 to 0x29f8ebc 2024-09-21T22:01:06.149 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:06.149 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:06.166 INFO:teuthology.orchestra.run.smithi102.stdout:840 trunc from 0x29f8ebc to 0x5c1a940 2024-09-21T22:01:06.168 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:06.168 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:06.171 INFO:teuthology.orchestra.run.smithi102.stdout:841 read 0x54e153f thru 0x54e38ce (0x2390 bytes) 2024-09-21T22:01:06.171 INFO:teuthology.orchestra.run.smithi102.stdout:842 punch from 0x3430cac to 0x3438d8d, (0x80e1 bytes) 2024-09-21T22:01:06.171 INFO:teuthology.orchestra.run.smithi102.stdout:843 punch from 0xb5e346 to 0xb63e1e, (0x5ad8 bytes) 2024-09-21T22:01:06.171 INFO:teuthology.orchestra.run.smithi102.stdout:844 write 0x11d1cc1 thru 0x11d4173 (0x24b3 bytes) 2024-09-21T22:01:06.172 INFO:teuthology.orchestra.run.smithi102.stdout:845 read 0x10b1c09 thru 0x10b4bb6 (0x2fae bytes) 2024-09-21T22:01:06.173 INFO:teuthology.orchestra.run.smithi102.stdout:846 read 0x4c68093 thru 0x4c704d2 (0x8440 bytes) 2024-09-21T22:01:06.173 INFO:teuthology.orchestra.run.smithi102.stdout:847 punch from 0x40a53f8 to 0x40af931, (0xa539 bytes) 2024-09-21T22:01:06.173 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.173 INFO:teuthology.orchestra.run.smithi102.stdout:849 read 0x25bff4e thru 0x25c403f (0x40f2 bytes) 2024-09-21T22:01:06.173 INFO:teuthology.orchestra.run.smithi102.stdout:850 punch from 0x271b153 to 0x272aa54, (0xf901 bytes) 2024-09-21T22:01:06.185 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:06.185 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:06.188 INFO:teuthology.orchestra.run.smithi102.stdout:851 writesame 0xdc97709 thru 0xdca046f data_size 0x1(0x8d67 bytes) 2024-09-21T22:01:06.190 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:06.190 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:06.203 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:06.203 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:06.204 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:06.204 INFO:teuthology.orchestra.run.smithi102.stdout:852 trunc from 0xdca0470 to 0xebddb6 2024-09-21T22:01:06.220 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:06.219+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:06.222 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:06.222 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:06.224 INFO:teuthology.orchestra.run.smithi102.stdout:853 writesame 0x450c9fd thru 0x4516610 data_size 0xe(0x9c14 bytes) 2024-09-21T22:01:06.234 INFO:teuthology.orchestra.run.smithi102.stdout:854 writesame 0x88ce226 thru 0x88cf46a data_size 0x1(0x1245 bytes) 2024-09-21T22:01:06.235 INFO:teuthology.orchestra.run.smithi102.stdout:856 read 0x1f60269 thru 0x1f62f69 (0x2d01 bytes) 2024-09-21T22:01:06.240 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:06.240 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:06.243 INFO:teuthology.orchestra.run.smithi102.stdout:858 write 0xb563adb thru 0xb56ddfd (0xa323 bytes) 2024-09-21T22:01:06.248 INFO:teuthology.orchestra.run.smithi102.stdout:859 punch from 0x7959fde to 0x7962e9b, (0x8ebd bytes) 2024-09-21T22:01:06.248 INFO:teuthology.orchestra.run.smithi102.stdout:862 read 0x485a287 thru 0x4866f17 (0xcc91 bytes) 2024-09-21T22:01:06.248 INFO:teuthology.orchestra.run.smithi102.stdout:864 write 0x470dd1e thru 0x4711937 (0x3c1a bytes) 2024-09-21T22:01:06.250 INFO:teuthology.orchestra.run.smithi102.stdout:867 write 0x13f3543 thru 0x13fbd72 (0x8830 bytes) 2024-09-21T22:01:06.253 INFO:teuthology.orchestra.run.smithi102.stdout:868 read 0x50857ff thru 0x5093375 (0xdb77 bytes) 2024-09-21T22:01:06.253 INFO:teuthology.orchestra.run.smithi102.stdout:869 write 0x70afa4d thru 0x70b9140 (0x96f4 bytes) 2024-09-21T22:01:06.256 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.256 INFO:teuthology.orchestra.run.smithi102.stdout:872 read 0x9c0a713 thru 0x9c11c54 (0x7542 bytes) 2024-09-21T22:01:06.256 INFO:teuthology.orchestra.run.smithi102.stdout:873 read 0xa2cf2b5 thru 0xa2d2c04 (0x3950 bytes) 2024-09-21T22:01:06.256 INFO:teuthology.orchestra.run.smithi102.stdout:874 punch from 0x8205d5d to 0x820eb61, (0x8e04 bytes) 2024-09-21T22:01:06.257 INFO:teuthology.orchestra.run.smithi102.stdout:875 write 0x4f02ec5 thru 0x4f098c9 (0x6a05 bytes) 2024-09-21T22:01:06.259 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:06.259 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:06.259 INFO:teuthology.orchestra.run.smithi102.stdout:876 punch from 0x44281ac to 0x4429acc, (0x1920 bytes) 2024-09-21T22:01:06.260 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.260 INFO:teuthology.orchestra.run.smithi102.stdout:878 read 0x6189ba6 thru 0x6191c0f (0x806a bytes) 2024-09-21T22:01:06.260 INFO:teuthology.orchestra.run.smithi102.stdout:879 writesame 0xe9a2e thru 0xf85b8 data_size 0x1(0xeb8b bytes) 2024-09-21T22:01:06.290 INFO:teuthology.orchestra.run.smithi102.stdout:880 trunc from 0xb56ddfe to 0xe6c36a3 2024-09-21T22:01:06.296 INFO:teuthology.orchestra.run.smithi102.stdout:882 writesame 0xc749852 thru 0xc7562ad data_size 0x12(0xca5c bytes) 2024-09-21T22:01:06.301 INFO:teuthology.orchestra.run.smithi102.stdout:883 write 0x7a24f52 thru 0x7a31bf4 (0xcca3 bytes) 2024-09-21T22:01:06.306 INFO:teuthology.orchestra.run.smithi102.stdout:885 write 0x7a278f0 thru 0x7a2b4ff (0x3c10 bytes) 2024-09-21T22:01:06.309 INFO:teuthology.orchestra.run.smithi102.stdout:886 read 0x5529078 thru 0x5531680 (0x8609 bytes) 2024-09-21T22:01:06.309 INFO:teuthology.orchestra.run.smithi102.stdout:887 writesame 0x585c501 thru 0x5869973 data_size 0x9(0xd473 bytes) 2024-09-21T22:01:06.315 INFO:teuthology.orchestra.run.smithi102.stdout:888 write 0x32761e7 thru 0x327f957 (0x9771 bytes) 2024-09-21T22:01:06.319 INFO:teuthology.orchestra.run.smithi102.stdout:889 write 0xc259b8b thru 0xc25e32b (0x47a1 bytes) 2024-09-21T22:01:06.322 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.322 INFO:teuthology.orchestra.run.smithi102.stdout:892 writesame 0xcf79d7e thru 0xcf7cf9b data_size 0x5(0x321e bytes) 2024-09-21T22:01:06.322 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:06.320+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:06.325 INFO:teuthology.orchestra.run.smithi102.stdout:894 read 0x8f569f7 thru 0x8f65721 (0xed2b bytes) 2024-09-21T22:01:06.325 INFO:teuthology.orchestra.run.smithi102.stdout:895 write 0xa304256 thru 0xa305adc (0x1887 bytes) 2024-09-21T22:01:06.341 INFO:teuthology.orchestra.run.smithi102.stdout:897 trunc from 0xe6c36a3 to 0x4f5455f 2024-09-21T22:01:06.344 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:06.344 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:06.354 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:06.359 INFO:teuthology.orchestra.run.smithi102.stdout:898 read 0x278e2e0 thru 0x279b22e (0xcf4f bytes) 2024-09-21T22:01:06.375 INFO:teuthology.orchestra.run.smithi102.stdout:899 writesame 0xe005693 thru 0xe005a36 data_size 0x2(0x3a4 bytes) 2024-09-21T22:01:06.375 INFO:teuthology.orchestra.run.smithi102.stdout:900 writesame 0x2e9fa05 thru 0x2eab201 data_size 0x25(0xb7fd bytes) 2024-09-21T22:01:06.388 INFO:teuthology.orchestra.run.smithi102.stdout:901 trunc from 0xe005a37 to 0x55f9934 2024-09-21T22:01:06.397 INFO:teuthology.orchestra.run.smithi102.stdout:902 writesame 0x439682d thru 0x43a3132 data_size 0x1b(0xc906 bytes) 2024-09-21T22:01:06.404 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.421 INFO:teuthology.orchestra.run.smithi102.stdout:904 writesame 0xc7e778b thru 0xc7f51a4 data_size 0x1(0xda1a bytes) 2024-09-21T22:01:06.421 INFO:teuthology.orchestra.run.smithi102.stdout:905 writesame 0x74270cd thru 0x742c5d6 data_size 0x23(0x550a bytes) 2024-09-21T22:01:06.422 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:06.420+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:06.425 INFO:teuthology.orchestra.run.smithi102.stdout:907 punch from 0xb21e057 to 0xb229e10, (0xbdb9 bytes) 2024-09-21T22:01:06.425 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.425 INFO:teuthology.orchestra.run.smithi102.stdout:909 write 0x2f9901c thru 0x2f9b9a9 (0x298e bytes) 2024-09-21T22:01:06.426 INFO:teuthology.orchestra.run.smithi102.stdout:910 punch from 0xde9963 to 0xdec681, (0x2d1e bytes) 2024-09-21T22:01:06.426 INFO:teuthology.orchestra.run.smithi102.stdout:912 writesame 0x859dd98 thru 0x85a5f1c data_size 0x1(0x8185 bytes) 2024-09-21T22:01:06.442 INFO:teuthology.orchestra.run.smithi102.stdout:914 read 0x9a95220 thru 0x9a97d68 (0x2b49 bytes) 2024-09-21T22:01:06.442 INFO:teuthology.orchestra.run.smithi102.stdout:915 read 0x822f927 thru 0x823435e (0x4a38 bytes) 2024-09-21T22:01:06.442 INFO:teuthology.orchestra.run.smithi102.stdout:918 read 0x83f3e1e thru 0x83ff87f (0xba62 bytes) 2024-09-21T22:01:06.442 INFO:teuthology.orchestra.run.smithi102.stdout:919 read 0x1ae1580 thru 0x1ae4744 (0x31c5 bytes) 2024-09-21T22:01:06.442 INFO:teuthology.orchestra.run.smithi102.stdout:922 read 0x1703f99 thru 0x171142e (0xd496 bytes) 2024-09-21T22:01:06.442 INFO:teuthology.orchestra.run.smithi102.stdout:923 write 0xb868427 thru 0xb870872 (0x844c bytes) 2024-09-21T22:01:06.447 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.448 INFO:teuthology.orchestra.run.smithi102.stdout:925 trunc from 0xc7f51a5 to 0xd49a05f 2024-09-21T22:01:06.455 INFO:teuthology.orchestra.run.smithi102.stdout:926 writesame 0x532ffff thru 0x533569c data_size 0x1(0x569e bytes) 2024-09-21T22:01:06.480 INFO:teuthology.orchestra.run.smithi102.stdout:927 trunc from 0xd49a05f to 0x22932bd 2024-09-21T22:01:06.486 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:06.486 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:06.496 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:06.500 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.500 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.508 INFO:teuthology.orchestra.run.smithi102.stdout:930 write 0x4615525 thru 0x461dca2 (0x877e bytes) 2024-09-21T22:01:06.512 INFO:teuthology.orchestra.run.smithi102.stdout:931 read 0x7e1e19 thru 0x7efc28 (0xde10 bytes) 2024-09-21T22:01:06.512 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.513 INFO:teuthology.orchestra.run.smithi102.stdout:933 write 0x1429a2d thru 0x142f14e (0x5722 bytes) 2024-09-21T22:01:06.517 INFO:teuthology.orchestra.run.smithi102.stdout:934 trunc from 0x461dca3 to 0x17f74b4 2024-09-21T22:01:06.523 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:06.521+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:06.549 INFO:teuthology.orchestra.run.smithi102.stdout:935 write 0xb650a1c thru 0xb6562ee (0x58d3 bytes) 2024-09-21T22:01:06.552 INFO:teuthology.orchestra.run.smithi102.stdout:936 read 0x59f6f92 thru 0x59fbc8b (0x4cfa bytes) 2024-09-21T22:01:06.561 INFO:teuthology.orchestra.run.smithi102.stdout:937 writesame 0xd75b2ac thru 0xd75f549 data_size 0x1(0x429e bytes) 2024-09-21T22:01:06.561 INFO:teuthology.orchestra.run.smithi102.stdout:938 read 0x841a7ef thru 0x841f0b2 (0x48c4 bytes) 2024-09-21T22:01:06.561 INFO:teuthology.orchestra.run.smithi102.stdout:939 write 0xfecd7d thru 0xff6d61 (0x9fe5 bytes) 2024-09-21T22:01:06.562 INFO:teuthology.orchestra.run.smithi102.stdout:940 read 0x31ffe00 thru 0x3202674 (0x2875 bytes) 2024-09-21T22:01:06.562 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.562 INFO:teuthology.orchestra.run.smithi102.stdout:944 punch from 0x880736 to 0x88e903, (0xe1cd bytes) 2024-09-21T22:01:06.563 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.563 INFO:teuthology.orchestra.run.smithi102.stdout:949 write 0x66431a1 thru 0x6647c6a (0x4aca bytes) 2024-09-21T22:01:06.565 INFO:teuthology.orchestra.run.smithi102.stdout:950 punch from 0x6f9c1ed to 0x6fa1d89, (0x5b9c bytes) 2024-09-21T22:01:06.565 INFO:teuthology.orchestra.run.smithi102.stdout:951 write 0x2c7657a thru 0x2c76a20 (0x4a7 bytes) 2024-09-21T22:01:06.567 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.567 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.567 INFO:teuthology.orchestra.run.smithi102.stdout:955 write 0x9940f9b thru 0x9946a61 (0x5ac7 bytes) 2024-09-21T22:01:06.570 INFO:teuthology.orchestra.run.smithi102.stdout:956 punch from 0xcd1bf4a to 0xcd200ac, (0x4162 bytes) 2024-09-21T22:01:06.574 INFO:teuthology.orchestra.run.smithi102.stdout:957 trunc from 0xd75f54a to 0x9e54c37 2024-09-21T22:01:06.584 INFO:teuthology.orchestra.run.smithi102.stdout:958 trunc from 0x9e54c37 to 0x860fec4 2024-09-21T22:01:06.602 INFO:teuthology.orchestra.run.smithi102.stdout:959 trunc from 0x860fec4 to 0x35e90c0 2024-09-21T22:01:06.613 INFO:teuthology.orchestra.run.smithi102.stdout:960 read 0x2bae847 thru 0x2bb3484 (0x4c3e bytes) 2024-09-21T22:01:06.617 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:06.617 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:06.624 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:06.622+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:06.627 INFO:teuthology.orchestra.run.smithi102.stdout:961 write 0x9d68629 thru 0x9d75f70 (0xd948 bytes) 2024-09-21T22:01:06.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:06.630 INFO:teuthology.orchestra.run.smithi102.stdout:962 read 0x2482264 thru 0x2485112 (0x2eaf bytes) 2024-09-21T22:01:06.631 INFO:teuthology.orchestra.run.smithi102.stdout:963 write 0x482898c thru 0x4830d2f (0x83a4 bytes) 2024-09-21T22:01:06.634 INFO:teuthology.orchestra.run.smithi102.stdout:966 write 0x47cd95b thru 0x47db83b (0xdee1 bytes) 2024-09-21T22:01:06.647 INFO:teuthology.orchestra.run.smithi102.stdout:969 trunc from 0x9d75f71 to 0x1720ad1 2024-09-21T22:01:06.663 INFO:teuthology.orchestra.run.smithi102.stdout:971 punch from 0x10d75b8 to 0x10dc2b5, (0x4cfd bytes) 2024-09-21T22:01:06.663 INFO:teuthology.orchestra.run.smithi102.stdout:972 read 0xbc986b thru 0xbd33ff (0x9b95 bytes) 2024-09-21T22:01:06.663 INFO:teuthology.orchestra.run.smithi102.stdout:974 writesame 0x1294806 thru 0x1299c33 data_size 0x19(0x542e bytes) 2024-09-21T22:01:06.664 INFO:teuthology.orchestra.run.smithi102.stdout:975 read 0x90a513 thru 0x90d223 (0x2d11 bytes) 2024-09-21T22:01:06.681 INFO:teuthology.orchestra.run.smithi102.stdout:976 write 0xa5e4ac1 thru 0xa5e6329 (0x1869 bytes) 2024-09-21T22:01:06.684 INFO:teuthology.orchestra.run.smithi102.stdout:978 write 0x742113c thru 0x7427f53 (0x6e18 bytes) 2024-09-21T22:01:06.702 INFO:teuthology.orchestra.run.smithi102.stdout:979 writesame 0xdd751e0 thru 0xdd75753 data_size 0x2(0x574 bytes) 2024-09-21T22:01:06.702 INFO:teuthology.orchestra.run.smithi102.stdout:980 read 0x10f138c thru 0x10fe037 (0xccac bytes) 2024-09-21T22:01:06.702 INFO:teuthology.orchestra.run.smithi102.stdout:981 read 0xd4cf61e thru 0xd4d4cd7 (0x56ba bytes) 2024-09-21T22:01:06.702 INFO:teuthology.orchestra.run.smithi102.stdout:983 punch from 0x847d9cb to 0x8489d46, (0xc37b bytes) 2024-09-21T22:01:06.708 INFO:teuthology.orchestra.run.smithi102.stdout:984 trunc from 0xdd75754 to 0x89bb1c7 2024-09-21T22:01:06.713 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T22:01:06.723 INFO:teuthology.orchestra.run.smithi102.stdout:986 write 0x4e1a7fb thru 0x4e288e2 (0xe0e8 bytes) 2024-09-21T22:01:06.724 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:06.722+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:06.727 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:01:06.729 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T22:01:06.729 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:06.733 INFO:teuthology.orchestra.run.smithi102.stdout:988 trunc from 0x89bb1c7 to 0x448ccb2 2024-09-21T22:01:06.745 INFO:teuthology.orchestra.run.smithi102.stdout:989 read 0x1471e27 thru 0x147a2ec (0x84c6 bytes) 2024-09-21T22:01:06.745 INFO:teuthology.orchestra.run.smithi102.stdout:991 read 0x19b4e99 thru 0x19bc3fc (0x7564 bytes) 2024-09-21T22:01:06.755 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:06.755 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:06.759 INFO:teuthology.orchestra.run.smithi102.stdout:992 writesame 0xa834728 thru 0xa83696d data_size 0x29(0x2246 bytes) 2024-09-21T22:01:06.759 INFO:teuthology.orchestra.run.smithi102.stdout:996 read 0x431d73e thru 0x43294b0 (0xbd73 bytes) 2024-09-21T22:01:06.759 INFO:teuthology.orchestra.run.smithi102.stdout:997 read 0x7da3bf8 thru 0x7dacb84 (0x8f8d bytes) 2024-09-21T22:01:06.759 INFO:teuthology.orchestra.run.smithi102.stdout:998 write 0x6b1eced thru 0x6b2847f (0x9793 bytes) 2024-09-21T22:01:06.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:06.770 INFO:teuthology.orchestra.run.smithi102.stdout:999 write 0xadcf441 thru 0xaddec98 (0xf858 bytes) 2024-09-21T22:01:06.777 INFO:teuthology.orchestra.run.smithi102.stdout:1001 trunc from 0xaddec99 to 0x7b9fbfa 2024-09-21T22:01:06.792 INFO:teuthology.orchestra.run.smithi102.stdout:1002 read 0x5d89765 thru 0x5d8d84b (0x40e7 bytes) 2024-09-21T22:01:06.792 INFO:teuthology.orchestra.run.smithi102.stdout:1003 clone 7 order 19 su 16384 sc 2 2024-09-21T22:01:06.825 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:06.824+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:06.880 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:06.880 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:06.889 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:06.932 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:06.930+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:07.026 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:07.024+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:07.036 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:07.036 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:07.045 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:07.129 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:07.127+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:07.188 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:07.188 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:07.197 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:07.228 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:07.227+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:07.329 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:07.327+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:07.339 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:07.340 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:07.348 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:07.433 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:07.431+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:07.492 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:07.492 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:07.501 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:07.542 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:07.540+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:07.631 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:07.630+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:07.643 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:07.643 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:07.652 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:01:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T22:01:07.732 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:07.730+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:07.734 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T22:01:07.763 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:07.763 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:07.772 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:07.793 INFO:teuthology.orchestra.run.smithi102.stdout:flattening image image_client.0-clone6 2024-09-21T22:01:07.833 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:07.831+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:07.877 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:07.878 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:07.887 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:07.901 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-21T22:01:07.934 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:07.932+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:07.977 INFO:teuthology.orchestra.run.smithi102.stdout:1004 writesame 0xac9a133 thru 0xaca4df0 data_size 0x1(0xacbe bytes) 2024-09-21T22:01:07.977 INFO:teuthology.orchestra.run.smithi102.stdout:1005 read 0x8397df6 thru 0x83a1577 (0x9782 bytes) 2024-09-21T22:01:07.977 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:07.978 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:07.983 INFO:teuthology.orchestra.run.smithi102.stdout:1008 writesame 0xb3f7677 thru 0xb402193 data_size 0x1(0xab1d bytes) 2024-09-21T22:01:07.983 INFO:teuthology.orchestra.run.smithi102.stdout:1009 write 0x2a10262 thru 0x2a19f74 (0x9d13 bytes) 2024-09-21T22:01:07.990 INFO:teuthology.orchestra.run.smithi102.stdout:1010 read 0x87f0a89 thru 0x87fa7fb (0x9d73 bytes) 2024-09-21T22:01:07.990 INFO:teuthology.orchestra.run.smithi102.stdout:1013 punch from 0x410d8eb to 0x4115f3d, (0x8652 bytes) 2024-09-21T22:01:07.990 INFO:teuthology.orchestra.run.smithi102.stdout:1014 read 0xaee62c3 thru 0xaeebd87 (0x5ac5 bytes) 2024-09-21T22:01:07.990 INFO:teuthology.orchestra.run.smithi102.stdout:1015 write 0x9b2c7b9 thru 0x9b32e01 (0x6649 bytes) 2024-09-21T22:01:07.993 INFO:teuthology.orchestra.run.smithi102.stdout:1017 write 0xb3b8e51 thru 0xb3bb494 (0x2644 bytes) 2024-09-21T22:01:07.996 INFO:teuthology.orchestra.run.smithi102.stdout:1018 read 0x18d43e1 thru 0x18d9ef1 (0x5b11 bytes) 2024-09-21T22:01:07.997 INFO:teuthology.orchestra.run.smithi102.stdout:1019 punch from 0x145f82b to 0x14638e5, (0x40ba bytes) 2024-09-21T22:01:07.997 INFO:teuthology.orchestra.run.smithi102.stdout:1020 write 0x57485cc thru 0x57563fd (0xde32 bytes) 2024-09-21T22:01:08.010 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.010 INFO:teuthology.orchestra.run.smithi102.stdout:1022 read 0xbfee9f thru 0xc0cbb6 (0xdd18 bytes) 2024-09-21T22:01:08.011 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.011 INFO:teuthology.orchestra.run.smithi102.stdout:1024 write 0x91f3982 thru 0x9200455 (0xcad4 bytes) 2024-09-21T22:01:08.029 INFO:teuthology.orchestra.run.smithi102.stdout:1027 writesame 0x9359da2 thru 0x935c7d9 data_size 0x1c(0x2a38 bytes) 2024-09-21T22:01:08.035 INFO:teuthology.orchestra.run.smithi102.stdout:1028 write 0x81a1193 thru 0x81ae974 (0xd7e2 bytes) 2024-09-21T22:01:08.035 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:08.033+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:08.041 INFO:teuthology.orchestra.run.smithi102.stdout:1029 write 0x25abda5 thru 0x25b9e76 (0xe0d2 bytes) 2024-09-21T22:01:08.046 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:08.046 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:08.055 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:08.056 INFO:teuthology.orchestra.run.smithi102.stdout:1031 trunc from 0xb402194 to 0x43b490d 2024-09-21T22:01:08.088 INFO:teuthology.orchestra.run.smithi102.stdout:1032 trunc from 0x43b490d to 0xe30fac1 2024-09-21T22:01:08.093 INFO:teuthology.orchestra.run.smithi102.stdout:1033 trunc from 0xe30fac1 to 0xdd49bd6 2024-09-21T22:01:08.099 INFO:teuthology.orchestra.run.smithi102.stdout:1034 write 0xc5bd4e4 thru 0xc5c498b (0x74a8 bytes) 2024-09-21T22:01:08.105 INFO:teuthology.orchestra.run.smithi102.stdout:1035 writesame 0x39190b7 thru 0x391a7d4 data_size 0xb(0x171e bytes) 2024-09-21T22:01:08.122 INFO:teuthology.orchestra.run.smithi102.stdout:1037 trunc from 0xdd49bd6 to 0x2ad6c9c 2024-09-21T22:01:08.133 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.133 INFO:teuthology.orchestra.run.smithi102.stdout:1040 writesame 0x5bf12d thru 0x5bf432 data_size 0x3(0x306 bytes) 2024-09-21T22:01:08.135 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:08.133+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:08.138 INFO:teuthology.orchestra.run.smithi102.stdout:1041 punch from 0x638a28 to 0x646261, (0xd839 bytes) 2024-09-21T22:01:08.138 INFO:teuthology.orchestra.run.smithi102.stdout:1042 read 0x27b790b thru 0x27c253f (0xac35 bytes) 2024-09-21T22:01:08.159 INFO:teuthology.orchestra.run.smithi102.stdout:1044 write 0xdf1bc4d thru 0xdf293c3 (0xd777 bytes) 2024-09-21T22:01:08.162 INFO:teuthology.orchestra.run.smithi102.stdout:1045 read 0x83e6c04 thru 0x83efbae (0x8fab bytes) 2024-09-21T22:01:08.162 INFO:teuthology.orchestra.run.smithi102.stdout:1046 read 0x2de45e4 thru 0x2dec026 (0x7a43 bytes) 2024-09-21T22:01:08.162 INFO:teuthology.orchestra.run.smithi102.stdout:1047 write 0xcf842e7 thru 0xcf8e585 (0xa29f bytes) 2024-09-21T22:01:08.167 INFO:teuthology.orchestra.run.smithi102.stdout:1048 read 0xbd8dd54 thru 0xbd9b3c6 (0xd673 bytes) 2024-09-21T22:01:08.167 INFO:teuthology.orchestra.run.smithi102.stdout:1049 punch from 0x70480d4 to 0x7053dc0, (0xbcec bytes) 2024-09-21T22:01:08.167 INFO:teuthology.orchestra.run.smithi102.stdout:1051 punch from 0xabf6989 to 0xabfb050, (0x46c7 bytes) 2024-09-21T22:01:08.167 INFO:teuthology.orchestra.run.smithi102.stdout:1052 write 0x6e98f8f thru 0x6ea39ab (0xaa1d bytes) 2024-09-21T22:01:08.170 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:08.170 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:08.179 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:08.187 INFO:teuthology.orchestra.run.smithi102.stdout:1055 trunc from 0xdf293c4 to 0x21d6582 2024-09-21T22:01:08.222 INFO:teuthology.orchestra.run.smithi102.stdout:1056 trunc from 0x21d6582 to 0xddbc0ed 2024-09-21T22:01:08.227 INFO:teuthology.orchestra.run.smithi102.stdout:1057 read 0x9c688f thru 0x9c9d26 (0x3498 bytes) 2024-09-21T22:01:08.228 INFO:teuthology.orchestra.run.smithi102.stdout:1058 read 0x19c318b thru 0x19cddd2 (0xac48 bytes) 2024-09-21T22:01:08.231 INFO:teuthology.orchestra.run.smithi102.stdout:1059 write 0x277238e thru 0x277b776 (0x93e9 bytes) 2024-09-21T22:01:08.236 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:08.234+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:08.239 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.240 INFO:teuthology.orchestra.run.smithi102.stdout:1062 writesame 0x4d8adfe thru 0x4d92f09 data_size 0x6(0x810c bytes) 2024-09-21T22:01:08.256 INFO:teuthology.orchestra.run.smithi102.stdout:1063 trunc from 0xddbc0ed to 0x6e7d390 2024-09-21T22:01:08.268 INFO:teuthology.orchestra.run.smithi102.stdout:1064 write 0x7263063 thru 0x7269601 (0x659f bytes) 2024-09-21T22:01:08.271 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:08.273 INFO:teuthology.orchestra.run.smithi102.stdout:1065 read 0x2127dda thru 0x2129427 (0x164e bytes) 2024-09-21T22:01:08.273 INFO:teuthology.orchestra.run.smithi102.stdout:1066 write 0x5541bc0 thru 0x55446dd (0x2b1e bytes) 2024-09-21T22:01:08.279 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.279 INFO:teuthology.orchestra.run.smithi102.stdout:1068 write 0xb9d5e8 thru 0xba6a35 (0x944e bytes) 2024-09-21T22:01:08.283 INFO:teuthology.orchestra.run.smithi102.stdout:1070 write 0x599999d thru 0x59a6249 (0xc8ad bytes) 2024-09-21T22:01:08.287 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.290 INFO:teuthology.orchestra.run.smithi102.stdout:1072 trunc from 0x7269602 to 0x9d2d103 2024-09-21T22:01:08.294 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:08.294 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:08.295 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.295 INFO:teuthology.orchestra.run.smithi102.stdout:1074 punch from 0x17e2277 to 0x17e8cbb, (0x6a44 bytes) 2024-09-21T22:01:08.300 INFO:teuthology.orchestra.run.smithi102.stdout:1075 trunc from 0x9d2d103 to 0xdd8f774 2024-09-21T22:01:08.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:08.305 INFO:teuthology.orchestra.run.smithi102.stdout:1076 read 0xa11a881 thru 0xa1261a7 (0xb927 bytes) 2024-09-21T22:01:08.305 INFO:teuthology.orchestra.run.smithi102.stdout:1077 punch from 0x9f0480b to 0x9f05a6f, (0x1264 bytes) 2024-09-21T22:01:08.305 INFO:teuthology.orchestra.run.smithi102.stdout:1078 write 0x6d65416 thru 0x6d6ffce (0xabb9 bytes) 2024-09-21T22:01:08.311 INFO:teuthology.orchestra.run.smithi102.stdout:1079 trunc from 0xdd8f774 to 0xca327e1 2024-09-21T22:01:08.316 INFO:teuthology.orchestra.run.smithi102.stdout:1080 read 0x145b930 thru 0x146066c (0x4d3d bytes) 2024-09-21T22:01:08.317 INFO:teuthology.orchestra.run.smithi102.stdout:1082 write 0x8aae72 thru 0x8b7f86 (0xd115 bytes) 2024-09-21T22:01:08.330 INFO:teuthology.orchestra.run.smithi102.stdout:1083 read 0xa3c0047 thru 0xa3ceff8 (0xefb2 bytes) 2024-09-21T22:01:08.330 INFO:teuthology.orchestra.run.smithi102.stdout:1084 writesame 0x4f137f8 thru 0x4f15e77 data_size 0xe(0x2680 bytes) 2024-09-21T22:01:08.338 INFO:teuthology.orchestra.run.smithi102.stdout:1085 write 0x4094b12 thru 0x4099916 (0x4e05 bytes) 2024-09-21T22:01:08.342 INFO:teuthology.orchestra.run.smithi102.stdout:1086 read 0x8e8e0ed thru 0x8e9cdd9 (0xeced bytes) 2024-09-21T22:01:08.347 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:08.345+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:08.348 INFO:teuthology.orchestra.run.smithi102.stdout:1087 writesame 0xd5bc44b thru 0xd5bdd17 data_size 0x1(0x18cd bytes) 2024-09-21T22:01:08.348 INFO:teuthology.orchestra.run.smithi102.stdout:1088 punch from 0x256f59 to 0x2581f0, (0x1297 bytes) 2024-09-21T22:01:08.349 INFO:teuthology.orchestra.run.smithi102.stdout:1089 writesame 0x801d639 thru 0x8020154 data_size 0x3e(0x2b1c bytes) 2024-09-21T22:01:08.360 INFO:teuthology.orchestra.run.smithi102.stdout:1090 trunc from 0xd5bdd18 to 0x7e136a2 2024-09-21T22:01:08.376 INFO:teuthology.orchestra.run.smithi102.stdout:1091 trunc from 0x7e136a2 to 0xc7e9308 2024-09-21T22:01:08.393 INFO:teuthology.orchestra.run.smithi102.stdout:1093 trunc from 0xc7e9308 to 0x2a1773f 2024-09-21T22:01:08.405 INFO:teuthology.orchestra.run.smithi102.stdout:1095 writesame 0x21812ad thru 0x2186d0a data_size 0x2(0x5a5e bytes) 2024-09-21T22:01:08.411 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.411 INFO:teuthology.orchestra.run.smithi102.stdout:1098 read 0x627477 thru 0x62d06b (0x5bf5 bytes) 2024-09-21T22:01:08.419 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:08.419 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:08.422 INFO:teuthology.orchestra.run.smithi102.stdout:1099 writesame 0x4580e40 thru 0x4590136 data_size 0x3(0xf2f7 bytes) 2024-09-21T22:01:08.422 INFO:teuthology.orchestra.run.smithi102.stdout:1102 read 0x347b641 thru 0x3488aa7 (0xd467 bytes) 2024-09-21T22:01:08.423 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:08.423 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:08.428 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:08.436 INFO:teuthology.orchestra.run.smithi102.stdout:1103 write 0xa77869c thru 0xa77d867 (0x51cc bytes) 2024-09-21T22:01:08.446 INFO:teuthology.orchestra.run.smithi102.stdout:1106 writesame 0xb7fa47d thru 0xb802709 data_size 0x1(0x828d bytes) 2024-09-21T22:01:08.446 INFO:teuthology.orchestra.run.smithi102.stdout:1107 writesame 0x777faf5 thru 0x7784bc0 data_size 0x2(0x50cc bytes) 2024-09-21T22:01:08.448 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:08.448 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:08.452 INFO:teuthology.orchestra.run.smithi102.stdout:1108 read 0x28aa6fb thru 0x28abe74 (0x177a bytes) 2024-09-21T22:01:08.453 INFO:teuthology.orchestra.run.smithi102.stdout:1110 write 0x114d821 thru 0x115c7a0 (0xef80 bytes) 2024-09-21T22:01:08.459 INFO:teuthology.orchestra.run.smithi102.stdout:1111 punch from 0x3ed50d to 0x3f9ce0, (0xc7d3 bytes) 2024-09-21T22:01:08.459 INFO:teuthology.orchestra.run.smithi102.stdout:1113 punch from 0xae61d7f to 0xae6ceac, (0xb12d bytes) 2024-09-21T22:01:08.459 INFO:teuthology.orchestra.run.smithi102.stdout:1114 read 0x52dbfc2 thru 0x52eb5f0 (0xf62f bytes) 2024-09-21T22:01:08.470 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:08.468+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:08.473 INFO:teuthology.orchestra.run.smithi102.stdout:1117 trunc from 0xb80270a to 0xd51cb5 2024-09-21T22:01:08.474 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:08.474 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:08.493 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:08.493 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:08.497 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.497 INFO:teuthology.orchestra.run.smithi102.stdout:1120 read 0xa177b thru 0xa4834 (0x30ba bytes) 2024-09-21T22:01:08.498 INFO:teuthology.orchestra.run.smithi102.stdout:1121 read 0x89f976 thru 0x8a653b (0x6bc6 bytes) 2024-09-21T22:01:08.502 INFO:teuthology.orchestra.run.smithi102.stdout:1123 trunc from 0xd51cb5 to 0x2a74140 2024-09-21T22:01:08.511 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:08.513 INFO:teuthology.orchestra.run.smithi102.stdout:1124 write 0x6b05bc thru 0x6c027b (0xfcc0 bytes) 2024-09-21T22:01:08.525 INFO:teuthology.orchestra.run.smithi102.stdout:1126 trunc from 0x2a74140 to 0xb44108f 2024-09-21T22:01:08.530 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:08.530 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:08.538 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:08.536+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:08.540 INFO:teuthology.orchestra.run.smithi102.stdout:1127 trunc from 0xb44108f to 0x2b0dd7a 2024-09-21T22:01:08.546 INFO:teuthology.orchestra.run.smithi102.stdout:1128 punch from 0x209e03d to 0x20a251c, (0x44df bytes) 2024-09-21T22:01:08.546 INFO:teuthology.orchestra.run.smithi102.stdout:1129 read 0x1ba93d9 thru 0x1bb0ecc (0x7af4 bytes) 2024-09-21T22:01:08.548 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:08.548 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:08.555 INFO:teuthology.orchestra.run.smithi102.stdout:1131 write 0x667b9f1 thru 0x6687f81 (0xc591 bytes) 2024-09-21T22:01:08.567 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:08.567 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:08.567 INFO:teuthology.orchestra.run.smithi102.stdout:1134 trunc from 0x6687f82 to 0x256875d 2024-09-21T22:01:08.582 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:08.582 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:08.582 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:08.582 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:08.591 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:08.593 INFO:teuthology.orchestra.run.smithi102.stdout:1136 write 0xa132c50 thru 0xa133413 (0x7c4 bytes) 2024-09-21T22:01:08.609 INFO:teuthology.orchestra.run.smithi102.stdout:1137 trunc from 0xa133414 to 0x86f87 2024-09-21T22:01:08.648 INFO:teuthology.orchestra.run.smithi102.stdout:1138 write 0xe9718e5 thru 0xe97861a (0x6d36 bytes) 2024-09-21T22:01:08.658 INFO:teuthology.orchestra.run.smithi102.stdout:1139 read 0x2d15c6a thru 0x2d21dc8 (0xc15f bytes) 2024-09-21T22:01:08.673 INFO:teuthology.orchestra.run.smithi102.stdout:1140 trunc from 0xe97861b to 0x1ba80b5 2024-09-21T22:01:08.675 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:08.674+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:08.687 INFO:teuthology.orchestra.run.smithi102.stdout:1142 read 0x13e3d6b thru 0x13f1662 (0xd8f8 bytes) 2024-09-21T22:01:08.687 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.687 INFO:teuthology.orchestra.run.smithi102.stdout:1144 read 0xa683e0 thru 0xa6c11f (0x3d40 bytes) 2024-09-21T22:01:08.687 INFO:teuthology.orchestra.run.smithi102.stdout:1147 read 0x9b7fc7 thru 0x9b8a33 (0xa6d bytes) 2024-09-21T22:01:08.687 INFO:teuthology.orchestra.run.smithi102.stdout:1148 read 0x5bbd76 thru 0x5c64dc (0xa767 bytes) 2024-09-21T22:01:08.687 INFO:teuthology.orchestra.run.smithi102.stdout:1149 read 0x17bc6c0 thru 0x17c8051 (0xb992 bytes) 2024-09-21T22:01:08.688 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.688 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.688 INFO:teuthology.orchestra.run.smithi102.stdout:1156 read 0x44307e thru 0x449e3d (0x6dc0 bytes) 2024-09-21T22:01:08.699 INFO:teuthology.orchestra.run.smithi102.stdout:1158 trunc from 0x1ba80b5 to 0xb984e40 2024-09-21T22:01:08.704 INFO:teuthology.orchestra.run.smithi102.stdout:1159 punch from 0x39ca035 to 0x39d00fb, (0x60c6 bytes) 2024-09-21T22:01:08.705 INFO:teuthology.orchestra.run.smithi102.stdout:1160 punch from 0xb1817f7 to 0xb18ed8a, (0xd593 bytes) 2024-09-21T22:01:08.705 INFO:teuthology.orchestra.run.smithi102.stdout:1161 punch from 0x1d427a to 0x1d7663, (0x33e9 bytes) 2024-09-21T22:01:08.705 INFO:teuthology.orchestra.run.smithi102.stdout:1162 punch from 0x6bb753f to 0x6bbf767, (0x8228 bytes) 2024-09-21T22:01:08.717 INFO:teuthology.orchestra.run.smithi102.stdout:1163 trunc from 0xb984e40 to 0xb9ec63 2024-09-21T22:01:08.722 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T22:01:08.728 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.729 INFO:teuthology.orchestra.run.smithi102.stdout:1166 trunc from 0xb9ec63 to 0x3563ac 2024-09-21T22:01:08.739 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:08.737+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:08.739 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:08.740 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:08.740 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:08.740 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:08.740 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:08.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T22:01:08.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:08.755 INFO:teuthology.orchestra.run.smithi102.stdout:1167 write 0xcd95cba thru 0xcd96a1a (0xd61 bytes) 2024-09-21T22:01:08.760 INFO:teuthology.orchestra.run.smithi102.stdout:1168 read 0xb5f1b5a thru 0xb5fa694 (0x8b3b bytes) 2024-09-21T22:01:08.760 INFO:teuthology.orchestra.run.smithi102.stdout:1170 write 0xc88abe1 thru 0xc89326d (0x868d bytes) 2024-09-21T22:01:08.779 INFO:teuthology.orchestra.run.smithi102.stdout:1171 trunc from 0xcd96a1b to 0x237abcd 2024-09-21T22:01:08.800 INFO:teuthology.orchestra.run.smithi102.stdout:1172 write 0x8554e91 thru 0x85558a9 (0xa19 bytes) 2024-09-21T22:01:08.803 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.804 INFO:teuthology.orchestra.run.smithi102.stdout:1174 read 0x1d905ad thru 0x1d9edcf (0xe823 bytes) 2024-09-21T22:01:08.812 INFO:teuthology.orchestra.run.smithi102.stdout:1175 writesame 0xb46d91c thru 0xb4775a0 data_size 0x1(0x9c85 bytes) 2024-09-21T22:01:08.812 INFO:teuthology.orchestra.run.smithi102.stdout:1177 punch from 0x9ba7579 to 0x9bb5bd1, (0xe658 bytes) 2024-09-21T22:01:08.813 INFO:teuthology.orchestra.run.smithi102.stdout:1178 trunc from 0xb4775a1 to 0xc5ad611 2024-09-21T22:01:08.828 INFO:teuthology.orchestra.run.smithi102.stdout:1179 trunc from 0xc5ad611 to 0x450fda7 2024-09-21T22:01:08.840 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:08.838+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:08.848 INFO:teuthology.orchestra.run.smithi102.stdout:1180 writesame 0x9376704 thru 0x937c8fd data_size 0x1(0x61fa bytes) 2024-09-21T22:01:08.848 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.848 INFO:teuthology.orchestra.run.smithi102.stdout:1183 writesame 0x7822dbb thru 0x7826bc1 data_size 0x3(0x3e07 bytes) 2024-09-21T22:01:08.854 INFO:teuthology.orchestra.run.smithi102.stdout:1184 writesame 0x4c299cf thru 0x4c36adf data_size 0x17(0xd111 bytes) 2024-09-21T22:01:08.858 INFO:teuthology.orchestra.run.smithi102.stdout:1185 write 0x6f6a812 thru 0x6f782fa (0xdae9 bytes) 2024-09-21T22:01:08.862 INFO:teuthology.orchestra.run.smithi102.stdout:1186 read 0x24ec644 thru 0x24efba5 (0x3562 bytes) 2024-09-21T22:01:08.862 INFO:teuthology.orchestra.run.smithi102.stdout:1187 write 0xdf8bb0 thru 0xdfe1cc (0x561d bytes) 2024-09-21T22:01:08.870 INFO:teuthology.orchestra.run.smithi102.stdout:1189 trunc from 0x937c8fe to 0x5f84606 2024-09-21T22:01:08.888 INFO:teuthology.orchestra.run.smithi102.stdout:1190 write 0x829fefb thru 0x82af2b2 (0xf3b8 bytes) 2024-09-21T22:01:08.894 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.894 INFO:teuthology.orchestra.run.smithi102.stdout:1192 write 0x4c26cca thru 0x4c33bab (0xcee2 bytes) 2024-09-21T22:01:08.896 INFO:teuthology.orchestra.run.smithi102.stdout:1194 punch from 0x459c6c8 to 0x45a1cae, (0x55e6 bytes) 2024-09-21T22:01:08.896 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:08.896 INFO:teuthology.orchestra.run.smithi102.stdout:1196 clone 8 order 18 su 65536 sc 3 2024-09-21T22:01:08.902 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:08.902 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:08.902 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:08.902 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:08.902 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.902 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:12 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:08.902 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.189175+0000", 2024-09-21T22:01:08.902 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.711092325999999, 2024-09-21T22:01:08.902 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0025887610000000002, 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 12 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189175+0000", 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.903 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189175+0000", 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189176+0000", 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.319e-06 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189182+0000", 2024-09-21T22:01:08.904 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4399999999999996e-06 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189189+0000", 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9270000000000005e-06 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189196+0000", 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5400000000000001e-06 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189255+0000", 2024-09-21T22:01:08.905 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8839999999999999e-05 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.189261+0000", 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6710000000000004e-06 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.190669+0000", 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.001408732 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.906 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.190775+0000", 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000105936 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.190910+0000", 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000134671 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191489+0000", 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00057885 2024-09-21T22:01:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191700+0000", 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00021092100000000001 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191732+0000", 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2592000000000002e-05 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191764+0000", 2024-09-21T22:01:08.908 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1322000000000003e-05 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop_reply(client.4388.0:12 3.a e26/23 ondisk, result = 0)", 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.191637+0000", 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.708630442, 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013295599999999999, 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.909 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191637+0000", 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191637+0000", 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191637+0000", 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1800000000000005e-07 2024-09-21T22:01:08.910 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191641+0000", 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8600000000000003e-06 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191650+0000", 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8559999999999996e-06 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191658+0000", 2024-09-21T22:01:08.911 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4730000000000003e-06 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191692+0000", 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4267999999999998e-05 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191696+0000", 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.549e-06 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.191770+0000", 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3132000000000004e-05 2024-09-21T22:01:08.912 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:16 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.200109+0000", 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.700158454, 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00028054300000000001, 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:08.913 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 16 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200109+0000", 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200109+0000", 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.914 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200110+0000", 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9999999999999996e-07 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200115+0000", 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0479999999999998e-06 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200125+0000", 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.039e-05 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.915 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200131+0000", 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6919999999999999e-06 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200182+0000", 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1459000000000003e-05 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200237+0000", 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4395999999999999e-05 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.916 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200389+0000", 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015265799999999999 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:17 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.200495+0000", 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.699772068, 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018783299999999999, 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:08.917 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 17 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200495+0000", 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.918 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200495+0000", 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200496+0000", 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200499+0000", 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9960000000000002e-06 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.919 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200506+0000", 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6890000000000004e-06 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200511+0000", 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.848e-06 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200552+0000", 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0710999999999997e-05 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.920 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200603+0000", 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1471000000000002e-05 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200683+0000", 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9550999999999998e-05 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.921 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:18 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call,call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.200773+0000", 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.69949418, 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00016977999999999999, 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 18 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.922 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200773+0000", 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200773+0000", 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200774+0000", 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1799999999999995e-07 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.923 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200777+0000", 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5099999999999999e-06 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200783+0000", 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3759999999999996e-06 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200787+0000", 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7529999999999999e-06 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.924 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200814+0000", 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6842000000000002e-05 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200858+0000", 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3949000000000002e-05 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.200943+0000", 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.925 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:19 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.201025+0000", 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.699242245000001, 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000148548, 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 19 2024-09-21T22:01:08.926 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201025+0000", 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201025+0000", 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201026+0000", 2024-09-21T22:01:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5700000000000002e-07 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201028+0000", 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8399999999999999e-06 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201034+0000", 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9859999999999999e-06 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201038+0000", 2024-09-21T22:01:08.928 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5279999999999999e-06 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201066+0000", 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7715000000000001e-05 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201108+0000", 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1986000000000001e-05 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201173+0000", 2024-09-21T22:01:08.929 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5835999999999998e-05 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:20 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.201536+0000", 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.698731161, 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00053722700000000004, 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:08.930 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 20 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201536+0000", 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201536+0000", 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.931 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201537+0000", 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.04e-06 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201543+0000", 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8039999999999998e-06 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201558+0000", 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5109000000000001e-05 2024-09-21T22:01:08.932 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201585+0000", 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6889999999999998e-05 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201652+0000", 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6835000000000006e-05 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.201775+0000", 2024-09-21T22:01:08.933 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012348700000000001 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202073+0000", 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029806199999999998 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:21 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.202228+0000", 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.698039228000001, 2024-09-21T22:01:08.934 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000246825, 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 21 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202228+0000", 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.935 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202228+0000", 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202229+0000", 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7300000000000005e-07 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202234+0000", 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0869999999999997e-06 2024-09-21T22:01:08.936 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202246+0000", 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1761e-05 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202251+0000", 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202294+0000", 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2846000000000003e-05 2024-09-21T22:01:08.937 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202336+0000", 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.227e-05 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202475+0000", 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000138727 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.938 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:22 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.202574+0000", 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.697693352, 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015582700000000001, 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 22 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.939 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202574+0000", 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202574+0000", 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202574+0000", 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3099999999999997e-07 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.940 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202578+0000", 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1269999999999999e-06 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202584+0000", 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7580000000000003e-06 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202588+0000", 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8800000000000001e-06 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.941 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202617+0000", 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8912999999999999e-05 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202658+0000", 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0837000000000002e-05 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.202730+0000", 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1680999999999994e-05 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.942 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:24 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.203353+0000", 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.696914069, 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00020157899999999999, 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 24 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.943 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203353+0000", 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203353+0000", 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203354+0000", 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4300000000000003e-07 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.944 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203358+0000", 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3279999999999999e-06 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203367+0000", 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9619999999999999e-06 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203371+0000", 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3229999999999999e-06 2024-09-21T22:01:08.945 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203413+0000", 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1999000000000002e-05 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203459+0000", 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6202000000000003e-05 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203555+0000", 2024-09-21T22:01:08.946 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.5122000000000002e-05 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:25 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [watch watch cookie 140678969439376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.203732+0000", 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.696534856, 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00095077200000000001, 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:08.947 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 25 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203732+0000", 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203732+0000", 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.948 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203733+0000", 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9999999999999997e-07 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203735+0000", 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6299999999999998e-06 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203742+0000", 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.348e-06 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.949 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203746+0000", 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9400000000000004e-06 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203773+0000", 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7200999999999999e-05 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203816+0000", 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3337000000000002e-05 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.950 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.203905+0000", 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8727999999999995e-05 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204365+0000", 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000459634 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204563+0000", 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000197927 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.951 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204616+0000", 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3794e-05 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204683+0000", 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6632999999999997e-05 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop_reply(client.4388.0:25 3.a e26/23 ondisk, result = 0)", 2024-09-21T22:01:08.952 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:56.204485+0000", 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.695782244, 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00020383599999999999, 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204485+0000", 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:08.953 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204485+0000", 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204486+0000", 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999999e-07 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204489+0000", 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8249999999999998e-06 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:08.954 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204499+0000", 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1400000000000006e-06 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204503+0000", 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204547+0000", 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3426000000000001e-05 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:08.955 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204555+0000", 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7819999999999999e-06 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:56.204689+0000", 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013329300000000001 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:08.956 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:08.958 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:08.958 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:08.956+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:09.058 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:09.056+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:09.101 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:09.101 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:09.101 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:09.101 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:09.110 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:09.159 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:09.157+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:09.254 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:09.254 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:09.254 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:09.254 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:09.254 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:09.259 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:09.258+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:09.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:09.360 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:09.358+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 31.292968247000001, 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.369 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:01:09.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:01:09.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:01:09.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 31.008472954999998, 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099026370000000006, 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.376 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 36 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357877+0000", 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357881+0000", 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3139999999999999e-06 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357884+0000", 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6799999999999999e-06 2024-09-21T22:01:09.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357888+0000", 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.286e-06 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.361833+0000", 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0039451979999999996 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.361912+0000", 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8916000000000001e-05 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362042+0000", 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013033700000000001 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.364625+0000", 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0025829170000000001 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367727+0000", 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031021540000000002 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367759+0000", 2024-09-21T22:01:09.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1711999999999997e-05 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367779+0000", 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0726000000000001e-05 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.357896+0000", 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 31.008453307, 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099972970000000005, 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.381 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 37 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357896+0000", 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357896+0000", 2024-09-21T22:01:09.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357897+0000", 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9999999999999999e-07 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357900+0000", 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.768e-06 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357903+0000", 2024-09-21T22:01:09.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8500000000000004e-06 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.357907+0000", 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2710000000000001e-06 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362472+0000", 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045652560000000002 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362538+0000", 2024-09-21T22:01:09.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6078e-05 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.362624+0000", 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5958999999999995e-05 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.364646+0000", 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.002022041 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367814+0000", 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031681880000000002 2024-09-21T22:01:09.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367850+0000", 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6248999999999998e-05 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.367894+0000", 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3337000000000002e-05 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.810138224999999, 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095823990000000001, 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 110 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556212+0000", 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556217+0000", 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5889999999999996e-06 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556226+0000", 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3910000000000004e-06 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556232+0000", 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8089999999999998e-06 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559353+0000", 2024-09-21T22:01:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031209219999999999 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559420+0000", 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7195999999999998e-05 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559525+0000", 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000104947 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.560853+0000", 2024-09-21T22:01:09.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0013283170000000001 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565693+0000", 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0048393050000000003 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565755+0000", 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2360000000000006e-05 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565794+0000", 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8859000000000002e-05 2024-09-21T22:01:09.391 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.810106053999998, 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096657129999999994, 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.392 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 111 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556244+0000", 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0699999999999996e-07 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556249+0000", 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6120000000000001e-06 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556257+0000", 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8220000000000007e-06 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556292+0000", 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5439999999999999e-05 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559894+0000", 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003601599 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.559981+0000", 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7082000000000004e-05 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.560150+0000", 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00016919299999999999 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562194+0000", 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.002043572 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565841+0000", 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0036475610000000001 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565878+0000", 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6681000000000003e-05 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565909+0000", 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1443999999999999e-05 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556312+0000", 2024-09-21T22:01:09.397 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.810037845, 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096874349999999994, 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 112 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556312+0000", 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556312+0000", 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556313+0000", 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3799999999999996e-07 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556412+0000", 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9259999999999995e-05 2024-09-21T22:01:09.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556422+0000", 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0413e-05 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556430+0000", 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2300000000000002e-06 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561110+0000", 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046802759999999997 2024-09-21T22:01:09.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561160+0000", 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0611e-05 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561250+0000", 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9979e-05 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563304+0000", 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0020534220000000001 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565948+0000", 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0026440790000000001 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565978+0000", 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0357000000000001e-05 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.565999+0000", 2024-09-21T22:01:09.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.107e-05 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556443+0000", 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.809906715, 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096365949999999995, 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.403 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 113 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556443+0000", 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556443+0000", 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556444+0000", 2024-09-21T22:01:09.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0999999999999997e-07 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556450+0000", 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8259999999999998e-06 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556462+0000", 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2588999999999999e-05 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556468+0000", 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9290000000000003e-06 2024-09-21T22:01:09.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561729+0000", 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0052607690000000002 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561822+0000", 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2948000000000005e-05 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.561925+0000", 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103379 2024-09-21T22:01:09.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563890+0000", 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0019645169999999998 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.566029+0000", 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0021388869999999999 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.566058+0000", 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9014999999999999e-05 2024-09-21T22:01:09.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.566080+0000", 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1826000000000001e-05 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556481+0000", 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.809868596000001, 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011982389, 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.408 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 114 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556481+0000", 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556481+0000", 2024-09-21T22:01:09.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556482+0000", 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2099999999999996e-07 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556488+0000", 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5950000000000004e-06 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556495+0000", 2024-09-21T22:01:09.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9820000000000002e-06 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556501+0000", 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4110000000000004e-06 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562235+0000", 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0057339399999999999 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562311+0000", 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6307e-05 2024-09-21T22:01:09.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562408+0000", 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7388999999999999e-05 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563894+0000", 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0014856699999999999 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568375+0000", 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0044804830000000004 2024-09-21T22:01:09.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568427+0000", 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2462e-05 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568464+0000", 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6529000000000002e-05 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.413 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556511+0000", 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.809838831, 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012065541000000001, 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 115 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556511+0000", 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.414 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556511+0000", 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556512+0000", 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6599999999999996e-07 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556585+0000", 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3905000000000005e-05 2024-09-21T22:01:09.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556596+0000", 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0549e-05 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556602+0000", 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0090000000000004e-06 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562744+0000", 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0061415410000000004 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562801+0000", 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7499e-05 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.562887+0000", 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5549000000000004e-05 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563902+0000", 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0010152749999999999 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.417 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568513+0000", 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.004611118 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568548+0000", 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5261e-05 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568577+0000", 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8269e-05 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.418 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556616+0000", 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.809733859000001, 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012059043, 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 116 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.419 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556616+0000", 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556616+0000", 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556617+0000", 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6899999999999996e-07 2024-09-21T22:01:09.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556622+0000", 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1719999999999998e-06 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556632+0000", 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0284e-05 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556639+0000", 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0110000000000003e-06 2024-09-21T22:01:09.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563457+0000", 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0068177769999999997 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563534+0000", 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7453999999999994e-05 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563625+0000", 2024-09-21T22:01:09.422 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0243999999999999e-05 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.564337+0000", 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00071240099999999998 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568622+0000", 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0042851169999999997 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568652+0000", 2024-09-21T22:01:09.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0179e-05 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568675+0000", 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2634999999999999e-05 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.809699059, 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012111705, 2024-09-21T22:01:09.424 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 117 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556651+0000", 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3499999999999996e-07 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556656+0000", 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3000000000000003e-06 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.426 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556666+0000", 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0020999999999999e-05 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.556673+0000", 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1810000000000004e-06 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563928+0000", 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0072551129999999997 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.563984+0000", 2024-09-21T22:01:09.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6267000000000002e-05 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.564080+0000", 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6211000000000004e-05 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.564582+0000", 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00050163599999999997 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568709+0000", 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.004126785 2024-09-21T22:01:09.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568740+0000", 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0657999999999997e-05 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.568762+0000", 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2898e-05 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.429 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.453733755000002, 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010152499000000001, 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 138 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:01:09.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912616+0000", 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912619+0000", 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9490000000000001e-06 2024-09-21T22:01:09.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912628+0000", 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1699999999999997e-06 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912631+0000", 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4939999999999999e-06 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.917688+0000", 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0050565999999999996 2024-09-21T22:01:09.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.917751+0000", 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3359000000000001e-05 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.917835+0000", 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4027e-05 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922655+0000", 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0048200079999999998 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922709+0000", 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4320999999999997e-05 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922742+0000", 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2308999999999998e-05 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922769+0000", 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6911e-05 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.434 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.453713930999999, 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010189116999999999, 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 139 2024-09-21T22:01:09.435 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912636+0000", 2024-09-21T22:01:09.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912639+0000", 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.774e-06 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912643+0000", 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.687e-06 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912646+0000", 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1779999999999999e-06 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.918591+0000", 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0059446209999999998 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.918641+0000", 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9985000000000003e-05 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.918724+0000", 2024-09-21T22:01:09.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3718e-05 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922698+0000", 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003973903 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922775+0000", 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7212000000000005e-05 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922805+0000", 2024-09-21T22:01:09.439 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9955999999999999e-05 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922825+0000", 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9624999999999999e-05 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912656+0000", 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.453693594000001, 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010746136, 2024-09-21T22:01:09.440 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 140 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912656+0000", 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912656+0000", 2024-09-21T22:01:09.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912657+0000", 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1e-07 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912696+0000", 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9632000000000003e-05 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912703+0000", 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1849999999999998e-06 2024-09-21T22:01:09.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912708+0000", 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3440000000000003e-06 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.919071+0000", 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0063632480000000002 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.919130+0000", 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8779000000000001e-05 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.919214+0000", 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4456999999999995e-05 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922886+0000", 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003672228 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923339+0000", 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00045238100000000002 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923376+0000", 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7431999999999997e-05 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923402+0000", 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.614e-05 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.453634762, 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011180765, 2024-09-21T22:01:09.445 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 141 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.446 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912715+0000", 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912718+0000", 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7709999999999998e-06 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.447 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912722+0000", 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7629999999999998e-06 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.912725+0000", 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0699999999999998e-06 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922910+0000", 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010185318 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.448 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.922974+0000", 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3836000000000003e-05 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923060+0000", 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5714e-05 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923672+0000", 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000612467 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.449 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923838+0000", 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00016549499999999999 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923873+0000", 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5055999999999998e-05 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.923896+0000", 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2908000000000002e-05 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2095 3.f 3:f1bf288a:::rbd_object_map.1124ebe77597:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.496847+0000", 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.8695028899999997, 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096887840000000006, 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2095 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.451 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496847+0000", 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496847+0000", 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496848+0000", 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1200000000000001e-06 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496854+0000", 2024-09-21T22:01:09.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496865+0000", 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0862e-05 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.496872+0000", 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1539999999999996e-06 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497710+0000", 2024-09-21T22:01:09.453 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00083737600000000003 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497770+0000", 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0180999999999999e-05 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497997+0000", 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00022681700000000001 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.501350+0000", 2024-09-21T22:01:09.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0033537250000000001 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506444+0000", 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0050937209999999998 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506491+0000", 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7224000000000001e-05 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.455 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506536+0000", 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4434999999999997e-05 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2096 3.f 3:f1bf288a:::rbd_object_map.1124ebe77597:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.497003+0000", 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.8693471720000003, 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096287950000000008, 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.456 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2096 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497003+0000", 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497003+0000", 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.457 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497003+0000", 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9299999999999997e-07 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497017+0000", 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3767e-05 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497027+0000", 2024-09-21T22:01:09.458 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4530000000000008e-06 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497034+0000", 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6739999999999997e-06 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498298+0000", 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0012633480000000001 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498382+0000", 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4746000000000005e-05 2024-09-21T22:01:09.459 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.498728+0000", 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034568199999999999 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.503698+0000", 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0049698839999999999 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506569+0000", 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028709489999999998 2024-09-21T22:01:09.460 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506598+0000", 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9084000000000001e-05 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506631+0000", 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3414999999999998e-05 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:2097 3.f 3:f408e78a:::rbd_data.1124ebe77597.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.461 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:01.497941+0000", 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.8684092799999998, 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0088259480000000001, 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 2097 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.462 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497941+0000", 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497941+0000", 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497941+0000", 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3900000000000004e-07 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.463 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497946+0000", 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8790000000000002e-06 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497956+0000", 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.5959999999999993e-06 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.497969+0000", 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2670999999999999e-05 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.464 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499116+0000", 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011474720000000001 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499212+0000", 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.5878999999999995e-05 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.499325+0000", 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011351199999999999 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.465 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.503705+0000", 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.004379979 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506673+0000", 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0029678389999999999 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506728+0000", 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5114999999999997e-05 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.466 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:01.506766+0000", 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8167000000000002e-05 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.8609319960000001, 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:09.467 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.468 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:09.469 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:01:09.470 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:01:09.471 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop_reply(client.4388.0:7933 3.11 e34/23 ondisk, result = 0)", 2024-09-21T22:01:09.472 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.525618+0000", 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.840731479, 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0085979960000000001, 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525618+0000", 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525618+0000", 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:09.473 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525619+0000", 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0780000000000001e-06 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525625+0000", 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9460000000000003e-06 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525641+0000", 2024-09-21T22:01:09.474 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5471000000000001e-05 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.525650+0000", 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9439999999999994e-06 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534125+0000", 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0084754519999999996 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534133+0000", 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0600000000000008e-06 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:09.475 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:09.476 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:09.476 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534216+0000", 2024-09-21T22:01:09.476 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3045000000000002e-05 2024-09-21T22:01:09.476 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.476 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.476 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.476 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:09.476 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:09.476 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:09.477 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:09.478 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:09.476+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:09.578 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:09.577+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:09.582 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:09.582 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:09.582 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:09.582 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:09.591 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:09.678 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:09.677+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:09.693 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:09.694 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:09.702 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:09.734 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:01:09.739 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T22:01:09.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T22:01:09.779 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:09.777+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:09.798 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone7 from 0x82af2b3 (overlap 0x86f87) to 0x1afe7 2024-09-21T22:01:09.819 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1533 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1179648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461433+0000", 2024-09-21T22:01:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3555848210000008, 2024-09-21T22:01:09.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015889985999999998, 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1533 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461433+0000", 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461433+0000", 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461434+0000", 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461436+0000", 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:01:09.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461442+0000", 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2920000000000001e-06 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461446+0000", 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477177+0000", 2024-09-21T22:01:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015730958999999999 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477253+0000", 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5967e-05 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477323+0000", 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9868000000000003e-05 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1534 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 933888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461453+0000", 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3555652889999994, 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016051202000000001, 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1534 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461453+0000", 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461453+0000", 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461453+0000", 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461455+0000", 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.21e-06 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461461+0000", 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1519999999999997e-06 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461477+0000", 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5559000000000001e-05 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477351+0000", 2024-09-21T22:01:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015874267000000001 2024-09-21T22:01:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477425+0000", 2024-09-21T22:01:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3705e-05 2024-09-21T22:01:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477504+0000", 2024-09-21T22:01:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8904000000000002e-05 2024-09-21T22:01:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.829 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1538 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 950272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461485+0000", 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3555333340000004, 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016161572999999999, 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1538 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461485+0000", 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461485+0000", 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461485+0000", 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461487+0000", 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3420000000000002e-06 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461493+0000", 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.127e-06 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461500+0000", 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477528+0000", 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016028216000000001 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477597+0000", 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8972000000000003e-05 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477646+0000", 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9434999999999997e-05 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1539 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461507+0000", 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3555112339999997, 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016268042, 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1539 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461507+0000", 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461507+0000", 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461507+0000", 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:09.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461509+0000", 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461517+0000", 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6389999999999992e-06 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461522+0000", 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3680000000000001e-06 2024-09-21T22:01:09.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477672+0000", 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016149587999999999 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477719+0000", 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7568999999999998e-05 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477775+0000", 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5377000000000002e-05 2024-09-21T22:01:09.837 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1542 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461529+0000", 2024-09-21T22:01:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3554889909999996, 2024-09-21T22:01:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016402301000000001, 2024-09-21T22:01:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.838 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1542 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461529+0000", 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461529+0000", 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461529+0000", 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461531+0000", 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.136e-06 2024-09-21T22:01:09.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461539+0000", 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3470000000000001e-06 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461544+0000", 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9629999999999997e-06 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477801+0000", 2024-09-21T22:01:09.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016257147999999999 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477860+0000", 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9298e-05 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477931+0000", 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1043000000000004e-05 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1544 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1032192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461551+0000", 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3554665289999992, 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016548994000000001, 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1544 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.843 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461551+0000", 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461551+0000", 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461552+0000", 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:09.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461563+0000", 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0995000000000001e-05 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461570+0000", 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2540000000000003e-06 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461575+0000", 2024-09-21T22:01:09.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477960+0000", 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016384920000000001 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478032+0000", 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1687000000000007e-05 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478100+0000", 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-05 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1546 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461582+0000", 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3554356169999995, 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016702069999999999, 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1546 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461582+0000", 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461582+0000", 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461583+0000", 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8400000000000004e-07 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461586+0000", 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8700000000000001e-06 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461592+0000", 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2169999999999999e-06 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461597+0000", 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1839999999999998e-06 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478128+0000", 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016530675000000002 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478202+0000", 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4297999999999999e-05 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478284+0000", 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2242000000000003e-05 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1548 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1327104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.851 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461604+0000", 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3554139630000002, 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016876019999999999, 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1548 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461604+0000", 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461604+0000", 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461604+0000", 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7100000000000002e-07 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461607+0000", 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0820000000000001e-06 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461613+0000", 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3069999999999999e-06 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461617+0000", 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.622e-06 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478318+0000", 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016700261000000001 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478400+0000", 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2038000000000003e-05 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478480+0000", 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0239000000000002e-05 2024-09-21T22:01:09.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1550 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461623+0000", 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3553946749999994, 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017050681000000002, 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1550 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461623+0000", 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461623+0000", 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461624+0000", 2024-09-21T22:01:09.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461625+0000", 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461631+0000", 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7230000000000001e-06 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461635+0000", 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2490000000000003e-06 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478511+0000", 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016876019999999999 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478594+0000", 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2177999999999998e-05 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478674+0000", 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0382000000000004e-05 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1552 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1409024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461641+0000", 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3553765420000001, 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017205169999999999, 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.860 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1552 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461641+0000", 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461641+0000", 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461642+0000", 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461644+0000", 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461650+0000", 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461654+0000", 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5750000000000002e-06 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478702+0000", 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017047896 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478775+0000", 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3059999999999995e-05 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478847+0000", 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1365000000000005e-05 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1554 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1425408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.864 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461660+0000", 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3553576550000006, 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017395931, 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1554 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461660+0000", 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461660+0000", 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461661+0000", 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461662+0000", 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.852e-06 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461669+0000", 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.083e-06 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461673+0000", 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4630000000000003e-06 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478892+0000", 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017219307 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478979+0000", 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6419e-05 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479056+0000", 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7445000000000001e-05 2024-09-21T22:01:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1556 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461680+0000", 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3553379840000002, 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017556394999999999, 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.869 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1556 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461680+0000", 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461680+0000", 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461680+0000", 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7e-07 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461682+0000", 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9120000000000001e-06 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461688+0000", 2024-09-21T22:01:09.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7629999999999997e-06 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461693+0000", 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479087+0000", 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017394012 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479162+0000", 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4918000000000003e-05 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479236+0000", 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4756000000000001e-05 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1558 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1196032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461699+0000", 2024-09-21T22:01:09.873 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3553190130000008, 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017715903000000002, 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1558 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461699+0000", 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461699+0000", 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461699+0000", 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461701+0000", 2024-09-21T22:01:09.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8899999999999999e-06 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461707+0000", 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8100000000000003e-06 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461712+0000", 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6399999999999996e-06 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479267+0000", 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017555775999999999 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479342+0000", 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4250000000000002e-05 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479415+0000", 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3196999999999997e-05 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1559 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1458176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461718+0000", 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3552998439999993, 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017906390000000001, 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1559 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.878 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461718+0000", 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461718+0000", 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461718+0000", 2024-09-21T22:01:09.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461721+0000", 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0999999999999998e-06 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461727+0000", 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.054e-06 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461731+0000", 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4490000000000001e-06 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479476+0000", 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017745097000000001 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479552+0000", 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6184000000000001e-05 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479624+0000", 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2131000000000004e-05 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1562 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461964+0000", 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3550536829999995, 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017858503000000001, 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.882 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1562 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461964+0000", 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461964+0000", 2024-09-21T22:01:09.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461965+0000", 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0900000000000001e-07 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461969+0000", 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.493e-06 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461980+0000", 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0294e-05 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461987+0000", 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2130000000000002e-06 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479656+0000", 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017668637000000001 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479741+0000", 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5691000000000003e-05 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479823+0000", 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1465999999999996e-05 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1564 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1277952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461999+0000", 2024-09-21T22:01:09.886 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3550188179999996, 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018019938999999999, 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1564 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461999+0000", 2024-09-21T22:01:09.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461999+0000", 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462000+0000", 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462002+0000", 2024-09-21T22:01:09.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8720000000000002e-06 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462009+0000", 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9700000000000002e-06 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462016+0000", 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9e-06 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479855+0000", 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017838599 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479942+0000", 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6928999999999994e-05 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480019+0000", 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7154e-05 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.890 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1566 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1294336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.462031+0000", 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3549873239999997, 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018182304999999999, 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1566 2024-09-21T22:01:09.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462031+0000", 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462031+0000", 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462031+0000", 2024-09-21T22:01:09.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7100000000000002e-07 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462034+0000", 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4899999999999999e-06 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462040+0000", 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7390000000000002e-06 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462045+0000", 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0289999999999996e-06 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480053+0000", 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018007472 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480136+0000", 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2847000000000001e-05 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480213+0000", 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7256999999999996e-05 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1568 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1212416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.462053+0000", 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3549653290000006, 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018351408, 2024-09-21T22:01:09.895 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1568 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462053+0000", 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462053+0000", 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462053+0000", 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462071+0000", 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8372e-05 2024-09-21T22:01:09.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462082+0000", 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0767999999999999e-05 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462088+0000", 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4079999999999997e-06 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480245+0000", 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018157957999999998 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480328+0000", 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2033000000000006e-05 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480404+0000", 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6501000000000005e-05 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.899 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1573 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.462096+0000", 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3549220599999998, 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018509907999999999, 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1573 2024-09-21T22:01:09.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462096+0000", 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462096+0000", 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462096+0000", 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.89e-07 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462099+0000", 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.419e-06 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462105+0000", 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6080000000000001e-06 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462110+0000", 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8119999999999998e-06 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480433+0000", 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018322432 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480538+0000", 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010541 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480606+0000", 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7737999999999994e-05 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:8347 3.17 3:e9914f4e:::rbd_data.11245d75990.0000000000000024:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.911134+0000", 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.9058838709999999, 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019107674000000002, 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:09.904 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 8347 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911134+0000", 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:09.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911134+0000", 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911136+0000", 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9269999999999999e-06 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911144+0000", 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.49e-06 2024-09-21T22:01:09.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911161+0000", 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.66e-05 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911169+0000", 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6040000000000004e-06 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911221+0000", 2024-09-21T22:01:09.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1909000000000001e-05 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911284+0000", 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3885000000000002e-05 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 5", 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.914580+0000", 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003296027 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.930054+0000", 2024-09-21T22:01:09.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015473948 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.930113+0000", 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9039000000000002e-05 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.930184+0000", 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0691999999999993e-05 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:09.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.930242+0000", 2024-09-21T22:01:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7553000000000003e-05 2024-09-21T22:01:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:09.910 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:09.910 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:09.911 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:09.912 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-21T22:01:09.912 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:09.909+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:10.012 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:10.011+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:10.012 INFO:teuthology.orchestra.run.smithi102.stdout:1197 trunc from 0x82af2b3 to 0x7400d7f 2024-09-21T22:01:10.025 INFO:teuthology.orchestra.run.smithi102.stdout:1199 read 0x583a75b thru 0x5841ebd (0x7763 bytes) 2024-09-21T22:01:10.034 INFO:teuthology.orchestra.run.smithi102.stdout:1200 write 0x9ad0ce2 thru 0x9ae0627 (0xf946 bytes) 2024-09-21T22:01:10.039 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:10.039 INFO:teuthology.orchestra.run.smithi102.stdout:1202 read 0x8ce37fc thru 0x8ceefa6 (0xb7ab bytes) 2024-09-21T22:01:10.039 INFO:teuthology.orchestra.run.smithi102.stdout:1205 punch from 0x32580b1 to 0x325f8b6, (0x7805 bytes) 2024-09-21T22:01:10.048 INFO:teuthology.orchestra.run.smithi102.stdout:1206 trunc from 0x9ae0628 to 0x1386894 2024-09-21T22:01:10.063 INFO:teuthology.orchestra.run.smithi102.stdout:1209 punch from 0xb4313a to 0xb4c90d, (0x97d3 bytes) 2024-09-21T22:01:10.063 INFO:teuthology.orchestra.run.smithi102.stdout:1211 read 0xf19168 thru 0xf1ffe0 (0x6e79 bytes) 2024-09-21T22:01:10.063 INFO:teuthology.orchestra.run.smithi102.stdout:1213 read 0xf9ec78 thru 0xfa2cc9 (0x4052 bytes) 2024-09-21T22:01:10.063 INFO:teuthology.orchestra.run.smithi102.stdout:1214 write 0x8b1eb4 thru 0x8bc3b8 (0xa505 bytes) 2024-09-21T22:01:10.068 INFO:teuthology.orchestra.run.smithi102.stdout:1215 clone 9 order 25 su 131072 sc 5 2024-09-21T22:01:10.072 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:10.072 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:10.072 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:10.072 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:10.081 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:10.126 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:10.124+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:10.185 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:10.185 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:10.194 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:10.235 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:10.233+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:10.314 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:10.312+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:10.340 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:10.340 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:10.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:10.340 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:10.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.340 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:5733 3.6 e32/23 3:6711db61:::rbd_data.11241aed97b.0000000000000005:head v 32'8, mlcod=32'5)", 2024-09-21T22:01:10.340 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:10.340 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 6.3876918600000003, 2024-09-21T22:01:10.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031617640000000001, 2024-09-21T22:01:10.340 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5000000000000002e-07 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950222+0000", 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6309999999999997e-06 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950235+0000", 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2848e-05 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950241+0000", 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9229999999999999e-06 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950292+0000", 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0767999999999999e-05 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950312+0000", 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0658000000000001e-05 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.953336+0000", 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030239329999999999 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.953377+0000", 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0352999999999998e-05 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.344 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6273 3.8 e34/23 3:17287710:::rbd_data.11241c6bf084.0000000000000004:head v 34'12, mlcod=33'8)", 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.779057+0000", 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5588495049999995, 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039622850000000003, 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779057+0000", 2024-09-21T22:01:10.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779057+0000", 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779058+0000", 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0200000000000001e-07 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779065+0000", 2024-09-21T22:01:10.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0219999999999999e-06 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779078+0000", 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2509e-05 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779085+0000", 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0060000000000003e-06 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779139+0000", 2024-09-21T22:01:10.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4163000000000003e-05 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779159+0000", 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0653999999999999e-05 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.782978+0000", 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038188300000000001 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783019+0000", 2024-09-21T22:01:10.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1298999999999999e-05 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6276 3.8 e34/23 3:139e13d6:::rbd_data.11241c6bf084.0000000000000006:head v 34'13, mlcod=33'8)", 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.779874+0000", 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5580323409999997, 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059474469999999998, 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779874+0000", 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779874+0000", 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779875+0000", 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7899999999999998e-07 2024-09-21T22:01:10.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779895+0000", 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9616e-05 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779906+0000", 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1759e-05 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779913+0000", 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4790000000000001e-06 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780183+0000", 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00027045699999999999 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780202+0000", 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8856e-05 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785800+0000", 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055976419999999999 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785822+0000", 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1959000000000001e-05 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6277 3.8 e34/23 3:139e13d6:::rbd_data.11241c6bf084.0000000000000006:head v 34'15, mlcod=33'8)", 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.780632+0000", 2024-09-21T22:01:10.353 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5572746549999996, 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052038550000000003, 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780632+0000", 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780632+0000", 2024-09-21T22:01:10.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780633+0000", 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9800000000000003e-07 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780639+0000", 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5849999999999996e-06 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780650+0000", 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0402e-05 2024-09-21T22:01:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780657+0000", 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3350000000000001e-06 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780709+0000", 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2077999999999998e-05 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780730+0000", 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0755e-05 2024-09-21T22:01:10.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785824+0000", 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050940100000000004 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785836+0000", 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1992e-05 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6281 3.8 e34/23 3:1043a0b3:::rbd_object_map.11241c6bf084:head v 34'16, mlcod=34'9)", 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.783460+0000", 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5544466080000001, 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047000590000000004, 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783460+0000", 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783460+0000", 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783461+0000", 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0900000000000001e-07 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783466+0000", 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8609999999999997e-06 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783483+0000", 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7252e-05 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783489+0000", 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783538+0000", 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8613999999999999e-05 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783554+0000", 2024-09-21T22:01:10.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5931999999999999e-05 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.788134+0000", 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045798849999999997 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.788160+0000", 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6336e-05 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.361 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6283 3.8 e34/23 3:1043a0b3:::rbd_object_map.11241c6bf084:head v 34'17, mlcod=34'10)", 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5535827739999997, 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064856749999999998, 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1200000000000003e-07 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784328+0000", 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9809999999999997e-06 2024-09-21T22:01:10.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784336+0000", 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5669999999999997e-06 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784343+0000", 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.737e-06 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785563+0000", 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0012207590000000001 2024-09-21T22:01:10.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785577+0000", 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3118999999999999e-05 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790766+0000", 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051893119999999997 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790810+0000", 2024-09-21T22:01:10.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3687999999999999e-05 2024-09-21T22:01:10.366 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.366 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.366 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.366 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6285 3.8 e34/23 3:1043a0b3:::rbd_object_map.11241c6bf084:head v 34'18, mlcod=34'10)", 2024-09-21T22:01:10.366 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:10.366 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5530248149999997, 2024-09-21T22:01:10.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059974349999999997, 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.01e-07 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784886+0000", 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4189999999999998e-06 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784892+0000", 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999997e-06 2024-09-21T22:01:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784897+0000", 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7530000000000001e-06 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785857+0000", 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096060000000000004 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785871+0000", 2024-09-21T22:01:10.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3269e-05 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790813+0000", 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049422490000000001 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790879+0000", 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6383000000000005e-05 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6292 3.a e34/28 3:54ffb751:::rbd_data.11241c6bf084.0000000000000001:head v 34'25, mlcod=33'21)", 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.792368+0000", 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5455384380000003, 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039734059999999996, 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792368+0000", 2024-09-21T22:01:10.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792368+0000", 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792369+0000", 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1600000000000001e-07 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792375+0000", 2024-09-21T22:01:10.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2450000000000003e-06 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792387+0000", 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1613e-05 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792393+0000", 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792650+0000", 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00025638199999999999 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792661+0000", 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1581e-05 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.796308+0000", 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0036463749999999999 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.796342+0000", 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4044999999999997e-05 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7626 3.4 e34/23 3:217b17c9:::rbd_data.11245d75990.0000000000000016:head v 34'44, mlcod=34'42)", 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.341873+0000", 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.9960339539999996, 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028624459999999998, 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.375 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341873+0000", 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341873+0000", 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341873+0000", 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2900000000000003e-07 2024-09-21T22:01:10.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341882+0000", 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0909999999999993e-06 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341895+0000", 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3159999999999999e-05 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341902+0000", 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.832e-06 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341965+0000", 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3176000000000006e-05 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341984+0000", 2024-09-21T22:01:10.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8859999999999999e-05 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.344700+0000", 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00271595 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.344735+0000", 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5648000000000002e-05 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.379 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7628 3.1a e34/23 3:59997cf8:::rbd_object_map.11245d75990:head v 34'59, mlcod=34'57)", 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.9944320339999999, 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039423549999999998, 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3600000000000003e-07 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343480+0000", 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5739999999999997e-06 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343489+0000", 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9339999999999995e-06 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343495+0000", 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0260000000000004e-06 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343542+0000", 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6940000000000001e-05 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343562+0000", 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0591999999999999e-05 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.347359+0000", 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003796654 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.347417+0000", 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7998999999999998e-05 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7632 3.1a e34/23 3:59997cf8:::rbd_object_map.11245d75990:head v 34'61, mlcod=34'59)", 2024-09-21T22:01:10.384 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.349031+0000", 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.9888753430000001, 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034961710000000002, 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349031+0000", 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349031+0000", 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349032+0000", 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7400000000000002e-07 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349038+0000", 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.964e-06 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349051+0000", 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2818e-05 2024-09-21T22:01:10.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349058+0000", 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349101+0000", 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2945000000000003e-05 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349113+0000", 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2422999999999999e-05 2024-09-21T22:01:10.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352502+0000", 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033889879999999999 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352528+0000", 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5551999999999999e-05 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7634 3.1a e34/23 3:59997cf8:::rbd_object_map.11245d75990:head v 34'63, mlcod=34'59)", 2024-09-21T22:01:10.388 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.352190+0000", 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.9857165170000002, 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034284049999999998, 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352190+0000", 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352190+0000", 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352191+0000", 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5300000000000004e-07 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352195+0000", 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7260000000000002e-06 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352204+0000", 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7809999999999994e-06 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352210+0000", 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2179999999999996e-06 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352245+0000", 2024-09-21T22:01:10.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5024000000000002e-05 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352259+0000", 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295999999999999e-05 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.355589+0000", 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033299660000000002 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.355619+0000", 2024-09-21T22:01:10.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9841000000000001e-05 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:8153 3.4 e35/23 3:217b17c9:::rbd_data.11245d75990.0000000000000016:head v 35'54, mlcod=34'51)", 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.760173+0000", 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5777339650000002, 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002988133, 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760173+0000", 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760173+0000", 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760174+0000", 2024-09-21T22:01:10.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1100000000000005e-07 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760179+0000", 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9840000000000001e-06 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760192+0000", 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.326e-05 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760198+0000", 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6969999999999996e-06 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760240+0000", 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1758000000000002e-05 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760274+0000", 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3772000000000001e-05 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.763129+0000", 2024-09-21T22:01:10.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028549650000000001 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.763161+0000", 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1885999999999999e-05 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:8258 3.4 e35/23 3:2443562f:::rbd_data.11245d75990.0000000000000006:head v 35'56, mlcod=35'54)", 2024-09-21T22:01:10.397 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5263571440000003, 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033350820000000001, 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811555+0000", 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0100000000000003e-06 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811564+0000", 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9069999999999996e-06 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811573+0000", 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8720000000000008e-06 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811622+0000", 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9206999999999998e-05 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811637+0000", 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4789e-05 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814833+0000", 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031957560000000001 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814885+0000", 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2021999999999998e-05 2024-09-21T22:01:10.401 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:8253 3.0 e35/23 3:051bfba9:::rbd_data.11245d75990.0000000000000001:head v 35'28, mlcod=34'26)", 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.811791+0000", 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5261160260000004, 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030884749999999998, 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.402 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811791+0000", 2024-09-21T22:01:10.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811791+0000", 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811791+0000", 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811796+0000", 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811803+0000", 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5050000000000001e-06 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811811+0000", 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8480000000000001e-06 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811856+0000", 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4706999999999997e-05 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811872+0000", 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5931999999999999e-05 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814850+0000", 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029784960000000002 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814879+0000", 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8722999999999999e-05 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.406 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.407 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.407 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:8255 3.1a e35/23 3:5c2256b7:::rbd_data.11245d75990.0000000000000003:head v 35'125, mlcod=35'123)", 2024-09-21T22:01:10.407 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.811912+0000", 2024-09-21T22:01:10.407 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5259945320000003, 2024-09-21T22:01:10.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058016710000000004, 2024-09-21T22:01:10.408 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.408 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.408 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.408 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811912+0000", 2024-09-21T22:01:10.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811912+0000", 2024-09-21T22:01:10.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811913+0000", 2024-09-21T22:01:10.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4600000000000003e-07 2024-09-21T22:01:10.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811921+0000", 2024-09-21T22:01:10.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2024-09-21T22:01:10.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811932+0000", 2024-09-21T22:01:10.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1368e-05 2024-09-21T22:01:10.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811938+0000", 2024-09-21T22:01:10.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3500000000000002e-06 2024-09-21T22:01:10.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811996+0000", 2024-09-21T22:01:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7216999999999998e-05 2024-09-21T22:01:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.812016+0000", 2024-09-21T22:01:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0593000000000001e-05 2024-09-21T22:01:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.817672+0000", 2024-09-21T22:01:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056554689999999998 2024-09-21T22:01:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.817714+0000", 2024-09-21T22:01:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2191999999999999e-05 2024-09-21T22:01:10.414 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.414 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.414 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.414 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:8467 3.19 3:98c60cb6:::rbd_data.11245d75990.0000000000000021:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T22:01:10.414 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:06.053457+0000", 2024-09-21T22:01:10.414 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.2844494439999998, 2024-09-21T22:01:10.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0089674449999999992, 2024-09-21T22:01:10.415 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.415 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.415 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.415 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:10.415 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:10.415 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:10.415 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 8467 2024-09-21T22:01:10.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.415 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053457+0000", 2024-09-21T22:01:10.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053457+0000", 2024-09-21T22:01:10.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053459+0000", 2024-09-21T22:01:10.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8780000000000001e-06 2024-09-21T22:01:10.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053473+0000", 2024-09-21T22:01:10.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3369e-05 2024-09-21T22:01:10.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053489+0000", 2024-09-21T22:01:10.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.647e-05 2024-09-21T22:01:10.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053498+0000", 2024-09-21T22:01:10.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1910000000000006e-06 2024-09-21T22:01:10.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053549+0000", 2024-09-21T22:01:10.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0639000000000001e-05 2024-09-21T22:01:10.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053642+0000", 2024-09-21T22:01:10.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3306000000000004e-05 2024-09-21T22:01:10.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:10.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.055069+0000", 2024-09-21T22:01:10.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0014269630000000001 2024-09-21T22:01:10.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:10.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062351+0000", 2024-09-21T22:01:10.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0072819060000000003 2024-09-21T22:01:10.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:10.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062363+0000", 2024-09-21T22:01:10.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.17e-05 2024-09-21T22:01:10.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062394+0000", 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1247000000000001e-05 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062425+0000", 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0775999999999998e-05 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.422 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:10543 3.a e37/28 3:52b77e0f:::rbd_data.11246f0f1a8f.00000000000000ee:head v 37'29, mlcod=37'27)", 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.860621093, 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040004919999999996, 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:10.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5799999999999998e-07 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477294+0000", 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2790000000000001e-06 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477305+0000", 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1843e-05 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477312+0000", 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8870000000000003e-06 2024-09-21T22:01:10.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477364+0000", 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1362000000000001e-05 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477385+0000", 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1321000000000001e-05 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.481247+0000", 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038619549999999998 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.481286+0000", 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9087e-05 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.427 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:11169 3.19 3:98c01e0c:::rbd_object_map.1124168bc283:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:10.015671+0000", 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.32223522399999999, 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029208799999999998, 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 11169 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015671+0000", 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015671+0000", 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015672+0000", 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6600000000000002e-07 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015675+0000", 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8739999999999999e-06 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015681+0000", 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8860000000000001e-06 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015686+0000", 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.412e-06 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.017163+0000", 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0014770790000000001 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.017219+0000", 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5801000000000003e-05 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.017509+0000", 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00029008499999999998 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.018378+0000", 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00086877000000000005 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.018530+0000", 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015228900000000001 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.018558+0000", 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489000000000001e-05 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.018592+0000", 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4728999999999999e-05 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:11223 3.19 3:98c01e0c:::rbd_object_map.1124168bc283:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:10.062951+0000", 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.27495589300000001, 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002793776, 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:10.433 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 11223 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062951+0000", 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062951+0000", 2024-09-21T22:01:10.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062952+0000", 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.92e-07 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062963+0000", 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1667e-05 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062973+0000", 2024-09-21T22:01:10.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.302e-06 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062982+0000", 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.098e-06 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.063627+0000", 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064574700000000001 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.063723+0000", 2024-09-21T22:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.064092+0000", 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00036968299999999999 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.065642+0000", 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001550034 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:10.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.065654+0000", 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.19e-05 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.065705+0000", 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0339e-05 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.065745+0000", 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9910000000000002e-05 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.439 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:10.439 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:10.439 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:10.440 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:10.440 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:10.438+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:10.541 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:10.539+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:10.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:10.584 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:10.585 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:10.585 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:10.585 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:10.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:10.678 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:10.676+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:10.700 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:10.717 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:10.717 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:10.734 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:10.738 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:01:10.738 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T22:01:10.742 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:10.742 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:10.743 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:10.741+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:10.756 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:10.759 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T22:01:10.759 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:01:10.761 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:10.761 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:10.784 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:10.784 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:10.803 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:10.803 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:10.822 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone8 from 0x1386894 (overlap 0x1386894) to 0x9c344a 2024-09-21T22:01:10.822 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:10.822 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:10.844 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:10.842+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:10.854 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:10.854 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:10.885 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:10.885 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:10.894 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:10.915 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-21T22:01:10.926 INFO:teuthology.orchestra.run.smithi102.stdout:1217 trunc from 0x1386894 to 0xc85362 2024-09-21T22:01:10.945 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:10.944+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:10.954 INFO:teuthology.orchestra.run.smithi102.stdout:1218 read 0x585d8a thru 0x58689d (0xb14 bytes) 2024-09-21T22:01:10.955 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:10.960 INFO:teuthology.orchestra.run.smithi102.stdout:1221 trunc from 0xc85362 to 0x51f51fe 2024-09-21T22:01:10.966 INFO:teuthology.orchestra.run.smithi102.stdout:1224 read 0x8f4290 thru 0x8fa102 (0x5e73 bytes) 2024-09-21T22:01:10.975 INFO:teuthology.orchestra.run.smithi102.stdout:1225 trunc from 0x51f51fe to 0xcc59f0c 2024-09-21T22:01:10.981 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:10.981 INFO:teuthology.orchestra.run.smithi102.stdout:1228 read 0x19f54e4 thru 0x19ff01f (0x9b3c bytes) 2024-09-21T22:01:10.982 INFO:teuthology.orchestra.run.smithi102.stdout:1230 write 0x300d4a6 thru 0x301001f (0x2b7a bytes) 2024-09-21T22:01:10.983 INFO:teuthology.orchestra.run.smithi102.stdout:1231 read 0x748c7fa thru 0x74985a2 (0xbda9 bytes) 2024-09-21T22:01:10.984 INFO:teuthology.orchestra.run.smithi102.stdout:1233 punch from 0x5d8963c to 0x5d8f997, (0x635b bytes) 2024-09-21T22:01:10.984 INFO:teuthology.orchestra.run.smithi102.stdout:1234 read 0x5cbdbe9 thru 0x5cc1951 (0x3d69 bytes) 2024-09-21T22:01:10.984 INFO:teuthology.orchestra.run.smithi102.stdout:1235 read 0xb1762bc thru 0xb17c6a8 (0x63ed bytes) 2024-09-21T22:01:10.984 INFO:teuthology.orchestra.run.smithi102.stdout:1237 write 0x41b85bb thru 0x41c6b1d (0xe563 bytes) 2024-09-21T22:01:10.986 INFO:teuthology.orchestra.run.smithi102.stdout:1238 punch from 0x4b8ad03 to 0x4b8dd33, (0x3030 bytes) 2024-09-21T22:01:10.986 INFO:teuthology.orchestra.run.smithi102.stdout:1239 write 0x2300fc thru 0x23645a (0x635f bytes) 2024-09-21T22:01:10.987 INFO:teuthology.orchestra.run.smithi102.stdout:1240 writesame 0x9c30cf3 thru 0x9c33985 data_size 0x1(0x2c93 bytes) 2024-09-21T22:01:10.994 INFO:teuthology.orchestra.run.smithi102.stdout:1242 write 0x8cb9b06 thru 0x8cbe4f9 (0x49f4 bytes) 2024-09-21T22:01:10.996 INFO:teuthology.orchestra.run.smithi102.stdout:1243 write 0x4c1e21f thru 0x4c24d32 (0x6b14 bytes) 2024-09-21T22:01:10.999 INFO:teuthology.orchestra.run.smithi102.stdout:1244 writesame 0x723bdf5 thru 0x723ef60 data_size 0x2(0x316c bytes) 2024-09-21T22:01:11.002 INFO:teuthology.orchestra.run.smithi102.stdout:1248 read 0xb8da8a7 thru 0xb8db4d7 (0xc31 bytes) 2024-09-21T22:01:11.002 INFO:teuthology.orchestra.run.smithi102.stdout:1249 punch from 0x284098f to 0x2847ca2, (0x7313 bytes) 2024-09-21T22:01:11.002 INFO:teuthology.orchestra.run.smithi102.stdout:1250 punch from 0x4f27d85 to 0x4f2bdd4, (0x404f bytes) 2024-09-21T22:01:11.002 INFO:teuthology.orchestra.run.smithi102.stdout:1251 punch from 0x56826ef to 0x56899ae, (0x72bf bytes) 2024-09-21T22:01:11.002 INFO:teuthology.orchestra.run.smithi102.stdout:1252 read 0x51c07fa thru 0x51cf3ce (0xebd5 bytes) 2024-09-21T22:01:11.009 INFO:teuthology.orchestra.run.smithi102.stdout:1253 writesame 0xdbb8e9d thru 0xdbba58f data_size 0x5(0x16f3 bytes) 2024-09-21T22:01:11.015 INFO:teuthology.orchestra.run.smithi102.stdout:1255 writesame 0xdf062be thru 0xdf15c99 data_size 0x2(0xf9dc bytes) 2024-09-21T22:01:11.015 INFO:teuthology.orchestra.run.smithi102.stdout:1259 punch from 0x12145b1 to 0x12205e0, (0xc02f bytes) 2024-09-21T22:01:11.016 INFO:teuthology.orchestra.run.smithi102.stdout:1260 writesame 0xa955411 thru 0xa95e51d data_size 0x1(0x910d bytes) 2024-09-21T22:01:11.029 INFO:teuthology.orchestra.run.smithi102.stdout:1261 trunc from 0xdf15c9a to 0x3b301c0 2024-09-21T22:01:11.037 INFO:teuthology.orchestra.run.smithi102.stdout:1262 read 0x38f20f thru 0x39d609 (0xe3fb bytes) 2024-09-21T22:01:11.046 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:11.044+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:11.047 INFO:teuthology.orchestra.run.smithi102.stdout:1265 write 0x62d40e4 thru 0x62dadb3 (0x6cd0 bytes) 2024-09-21T22:01:11.048 INFO:teuthology.orchestra.run.smithi102.stdout:1268 write 0x32ab2c3 thru 0x32b2429 (0x7167 bytes) 2024-09-21T22:01:11.050 INFO:teuthology.orchestra.run.smithi102.stdout:1269 writesame 0x16fb616 thru 0x1709a87 data_size 0x39(0xe472 bytes) 2024-09-21T22:01:11.050 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:11.050 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:11.052 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:11.063 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:11.065 INFO:teuthology.orchestra.run.smithi102.stdout:1271 write 0xc05d5da thru 0xc064592 (0x6fb9 bytes) 2024-09-21T22:01:11.073 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:11.073 INFO:teuthology.orchestra.run.smithi102.stdout:1273 trunc from 0xc064593 to 0xc34fdd3 2024-09-21T22:01:11.080 INFO:teuthology.orchestra.run.smithi102.stdout:1275 read 0xc2c1f77 thru 0xc2cb5a5 (0x962f bytes) 2024-09-21T22:01:11.080 INFO:teuthology.orchestra.run.smithi102.stdout:1276 read 0xa8475c9 thru 0xa856e21 (0xf859 bytes) 2024-09-21T22:01:11.080 INFO:teuthology.orchestra.run.smithi102.stdout:1277 writesame 0x1c6c5c0 thru 0x1c79215 data_size 0x5(0xcc56 bytes) 2024-09-21T22:01:11.093 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:01:11.093 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:01:11.094 INFO:teuthology.orchestra.run.smithi102.stdout:1278 write 0xe13dd43 thru 0xe1425e8 (0x48a6 bytes) 2024-09-21T22:01:11.098 INFO:teuthology.orchestra.run.smithi102.stdout:1280 write 0x4bf03aa thru 0x4bf4e74 (0x4acb bytes) 2024-09-21T22:01:11.106 INFO:teuthology.orchestra.run.smithi102.stdout:1282 trunc from 0xe1425e9 to 0x8f90d5c 2024-09-21T22:01:11.108 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-21T22:01:11.007970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":352984547,"num_objects":175,"num_object_clones":34,"num_object_copies":350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175,"num_whiteouts":28,"num_read":14099,"num_read_kb":49680,"num_write":2340,"num_write_kb":15690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1965,"ondisk_log_size":1965,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":225012,"kb_used_data":6664,"kb_used_omap":10,"kb_used_meta":218165,"kb_avail":660377868,"statfs":{"total":676457349120,"available":676226936832,"internally_reserved":0,"allocated":6823936,"data_stored":8492022,"data_compressed":2243189,"data_compressed_allocated":2453504,"data_compressed_original":6549504,"omap_allocated":11156,"internal_metadata":223401068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":261118455,"num_objects":82,"num_object_clones":17,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":12,"num_read":9555,"num_read_kb":28607,"num_write":1569,"num_write_kb":7110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000543"},"pg_stats":[{"pgid":"3.1f","version":"35'30","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.878023+0000","last_change":"2024-09-21T22:00:56.181293+0000","last_active":"2024-09-21T22:01:05.878023+0000","last_peered":"2024-09-21T22:01:05.878023+0000","last_clean":"2024-09-21T22:01:05.878023+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:01:05.878023+0000","last_undegraded":"2024-09-21T22:01:05.878023+0000","last_fullsized":"2024-09-21T22:01:05.878023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:14:06.968007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096701700000000003,"stat_sum":{"num_bytes":1614566,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":23,"num_read_kb":50,"num_write":31,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"34'9","reported_seq":468,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.711946+0000","last_change":"2024-09-21T22:01:00.191153+0000","last_active":"2024-09-21T22:01:06.711946+0000","last_peered":"2024-09-21T22:01:06.711946+0000","last_clean":"2024-09-21T22:01:06.711946+0000","last_became_active":"2024-09-21T22:01:00.187659+0000","last_became_peered":"2024-09-21T22:01:00.187659+0000","last_unstale":"2024-09-21T22:01:06.711946+0000","last_undegraded":"2024-09-21T22:01:06.711946+0000","last_fullsized":"2024-09-21T22:01:06.711946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:55:28.879119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064754199999999997,"stat_sum":{"num_bytes":32633544,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":413,"num_read_kb":3099,"num_write":15,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"35'52","reported_seq":133,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726570+0000","last_change":"2024-09-21T22:00:56.175600+0000","last_active":"2024-09-21T22:01:06.726570+0000","last_peered":"2024-09-21T22:01:06.726570+0000","last_clean":"2024-09-21T22:01:06.726570+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:01:06.726570+0000","last_undegraded":"2024-09-21T22:01:06.726570+0000","last_fullsized":"2024-09-21T22:01:06.726570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:40:28.168893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003077237,"stat_sum":{"num_bytes":4194349,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":74,"num_read_kb":104,"num_write":53,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"36'65","reported_seq":213,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.772741+0000","last_change":"2024-09-21T22:00:56.175356+0000","last_active":"2024-09-21T22:01:06.772741+0000","last_peered":"2024-09-21T22:01:06.772741+0000","last_clean":"2024-09-21T22:01:06.772741+0000","last_became_active":"2024-09-21T22:00:54.161171+0000","last_became_peered":"2024-09-21T22:00:54.161171+0000","last_unstale":"2024-09-21T22:01:06.772741+0000","last_undegraded":"2024-09-21T22:01:06.772741+0000","last_fullsized":"2024-09-21T22:01:06.772741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:21:07.939462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028551459999999998,"stat_sum":{"num_bytes":11012272,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":192,"num_write":62,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"35'47","reported_seq":482,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.002640+0000","last_change":"2024-09-21T22:00:56.180837+0000","last_active":"2024-09-21T22:01:06.002640+0000","last_peered":"2024-09-21T22:01:06.002640+0000","last_clean":"2024-09-21T22:01:06.002640+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:01:06.002640+0000","last_undegraded":"2024-09-21T22:01:06.002640+0000","last_fullsized":"2024-09-21T22:01:06.002640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:47:58.248230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000536288,"stat_sum":{"num_bytes":14325729,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":434,"num_read_kb":142,"num_write":44,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"36'263","reported_seq":717,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.788218+0000","last_change":"2024-09-21T22:00:56.166249+0000","last_active":"2024-09-21T22:01:06.788218+0000","last_peered":"2024-09-21T22:01:06.788218+0000","last_clean":"2024-09-21T22:01:06.788218+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:01:06.788218+0000","last_undegraded":"2024-09-21T22:01:06.788218+0000","last_fullsized":"2024-09-21T22:01:06.788218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:33.309590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085766300000000005,"stat_sum":{"num_bytes":3162174,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1663,"num_read_kb":3902,"num_write":431,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"35'12","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.716583+0000","last_change":"2024-09-21T22:00:56.167992+0000","last_active":"2024-09-21T22:01:06.716583+0000","last_peered":"2024-09-21T22:01:06.716583+0000","last_clean":"2024-09-21T22:01:06.716583+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:01:06.716583+0000","last_undegraded":"2024-09-21T22:01:06.716583+0000","last_fullsized":"2024-09-21T22:01:06.716583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:31:52.875647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000312307,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":13,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"35'48","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.711882+0000","last_change":"2024-09-21T22:00:56.158344+0000","last_active":"2024-09-21T22:01:06.711882+0000","last_peered":"2024-09-21T22:01:06.711882+0000","last_clean":"2024-09-21T22:01:06.711882+0000","last_became_active":"2024-09-21T22:00:54.155140+0000","last_became_peered":"2024-09-21T22:00:54.155140+0000","last_unstale":"2024-09-21T22:01:06.711882+0000","last_undegraded":"2024-09-21T22:01:06.711882+0000","last_fullsized":"2024-09-21T22:01:06.711882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:26:45.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037013200000000001,"stat_sum":{"num_bytes":29431613,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":312,"num_read_kb":3096,"num_write":46,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"35'22","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.956870+0000","last_change":"2024-09-21T22:00:56.181482+0000","last_active":"2024-09-21T22:01:05.956870+0000","last_peered":"2024-09-21T22:01:05.956870+0000","last_clean":"2024-09-21T22:01:05.956870+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:01:05.956870+0000","last_undegraded":"2024-09-21T22:01:05.956870+0000","last_fullsized":"2024-09-21T22:01:05.956870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:26:05.411110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001057845,"stat_sum":{"num_bytes":1359913,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":44,"num_write":24,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'78","reported_seq":784,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726500+0000","last_change":"2024-09-21T22:00:56.175667+0000","last_active":"2024-09-21T22:01:06.726500+0000","last_peered":"2024-09-21T22:01:06.726500+0000","last_clean":"2024-09-21T22:01:06.726500+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:01:06.726500+0000","last_undegraded":"2024-09-21T22:01:06.726500+0000","last_fullsized":"2024-09-21T22:01:06.726500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:09:33.797890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031184279999999999,"stat_sum":{"num_bytes":14781041,"num_objects":12,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":958,"num_read_kb":8788,"num_write":72,"num_write_kb":3439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"35'45","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714612+0000","last_change":"2024-09-21T22:00:56.161375+0000","last_active":"2024-09-21T22:01:06.714612+0000","last_peered":"2024-09-21T22:01:06.714612+0000","last_clean":"2024-09-21T22:01:06.714612+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:01:06.714612+0000","last_undegraded":"2024-09-21T22:01:06.714612+0000","last_fullsized":"2024-09-21T22:01:06.714612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:36:22.049392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057728900000000004,"stat_sum":{"num_bytes":3613815,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":713,"num_read_kb":3413,"num_write":43,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"36'66","reported_seq":255,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714301+0000","last_change":"2024-09-21T22:00:56.165733+0000","last_active":"2024-09-21T22:01:06.714301+0000","last_peered":"2024-09-21T22:01:06.714301+0000","last_clean":"2024-09-21T22:01:06.714301+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:01:06.714301+0000","last_undegraded":"2024-09-21T22:01:06.714301+0000","last_fullsized":"2024-09-21T22:01:06.714301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:06:48.407441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039301800000000002,"stat_sum":{"num_bytes":24249160,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":182,"num_read_kb":204,"num_write":64,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714895+0000","last_change":"2024-09-21T22:01:00.190764+0000","last_active":"2024-09-21T22:01:06.714895+0000","last_peered":"2024-09-21T22:01:06.714895+0000","last_clean":"2024-09-21T22:01:06.714895+0000","last_became_active":"2024-09-21T22:01:00.190495+0000","last_became_peered":"2024-09-21T22:01:00.190495+0000","last_unstale":"2024-09-21T22:01:06.714895+0000","last_undegraded":"2024-09-21T22:01:06.714895+0000","last_fullsized":"2024-09-21T22:01:06.714895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:46:41.347399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"35'17","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.736736+0000","last_change":"2024-09-21T22:00:56.180714+0000","last_active":"2024-09-21T22:01:05.736736+0000","last_peered":"2024-09-21T22:01:05.736736+0000","last_clean":"2024-09-21T22:01:05.736736+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:01:05.736736+0000","last_undegraded":"2024-09-21T22:01:05.736736+0000","last_fullsized":"2024-09-21T22:01:05.736736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:31:24.755948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043178500000000001,"stat_sum":{"num_bytes":2811689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":140,"num_write":18,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.713252+0000","last_change":"2024-09-21T22:01:00.621271+0000","last_active":"2024-09-21T22:01:06.713252+0000","last_peered":"2024-09-21T22:01:06.713252+0000","last_clean":"2024-09-21T22:01:06.713252+0000","last_became_active":"2024-09-21T22:01:00.621037+0000","last_became_peered":"2024-09-21T22:01:00.621037+0000","last_unstale":"2024-09-21T22:01:06.713252+0000","last_undegraded":"2024-09-21T22:01:06.713252+0000","last_fullsized":"2024-09-21T22:01:06.713252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:29:11.566683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"35'113","reported_seq":870,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.712284+0000","last_change":"2024-09-21T22:00:56.159977+0000","last_active":"2024-09-21T22:01:06.712284+0000","last_peered":"2024-09-21T22:01:06.712284+0000","last_clean":"2024-09-21T22:01:06.712284+0000","last_became_active":"2024-09-21T22:00:54.162377+0000","last_became_peered":"2024-09-21T22:00:54.162377+0000","last_unstale":"2024-09-21T22:01:06.712284+0000","last_undegraded":"2024-09-21T22:01:06.712284+0000","last_fullsized":"2024-09-21T22:01:06.712284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:52:28.135482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069122900000000002,"stat_sum":{"num_bytes":1064960,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1760,"num_read_kb":4127,"num_write":106,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714763+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:01:06.714763+0000","last_peered":"2024-09-21T22:01:06.714763+0000","last_clean":"2024-09-21T22:01:06.714763+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:01:06.714763+0000","last_undegraded":"2024-09-21T22:01:06.714763+0000","last_fullsized":"2024-09-21T22:01:06.714763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"35'71","reported_seq":172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.712143+0000","last_change":"2024-09-21T22:00:56.158198+0000","last_active":"2024-09-21T22:01:06.712143+0000","last_peered":"2024-09-21T22:01:06.712143+0000","last_clean":"2024-09-21T22:01:06.712143+0000","last_became_active":"2024-09-21T22:00:54.158128+0000","last_became_peered":"2024-09-21T22:00:54.158128+0000","last_unstale":"2024-09-21T22:01:06.712143+0000","last_undegraded":"2024-09-21T22:01:06.712143+0000","last_fullsized":"2024-09-21T22:01:06.712143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:09:12.726421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046529200000000002,"stat_sum":{"num_bytes":9721613,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":108,"num_read_kb":202,"num_write":70,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.728420+0000","last_change":"2024-09-21T22:00:54.156721+0000","last_active":"2024-09-21T22:01:05.728420+0000","last_peered":"2024-09-21T22:01:05.728420+0000","last_clean":"2024-09-21T22:01:05.728420+0000","last_became_active":"2024-09-21T22:00:54.156336+0000","last_became_peered":"2024-09-21T22:00:54.156336+0000","last_unstale":"2024-09-21T22:01:05.728420+0000","last_undegraded":"2024-09-21T22:01:05.728420+0000","last_fullsized":"2024-09-21T22:01:05.728420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:54:12.268488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"35'52","reported_seq":501,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726609+0000","last_change":"2024-09-21T22:00:56.175852+0000","last_active":"2024-09-21T22:01:06.726609+0000","last_peered":"2024-09-21T22:01:06.726609+0000","last_clean":"2024-09-21T22:01:06.726609+0000","last_became_active":"2024-09-21T22:00:54.156623+0000","last_became_peered":"2024-09-21T22:00:54.156623+0000","last_unstale":"2024-09-21T22:01:06.726609+0000","last_undegraded":"2024-09-21T22:01:06.726609+0000","last_fullsized":"2024-09-21T22:01:06.726609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:21:41.737652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031408949999999999,"stat_sum":{"num_bytes":2113567,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":890,"num_read_kb":3575,"num_write":55,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"36'99","reported_seq":534,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.727526+0000","last_change":"2024-09-21T22:00:56.166325+0000","last_active":"2024-09-21T22:01:06.727526+0000","last_peered":"2024-09-21T22:01:06.727526+0000","last_clean":"2024-09-21T22:01:06.727526+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:01:06.727526+0000","last_undegraded":"2024-09-21T22:01:06.727526+0000","last_fullsized":"2024-09-21T22:01:06.727526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:20:43.613963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091363999999999996,"stat_sum":{"num_bytes":12861069,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":798,"num_read_kb":487,"num_write":153,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726465+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:01:06.726465+0000","last_peered":"2024-09-21T22:01:06.726465+0000","last_clean":"2024-09-21T22:01:06.726465+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:01:06.726465+0000","last_undegraded":"2024-09-21T22:01:06.726465+0000","last_fullsized":"2024-09-21T22:01:06.726465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"35'38","reported_seq":252,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.712083+0000","last_change":"2024-09-21T22:00:56.158370+0000","last_active":"2024-09-21T22:01:06.712083+0000","last_peered":"2024-09-21T22:01:06.712083+0000","last_clean":"2024-09-21T22:01:06.712083+0000","last_became_active":"2024-09-21T22:00:54.156923+0000","last_became_peered":"2024-09-21T22:00:54.156923+0000","last_unstale":"2024-09-21T22:01:06.712083+0000","last_undegraded":"2024-09-21T22:01:06.712083+0000","last_fullsized":"2024-09-21T22:01:06.712083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:01:14.845039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065359599999999999,"stat_sum":{"num_bytes":4223884,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":198,"num_read_kb":2587,"num_write":35,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.712276+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:01:06.712276+0000","last_peered":"2024-09-21T22:01:06.712276+0000","last_clean":"2024-09-21T22:01:06.712276+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:01:06.712276+0000","last_undegraded":"2024-09-21T22:01:06.712276+0000","last_fullsized":"2024-09-21T22:01:06.712276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"32'7","reported_seq":216,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.728301+0000","last_change":"2024-09-21T22:00:56.180594+0000","last_active":"2024-09-21T22:01:05.728301+0000","last_peered":"2024-09-21T22:01:05.728301+0000","last_clean":"2024-09-21T22:01:05.728301+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:01:05.728301+0000","last_undegraded":"2024-09-21T22:01:05.728301+0000","last_fullsized":"2024-09-21T22:01:05.728301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:02:33.666282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039822099999999998,"stat_sum":{"num_bytes":5390374,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":178,"num_read_kb":2811,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714519+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:01:06.714519+0000","last_peered":"2024-09-21T22:01:06.714519+0000","last_clean":"2024-09-21T22:01:06.714519+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:01:06.714519+0000","last_undegraded":"2024-09-21T22:01:06.714519+0000","last_fullsized":"2024-09-21T22:01:06.714519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"36'30","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726287+0000","last_change":"2024-09-21T22:00:56.159828+0000","last_active":"2024-09-21T22:01:06.726287+0000","last_peered":"2024-09-21T22:01:06.726287+0000","last_clean":"2024-09-21T22:01:06.726287+0000","last_became_active":"2024-09-21T22:00:54.157660+0000","last_became_peered":"2024-09-21T22:00:54.157660+0000","last_unstale":"2024-09-21T22:01:06.726287+0000","last_undegraded":"2024-09-21T22:01:06.726287+0000","last_fullsized":"2024-09-21T22:01:06.726287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:17:54.881064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065768700000000001,"stat_sum":{"num_bytes":2146320,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":5,"num_write":32,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726466+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:01:06.726466+0000","last_peered":"2024-09-21T22:01:06.726466+0000","last_clean":"2024-09-21T22:01:06.726466+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:01:06.726466+0000","last_undegraded":"2024-09-21T22:01:06.726466+0000","last_fullsized":"2024-09-21T22:01:06.726466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714542+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:01:06.714542+0000","last_peered":"2024-09-21T22:01:06.714542+0000","last_clean":"2024-09-21T22:01:06.714542+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:01:06.714542+0000","last_undegraded":"2024-09-21T22:01:06.714542+0000","last_fullsized":"2024-09-21T22:01:06.714542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"35'33","reported_seq":716,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.712295+0000","last_change":"2024-09-21T22:00:56.159517+0000","last_active":"2024-09-21T22:01:06.712295+0000","last_peered":"2024-09-21T22:01:06.712295+0000","last_clean":"2024-09-21T22:01:06.712295+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:01:06.712295+0000","last_undegraded":"2024-09-21T22:01:06.712295+0000","last_fullsized":"2024-09-21T22:01:06.712295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:38:05.400315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053085999999999997,"stat_sum":{"num_bytes":52600595,"num_objects":13,"num_object_clones":4,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":691,"num_read_kb":276,"num_write":30,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"36'136","reported_seq":669,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.791825+0000","last_change":"2024-09-21T22:00:56.166480+0000","last_active":"2024-09-21T22:01:06.791825+0000","last_peered":"2024-09-21T22:01:06.791825+0000","last_clean":"2024-09-21T22:01:06.791825+0000","last_became_active":"2024-09-21T22:00:54.160321+0000","last_became_peered":"2024-09-21T22:00:54.160321+0000","last_unstale":"2024-09-21T22:01:06.791825+0000","last_undegraded":"2024-09-21T22:01:06.791825+0000","last_fullsized":"2024-09-21T22:01:06.791825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:01:08.655848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010281190000000001,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1541,"num_read_kb":1335,"num_write":166,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"34'25","reported_seq":512,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.713115+0000","last_change":"2024-09-21T22:01:00.626200+0000","last_active":"2024-09-21T22:01:06.713115+0000","last_peered":"2024-09-21T22:01:06.713115+0000","last_clean":"2024-09-21T22:01:06.713115+0000","last_became_active":"2024-09-21T22:01:00.621864+0000","last_became_peered":"2024-09-21T22:01:00.621864+0000","last_unstale":"2024-09-21T22:01:06.713115+0000","last_undegraded":"2024-09-21T22:01:06.713115+0000","last_fullsized":"2024-09-21T22:01:06.713115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:02:30.458317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090320500000000002,"stat_sum":{"num_bytes":22617511,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":817,"num_read_kb":553,"num_write":21,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"36'16","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.785018+0000","last_change":"2024-09-21T22:00:56.159527+0000","last_active":"2024-09-21T22:01:06.785018+0000","last_peered":"2024-09-21T22:01:06.785018+0000","last_clean":"2024-09-21T22:01:06.785018+0000","last_became_active":"2024-09-21T22:00:54.156515+0000","last_became_peered":"2024-09-21T22:00:54.156515+0000","last_unstale":"2024-09-21T22:01:06.785018+0000","last_undegraded":"2024-09-21T22:01:06.785018+0000","last_fullsized":"2024-09-21T22:01:06.785018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:56:48.671536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073161999999999999,"stat_sum":{"num_bytes":5174400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":16,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"35'48","reported_seq":264,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726535+0000","last_change":"2024-09-21T22:00:56.175447+0000","last_active":"2024-09-21T22:01:06.726535+0000","last_peered":"2024-09-21T22:01:06.726535+0000","last_clean":"2024-09-21T22:01:06.726535+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:01:06.726535+0000","last_undegraded":"2024-09-21T22:01:06.726535+0000","last_fullsized":"2024-09-21T22:01:06.726535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:46.866609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029196539999999998,"stat_sum":{"num_bytes":8267827,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":202,"num_read_kb":2819,"num_write":45,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"35'49","reported_seq":259,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714738+0000","last_change":"2024-09-21T22:00:56.161329+0000","last_active":"2024-09-21T22:01:06.714738+0000","last_peered":"2024-09-21T22:01:06.714738+0000","last_clean":"2024-09-21T22:01:06.714738+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:01:06.714738+0000","last_undegraded":"2024-09-21T22:01:06.714738+0000","last_fullsized":"2024-09-21T22:01:06.714738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:38:25.344544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674853,"stat_sum":{"num_bytes":34363569,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":195,"num_read_kb":267,"num_write":50,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"32'14","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714791+0000","last_change":"2024-09-21T22:00:56.160920+0000","last_active":"2024-09-21T22:01:06.714791+0000","last_peered":"2024-09-21T22:01:06.714791+0000","last_clean":"2024-09-21T22:01:06.714791+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:01:06.714791+0000","last_undegraded":"2024-09-21T22:01:06.714791+0000","last_fullsized":"2024-09-21T22:01:06.714791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:48:43.749131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035276399999999999,"stat_sum":{"num_bytes":2875954,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":22,"num_write":13,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"35'255","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714824+0000","last_change":"2024-09-21T22:00:56.161162+0000","last_active":"2024-09-21T22:01:06.714824+0000","last_peered":"2024-09-21T22:01:06.714824+0000","last_clean":"2024-09-21T22:01:06.714824+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:01:06.714824+0000","last_undegraded":"2024-09-21T22:01:06.714824+0000","last_fullsized":"2024-09-21T22:01:06.714824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:33:55.232465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054637399999999997,"stat_sum":{"num_bytes":20366550,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1023,"num_read_kb":1425,"num_write":354,"num_write_kb":1089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"35'7","reported_seq":219,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.891050+0000","last_change":"2024-09-21T22:01:00.548437+0000","last_active":"2024-09-21T22:01:05.891050+0000","last_peered":"2024-09-21T22:01:05.891050+0000","last_clean":"2024-09-21T22:01:05.891050+0000","last_became_active":"2024-09-21T22:01:00.546491+0000","last_became_peered":"2024-09-21T22:01:00.546491+0000","last_unstale":"2024-09-21T22:01:05.891050+0000","last_undegraded":"2024-09-21T22:01:05.891050+0000","last_fullsized":"2024-09-21T22:01:05.891050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:48:55.439177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297588,"stat_sum":{"num_bytes":7504125,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":164,"num_read_kb":2831,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"35'59","reported_seq":312,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714572+0000","last_change":"2024-09-21T22:00:56.160905+0000","last_active":"2024-09-21T22:01:06.714572+0000","last_peered":"2024-09-21T22:01:06.714572+0000","last_clean":"2024-09-21T22:01:06.714572+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:01:06.714572+0000","last_undegraded":"2024-09-21T22:01:06.714572+0000","last_fullsized":"2024-09-21T22:01:06.714572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:17.165777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042909099999999999,"stat_sum":{"num_bytes":14097769,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":256,"num_read_kb":2991,"num_write":54,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"35'38","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.812742+0000","last_change":"2024-09-21T22:00:56.181344+0000","last_active":"2024-09-21T22:01:05.812742+0000","last_peered":"2024-09-21T22:01:05.812742+0000","last_clean":"2024-09-21T22:01:05.812742+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:01:05.812742+0000","last_undegraded":"2024-09-21T22:01:05.812742+0000","last_fullsized":"2024-09-21T22:01:05.812742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:49:53.748129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096881799999999998,"stat_sum":{"num_bytes":3814170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":51,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"32'1","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714625+0000","last_change":"2024-09-21T22:00:56.161104+0000","last_active":"2024-09-21T22:01:06.714625+0000","last_peered":"2024-09-21T22:01:06.714625+0000","last_clean":"2024-09-21T22:01:06.714625+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:01:06.714625+0000","last_undegraded":"2024-09-21T22:01:06.714625+0000","last_fullsized":"2024-09-21T22:01:06.714625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:43:45.507912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051462399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":352394160,"num_objects":171,"num_object_clones":34,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":171,"num_whiteouts":28,"num_read":13983,"num_read_kb":49580,"num_write":2179,"num_write_kb":13272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3842048,"data_stored":5931420,"data_compressed":2166753,"data_compressed_allocated":2289664,"data_compressed_original":5169152,"omap_allocated":0,"internal_metadata":0},"log_size":1845,"ondisk_log_size":1845,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1212416,"data_stored":1906018,"data_compressed":419934,"data_compressed_allocated":507904,"data_compressed_original":1572864,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":0,"seq":60129542154,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":745472,"data_stored":691909,"data_compressed":108014,"data_compressed_allocated":167936,"data_compressed_original":446464,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1204224,"data_stored":1296621,"data_compressed":437931,"data_compressed_allocated":475136,"data_compressed_original":974848,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1073152,"data_stored":1408725,"data_compressed":460825,"data_compressed_allocated":421888,"data_compressed_original":1110016,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":815104,"data_stored":1054830,"data_compressed":330118,"data_compressed_allocated":270336,"data_compressed_original":802816,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":738562,"data_compressed":258584,"data_compressed_allocated":294912,"data_compressed_original":499712,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":909312,"data_stored":1395357,"data_compressed":227783,"data_compressed_allocated":315392,"data_compressed_original":1142784,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":630793,"data_compressed":268792,"data_compressed_allocated":315392,"data_compressed_original":552960,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":575298,"data_compressed":258584,"data_compressed_allocated":294912,"data_compressed_original":499712,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":891585,"data_compressed":330118,"data_compressed_allocated":270336,"data_compressed_original":802816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":1158615,"data_compressed":412249,"data_compressed_allocated":368640,"data_compressed_original":1032192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":806912,"data_stored":1133376,"data_compressed":437931,"data_compressed_allocated":475136,"data_compressed_original":974848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":506112,"data_compressed":95201,"data_compressed_allocated":151552,"data_compressed_original":425984,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":704512,"data_stored":1035641,"data_compressed":363878,"data_compressed_allocated":413696,"data_compressed_original":880640,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:01:11.110 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:01:11.118 INFO:teuthology.orchestra.run.smithi102.stdout:1283 read 0x5e9daa4 thru 0x5ea4993 (0x6ef0 bytes) 2024-09-21T22:01:11.130 INFO:teuthology.orchestra.run.smithi102.stdout:1285 write 0xc526e49 thru 0xc53268f (0xb847 bytes) 2024-09-21T22:01:11.133 INFO:teuthology.orchestra.run.smithi102.stdout:1286 read 0x5993a1e thru 0x59a0a99 (0xd07c bytes) 2024-09-21T22:01:11.134 INFO:teuthology.orchestra.run.smithi102.stdout:1289 read 0x24dfd8a thru 0x24e4c1d (0x4e94 bytes) 2024-09-21T22:01:11.134 INFO:teuthology.orchestra.run.smithi102.stdout:1291 clone 10 order 24 su 8388608 sc 2 2024-09-21T22:01:11.146 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:11.144+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:11.182 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:11.182 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:11.191 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:11.247 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:11.246+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:11.335 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:11.335 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:11.345 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:11.348 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:11.347+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:11.404 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:01:11.404 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:01:11.416 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-21T22:01:11.007970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":352984547,"num_objects":175,"num_object_clones":34,"num_object_copies":350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175,"num_whiteouts":28,"num_read":14099,"num_read_kb":49680,"num_write":2340,"num_write_kb":15690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1965,"ondisk_log_size":1965,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":225012,"kb_used_data":6664,"kb_used_omap":10,"kb_used_meta":218165,"kb_avail":660377868,"statfs":{"total":676457349120,"available":676226936832,"internally_reserved":0,"allocated":6823936,"data_stored":8492022,"data_compressed":2243189,"data_compressed_allocated":2453504,"data_compressed_original":6549504,"omap_allocated":11156,"internal_metadata":223401068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":261118455,"num_objects":82,"num_object_clones":17,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":12,"num_read":9555,"num_read_kb":28607,"num_write":1569,"num_write_kb":7110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000543"},"pg_stats":[{"pgid":"3.1f","version":"35'30","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.878023+0000","last_change":"2024-09-21T22:00:56.181293+0000","last_active":"2024-09-21T22:01:05.878023+0000","last_peered":"2024-09-21T22:01:05.878023+0000","last_clean":"2024-09-21T22:01:05.878023+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:01:05.878023+0000","last_undegraded":"2024-09-21T22:01:05.878023+0000","last_fullsized":"2024-09-21T22:01:05.878023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:14:06.968007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096701700000000003,"stat_sum":{"num_bytes":1614566,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":23,"num_read_kb":50,"num_write":31,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"34'9","reported_seq":468,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.711946+0000","last_change":"2024-09-21T22:01:00.191153+0000","last_active":"2024-09-21T22:01:06.711946+0000","last_peered":"2024-09-21T22:01:06.711946+0000","last_clean":"2024-09-21T22:01:06.711946+0000","last_became_active":"2024-09-21T22:01:00.187659+0000","last_became_peered":"2024-09-21T22:01:00.187659+0000","last_unstale":"2024-09-21T22:01:06.711946+0000","last_undegraded":"2024-09-21T22:01:06.711946+0000","last_fullsized":"2024-09-21T22:01:06.711946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:55:28.879119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064754199999999997,"stat_sum":{"num_bytes":32633544,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":413,"num_read_kb":3099,"num_write":15,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"35'52","reported_seq":133,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726570+0000","last_change":"2024-09-21T22:00:56.175600+0000","last_active":"2024-09-21T22:01:06.726570+0000","last_peered":"2024-09-21T22:01:06.726570+0000","last_clean":"2024-09-21T22:01:06.726570+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:01:06.726570+0000","last_undegraded":"2024-09-21T22:01:06.726570+0000","last_fullsized":"2024-09-21T22:01:06.726570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:40:28.168893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003077237,"stat_sum":{"num_bytes":4194349,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":74,"num_read_kb":104,"num_write":53,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"36'65","reported_seq":213,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.772741+0000","last_change":"2024-09-21T22:00:56.175356+0000","last_active":"2024-09-21T22:01:06.772741+0000","last_peered":"2024-09-21T22:01:06.772741+0000","last_clean":"2024-09-21T22:01:06.772741+0000","last_became_active":"2024-09-21T22:00:54.161171+0000","last_became_peered":"2024-09-21T22:00:54.161171+0000","last_unstale":"2024-09-21T22:01:06.772741+0000","last_undegraded":"2024-09-21T22:01:06.772741+0000","last_fullsized":"2024-09-21T22:01:06.772741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:21:07.939462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028551459999999998,"stat_sum":{"num_bytes":11012272,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":192,"num_write":62,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"35'47","reported_seq":482,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.002640+0000","last_change":"2024-09-21T22:00:56.180837+0000","last_active":"2024-09-21T22:01:06.002640+0000","last_peered":"2024-09-21T22:01:06.002640+0000","last_clean":"2024-09-21T22:01:06.002640+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:01:06.002640+0000","last_undegraded":"2024-09-21T22:01:06.002640+0000","last_fullsized":"2024-09-21T22:01:06.002640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:47:58.248230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000536288,"stat_sum":{"num_bytes":14325729,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":434,"num_read_kb":142,"num_write":44,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"36'263","reported_seq":717,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.788218+0000","last_change":"2024-09-21T22:00:56.166249+0000","last_active":"2024-09-21T22:01:06.788218+0000","last_peered":"2024-09-21T22:01:06.788218+0000","last_clean":"2024-09-21T22:01:06.788218+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:01:06.788218+0000","last_undegraded":"2024-09-21T22:01:06.788218+0000","last_fullsized":"2024-09-21T22:01:06.788218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:33.309590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085766300000000005,"stat_sum":{"num_bytes":3162174,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1663,"num_read_kb":3902,"num_write":431,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"35'12","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.716583+0000","last_change":"2024-09-21T22:00:56.167992+0000","last_active":"2024-09-21T22:01:06.716583+0000","last_peered":"2024-09-21T22:01:06.716583+0000","last_clean":"2024-09-21T22:01:06.716583+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:01:06.716583+0000","last_undegraded":"2024-09-21T22:01:06.716583+0000","last_fullsized":"2024-09-21T22:01:06.716583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:31:52.875647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000312307,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":13,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"35'48","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.711882+0000","last_change":"2024-09-21T22:00:56.158344+0000","last_active":"2024-09-21T22:01:06.711882+0000","last_peered":"2024-09-21T22:01:06.711882+0000","last_clean":"2024-09-21T22:01:06.711882+0000","last_became_active":"2024-09-21T22:00:54.155140+0000","last_became_peered":"2024-09-21T22:00:54.155140+0000","last_unstale":"2024-09-21T22:01:06.711882+0000","last_undegraded":"2024-09-21T22:01:06.711882+0000","last_fullsized":"2024-09-21T22:01:06.711882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:26:45.587451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037013200000000001,"stat_sum":{"num_bytes":29431613,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":312,"num_read_kb":3096,"num_write":46,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"35'22","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.956870+0000","last_change":"2024-09-21T22:00:56.181482+0000","last_active":"2024-09-21T22:01:05.956870+0000","last_peered":"2024-09-21T22:01:05.956870+0000","last_clean":"2024-09-21T22:01:05.956870+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:01:05.956870+0000","last_undegraded":"2024-09-21T22:01:05.956870+0000","last_fullsized":"2024-09-21T22:01:05.956870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:26:05.411110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001057845,"stat_sum":{"num_bytes":1359913,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":44,"num_write":24,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'78","reported_seq":784,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726500+0000","last_change":"2024-09-21T22:00:56.175667+0000","last_active":"2024-09-21T22:01:06.726500+0000","last_peered":"2024-09-21T22:01:06.726500+0000","last_clean":"2024-09-21T22:01:06.726500+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:01:06.726500+0000","last_undegraded":"2024-09-21T22:01:06.726500+0000","last_fullsized":"2024-09-21T22:01:06.726500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:09:33.797890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031184279999999999,"stat_sum":{"num_bytes":14781041,"num_objects":12,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":958,"num_read_kb":8788,"num_write":72,"num_write_kb":3439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"35'45","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714612+0000","last_change":"2024-09-21T22:00:56.161375+0000","last_active":"2024-09-21T22:01:06.714612+0000","last_peered":"2024-09-21T22:01:06.714612+0000","last_clean":"2024-09-21T22:01:06.714612+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:01:06.714612+0000","last_undegraded":"2024-09-21T22:01:06.714612+0000","last_fullsized":"2024-09-21T22:01:06.714612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:36:22.049392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057728900000000004,"stat_sum":{"num_bytes":3613815,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":713,"num_read_kb":3413,"num_write":43,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"36'66","reported_seq":255,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714301+0000","last_change":"2024-09-21T22:00:56.165733+0000","last_active":"2024-09-21T22:01:06.714301+0000","last_peered":"2024-09-21T22:01:06.714301+0000","last_clean":"2024-09-21T22:01:06.714301+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:01:06.714301+0000","last_undegraded":"2024-09-21T22:01:06.714301+0000","last_fullsized":"2024-09-21T22:01:06.714301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:06:48.407441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039301800000000002,"stat_sum":{"num_bytes":24249160,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":182,"num_read_kb":204,"num_write":64,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714895+0000","last_change":"2024-09-21T22:01:00.190764+0000","last_active":"2024-09-21T22:01:06.714895+0000","last_peered":"2024-09-21T22:01:06.714895+0000","last_clean":"2024-09-21T22:01:06.714895+0000","last_became_active":"2024-09-21T22:01:00.190495+0000","last_became_peered":"2024-09-21T22:01:00.190495+0000","last_unstale":"2024-09-21T22:01:06.714895+0000","last_undegraded":"2024-09-21T22:01:06.714895+0000","last_fullsized":"2024-09-21T22:01:06.714895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:46:41.347399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"35'17","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.736736+0000","last_change":"2024-09-21T22:00:56.180714+0000","last_active":"2024-09-21T22:01:05.736736+0000","last_peered":"2024-09-21T22:01:05.736736+0000","last_clean":"2024-09-21T22:01:05.736736+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:01:05.736736+0000","last_undegraded":"2024-09-21T22:01:05.736736+0000","last_fullsized":"2024-09-21T22:01:05.736736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:31:24.755948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043178500000000001,"stat_sum":{"num_bytes":2811689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":140,"num_write":18,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.713252+0000","last_change":"2024-09-21T22:01:00.621271+0000","last_active":"2024-09-21T22:01:06.713252+0000","last_peered":"2024-09-21T22:01:06.713252+0000","last_clean":"2024-09-21T22:01:06.713252+0000","last_became_active":"2024-09-21T22:01:00.621037+0000","last_became_peered":"2024-09-21T22:01:00.621037+0000","last_unstale":"2024-09-21T22:01:06.713252+0000","last_undegraded":"2024-09-21T22:01:06.713252+0000","last_fullsized":"2024-09-21T22:01:06.713252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:29:11.566683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"35'113","reported_seq":870,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.712284+0000","last_change":"2024-09-21T22:00:56.159977+0000","last_active":"2024-09-21T22:01:06.712284+0000","last_peered":"2024-09-21T22:01:06.712284+0000","last_clean":"2024-09-21T22:01:06.712284+0000","last_became_active":"2024-09-21T22:00:54.162377+0000","last_became_peered":"2024-09-21T22:00:54.162377+0000","last_unstale":"2024-09-21T22:01:06.712284+0000","last_undegraded":"2024-09-21T22:01:06.712284+0000","last_fullsized":"2024-09-21T22:01:06.712284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:52:28.135482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069122900000000002,"stat_sum":{"num_bytes":1064960,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1760,"num_read_kb":4127,"num_write":106,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714763+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:01:06.714763+0000","last_peered":"2024-09-21T22:01:06.714763+0000","last_clean":"2024-09-21T22:01:06.714763+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:01:06.714763+0000","last_undegraded":"2024-09-21T22:01:06.714763+0000","last_fullsized":"2024-09-21T22:01:06.714763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"35'71","reported_seq":172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.712143+0000","last_change":"2024-09-21T22:00:56.158198+0000","last_active":"2024-09-21T22:01:06.712143+0000","last_peered":"2024-09-21T22:01:06.712143+0000","last_clean":"2024-09-21T22:01:06.712143+0000","last_became_active":"2024-09-21T22:00:54.158128+0000","last_became_peered":"2024-09-21T22:00:54.158128+0000","last_unstale":"2024-09-21T22:01:06.712143+0000","last_undegraded":"2024-09-21T22:01:06.712143+0000","last_fullsized":"2024-09-21T22:01:06.712143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:09:12.726421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046529200000000002,"stat_sum":{"num_bytes":9721613,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":108,"num_read_kb":202,"num_write":70,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.728420+0000","last_change":"2024-09-21T22:00:54.156721+0000","last_active":"2024-09-21T22:01:05.728420+0000","last_peered":"2024-09-21T22:01:05.728420+0000","last_clean":"2024-09-21T22:01:05.728420+0000","last_became_active":"2024-09-21T22:00:54.156336+0000","last_became_peered":"2024-09-21T22:00:54.156336+0000","last_unstale":"2024-09-21T22:01:05.728420+0000","last_undegraded":"2024-09-21T22:01:05.728420+0000","last_fullsized":"2024-09-21T22:01:05.728420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:54:12.268488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"35'52","reported_seq":501,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726609+0000","last_change":"2024-09-21T22:00:56.175852+0000","last_active":"2024-09-21T22:01:06.726609+0000","last_peered":"2024-09-21T22:01:06.726609+0000","last_clean":"2024-09-21T22:01:06.726609+0000","last_became_active":"2024-09-21T22:00:54.156623+0000","last_became_peered":"2024-09-21T22:00:54.156623+0000","last_unstale":"2024-09-21T22:01:06.726609+0000","last_undegraded":"2024-09-21T22:01:06.726609+0000","last_fullsized":"2024-09-21T22:01:06.726609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:21:41.737652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031408949999999999,"stat_sum":{"num_bytes":2113567,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":890,"num_read_kb":3575,"num_write":55,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"36'99","reported_seq":534,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.727526+0000","last_change":"2024-09-21T22:00:56.166325+0000","last_active":"2024-09-21T22:01:06.727526+0000","last_peered":"2024-09-21T22:01:06.727526+0000","last_clean":"2024-09-21T22:01:06.727526+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:01:06.727526+0000","last_undegraded":"2024-09-21T22:01:06.727526+0000","last_fullsized":"2024-09-21T22:01:06.727526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:20:43.613963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091363999999999996,"stat_sum":{"num_bytes":12861069,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":798,"num_read_kb":487,"num_write":153,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726465+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:01:06.726465+0000","last_peered":"2024-09-21T22:01:06.726465+0000","last_clean":"2024-09-21T22:01:06.726465+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:01:06.726465+0000","last_undegraded":"2024-09-21T22:01:06.726465+0000","last_fullsized":"2024-09-21T22:01:06.726465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"35'38","reported_seq":252,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.712083+0000","last_change":"2024-09-21T22:00:56.158370+0000","last_active":"2024-09-21T22:01:06.712083+0000","last_peered":"2024-09-21T22:01:06.712083+0000","last_clean":"2024-09-21T22:01:06.712083+0000","last_became_active":"2024-09-21T22:00:54.156923+0000","last_became_peered":"2024-09-21T22:00:54.156923+0000","last_unstale":"2024-09-21T22:01:06.712083+0000","last_undegraded":"2024-09-21T22:01:06.712083+0000","last_fullsized":"2024-09-21T22:01:06.712083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:01:14.845039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065359599999999999,"stat_sum":{"num_bytes":4223884,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":198,"num_read_kb":2587,"num_write":35,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.712276+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:01:06.712276+0000","last_peered":"2024-09-21T22:01:06.712276+0000","last_clean":"2024-09-21T22:01:06.712276+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:01:06.712276+0000","last_undegraded":"2024-09-21T22:01:06.712276+0000","last_fullsized":"2024-09-21T22:01:06.712276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"32'7","reported_seq":216,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.728301+0000","last_change":"2024-09-21T22:00:56.180594+0000","last_active":"2024-09-21T22:01:05.728301+0000","last_peered":"2024-09-21T22:01:05.728301+0000","last_clean":"2024-09-21T22:01:05.728301+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:01:05.728301+0000","last_undegraded":"2024-09-21T22:01:05.728301+0000","last_fullsized":"2024-09-21T22:01:05.728301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:02:33.666282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039822099999999998,"stat_sum":{"num_bytes":5390374,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":178,"num_read_kb":2811,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714519+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:01:06.714519+0000","last_peered":"2024-09-21T22:01:06.714519+0000","last_clean":"2024-09-21T22:01:06.714519+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:01:06.714519+0000","last_undegraded":"2024-09-21T22:01:06.714519+0000","last_fullsized":"2024-09-21T22:01:06.714519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"36'30","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726287+0000","last_change":"2024-09-21T22:00:56.159828+0000","last_active":"2024-09-21T22:01:06.726287+0000","last_peered":"2024-09-21T22:01:06.726287+0000","last_clean":"2024-09-21T22:01:06.726287+0000","last_became_active":"2024-09-21T22:00:54.157660+0000","last_became_peered":"2024-09-21T22:00:54.157660+0000","last_unstale":"2024-09-21T22:01:06.726287+0000","last_undegraded":"2024-09-21T22:01:06.726287+0000","last_fullsized":"2024-09-21T22:01:06.726287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:17:54.881064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065768700000000001,"stat_sum":{"num_bytes":2146320,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":5,"num_write":32,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726466+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:01:06.726466+0000","last_peered":"2024-09-21T22:01:06.726466+0000","last_clean":"2024-09-21T22:01:06.726466+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:01:06.726466+0000","last_undegraded":"2024-09-21T22:01:06.726466+0000","last_fullsized":"2024-09-21T22:01:06.726466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714542+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:01:06.714542+0000","last_peered":"2024-09-21T22:01:06.714542+0000","last_clean":"2024-09-21T22:01:06.714542+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:01:06.714542+0000","last_undegraded":"2024-09-21T22:01:06.714542+0000","last_fullsized":"2024-09-21T22:01:06.714542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"35'33","reported_seq":716,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.712295+0000","last_change":"2024-09-21T22:00:56.159517+0000","last_active":"2024-09-21T22:01:06.712295+0000","last_peered":"2024-09-21T22:01:06.712295+0000","last_clean":"2024-09-21T22:01:06.712295+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:01:06.712295+0000","last_undegraded":"2024-09-21T22:01:06.712295+0000","last_fullsized":"2024-09-21T22:01:06.712295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:38:05.400315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053085999999999997,"stat_sum":{"num_bytes":52600595,"num_objects":13,"num_object_clones":4,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":691,"num_read_kb":276,"num_write":30,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"36'136","reported_seq":669,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.791825+0000","last_change":"2024-09-21T22:00:56.166480+0000","last_active":"2024-09-21T22:01:06.791825+0000","last_peered":"2024-09-21T22:01:06.791825+0000","last_clean":"2024-09-21T22:01:06.791825+0000","last_became_active":"2024-09-21T22:00:54.160321+0000","last_became_peered":"2024-09-21T22:00:54.160321+0000","last_unstale":"2024-09-21T22:01:06.791825+0000","last_undegraded":"2024-09-21T22:01:06.791825+0000","last_fullsized":"2024-09-21T22:01:06.791825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:01:08.655848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010281190000000001,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1541,"num_read_kb":1335,"num_write":166,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"34'25","reported_seq":512,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.713115+0000","last_change":"2024-09-21T22:01:00.626200+0000","last_active":"2024-09-21T22:01:06.713115+0000","last_peered":"2024-09-21T22:01:06.713115+0000","last_clean":"2024-09-21T22:01:06.713115+0000","last_became_active":"2024-09-21T22:01:00.621864+0000","last_became_peered":"2024-09-21T22:01:00.621864+0000","last_unstale":"2024-09-21T22:01:06.713115+0000","last_undegraded":"2024-09-21T22:01:06.713115+0000","last_fullsized":"2024-09-21T22:01:06.713115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:02:30.458317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090320500000000002,"stat_sum":{"num_bytes":22617511,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":817,"num_read_kb":553,"num_write":21,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"36'16","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.785018+0000","last_change":"2024-09-21T22:00:56.159527+0000","last_active":"2024-09-21T22:01:06.785018+0000","last_peered":"2024-09-21T22:01:06.785018+0000","last_clean":"2024-09-21T22:01:06.785018+0000","last_became_active":"2024-09-21T22:00:54.156515+0000","last_became_peered":"2024-09-21T22:00:54.156515+0000","last_unstale":"2024-09-21T22:01:06.785018+0000","last_undegraded":"2024-09-21T22:01:06.785018+0000","last_fullsized":"2024-09-21T22:01:06.785018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:56:48.671536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073161999999999999,"stat_sum":{"num_bytes":5174400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":16,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"35'48","reported_seq":264,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.726535+0000","last_change":"2024-09-21T22:00:56.175447+0000","last_active":"2024-09-21T22:01:06.726535+0000","last_peered":"2024-09-21T22:01:06.726535+0000","last_clean":"2024-09-21T22:01:06.726535+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:01:06.726535+0000","last_undegraded":"2024-09-21T22:01:06.726535+0000","last_fullsized":"2024-09-21T22:01:06.726535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:48:46.866609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029196539999999998,"stat_sum":{"num_bytes":8267827,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":202,"num_read_kb":2819,"num_write":45,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"35'49","reported_seq":259,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714738+0000","last_change":"2024-09-21T22:00:56.161329+0000","last_active":"2024-09-21T22:01:06.714738+0000","last_peered":"2024-09-21T22:01:06.714738+0000","last_clean":"2024-09-21T22:01:06.714738+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:01:06.714738+0000","last_undegraded":"2024-09-21T22:01:06.714738+0000","last_fullsized":"2024-09-21T22:01:06.714738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:38:25.344544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674853,"stat_sum":{"num_bytes":34363569,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":195,"num_read_kb":267,"num_write":50,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"32'14","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714791+0000","last_change":"2024-09-21T22:00:56.160920+0000","last_active":"2024-09-21T22:01:06.714791+0000","last_peered":"2024-09-21T22:01:06.714791+0000","last_clean":"2024-09-21T22:01:06.714791+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:01:06.714791+0000","last_undegraded":"2024-09-21T22:01:06.714791+0000","last_fullsized":"2024-09-21T22:01:06.714791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:48:43.749131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035276399999999999,"stat_sum":{"num_bytes":2875954,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":22,"num_write":13,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"35'255","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714824+0000","last_change":"2024-09-21T22:00:56.161162+0000","last_active":"2024-09-21T22:01:06.714824+0000","last_peered":"2024-09-21T22:01:06.714824+0000","last_clean":"2024-09-21T22:01:06.714824+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:01:06.714824+0000","last_undegraded":"2024-09-21T22:01:06.714824+0000","last_fullsized":"2024-09-21T22:01:06.714824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:33:55.232465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054637399999999997,"stat_sum":{"num_bytes":20366550,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1023,"num_read_kb":1425,"num_write":354,"num_write_kb":1089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"35'7","reported_seq":219,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.891050+0000","last_change":"2024-09-21T22:01:00.548437+0000","last_active":"2024-09-21T22:01:05.891050+0000","last_peered":"2024-09-21T22:01:05.891050+0000","last_clean":"2024-09-21T22:01:05.891050+0000","last_became_active":"2024-09-21T22:01:00.546491+0000","last_became_peered":"2024-09-21T22:01:00.546491+0000","last_unstale":"2024-09-21T22:01:05.891050+0000","last_undegraded":"2024-09-21T22:01:05.891050+0000","last_fullsized":"2024-09-21T22:01:05.891050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:48:55.439177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297588,"stat_sum":{"num_bytes":7504125,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":164,"num_read_kb":2831,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"35'59","reported_seq":312,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714572+0000","last_change":"2024-09-21T22:00:56.160905+0000","last_active":"2024-09-21T22:01:06.714572+0000","last_peered":"2024-09-21T22:01:06.714572+0000","last_clean":"2024-09-21T22:01:06.714572+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:01:06.714572+0000","last_undegraded":"2024-09-21T22:01:06.714572+0000","last_fullsized":"2024-09-21T22:01:06.714572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:17.165777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042909099999999999,"stat_sum":{"num_bytes":14097769,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":256,"num_read_kb":2991,"num_write":54,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"35'38","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-21T22:01:05.812742+0000","last_change":"2024-09-21T22:00:56.181344+0000","last_active":"2024-09-21T22:01:05.812742+0000","last_peered":"2024-09-21T22:01:05.812742+0000","last_clean":"2024-09-21T22:01:05.812742+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:01:05.812742+0000","last_undegraded":"2024-09-21T22:01:05.812742+0000","last_fullsized":"2024-09-21T22:01:05.812742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:49:53.748129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096881799999999998,"stat_sum":{"num_bytes":3814170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":51,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"32'1","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T22:01:06.714625+0000","last_change":"2024-09-21T22:00:56.161104+0000","last_active":"2024-09-21T22:01:06.714625+0000","last_peered":"2024-09-21T22:01:06.714625+0000","last_clean":"2024-09-21T22:01:06.714625+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:01:06.714625+0000","last_undegraded":"2024-09-21T22:01:06.714625+0000","last_fullsized":"2024-09-21T22:01:06.714625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:43:45.507912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051462399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":352394160,"num_objects":171,"num_object_clones":34,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":171,"num_whiteouts":28,"num_read":13983,"num_read_kb":49580,"num_write":2179,"num_write_kb":13272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3842048,"data_stored":5931420,"data_compressed":2166753,"data_compressed_allocated":2289664,"data_compressed_original":5169152,"omap_allocated":0,"internal_metadata":0},"log_size":1845,"ondisk_log_size":1845,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1212416,"data_stored":1906018,"data_compressed":419934,"data_compressed_allocated":507904,"data_compressed_original":1572864,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":0,"seq":60129542154,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":745472,"data_stored":691909,"data_compressed":108014,"data_compressed_allocated":167936,"data_compressed_original":446464,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1204224,"data_stored":1296621,"data_compressed":437931,"data_compressed_allocated":475136,"data_compressed_original":974848,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1073152,"data_stored":1408725,"data_compressed":460825,"data_compressed_allocated":421888,"data_compressed_original":1110016,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":815104,"data_stored":1054830,"data_compressed":330118,"data_compressed_allocated":270336,"data_compressed_original":802816,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":738562,"data_compressed":258584,"data_compressed_allocated":294912,"data_compressed_original":499712,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":909312,"data_stored":1395357,"data_compressed":227783,"data_compressed_allocated":315392,"data_compressed_original":1142784,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":630793,"data_compressed":268792,"data_compressed_allocated":315392,"data_compressed_original":552960,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":575298,"data_compressed":258584,"data_compressed_allocated":294912,"data_compressed_original":499712,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":891585,"data_compressed":330118,"data_compressed_allocated":270336,"data_compressed_original":802816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":1158615,"data_compressed":412249,"data_compressed_allocated":368640,"data_compressed_original":1032192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":806912,"data_stored":1133376,"data_compressed":437931,"data_compressed_allocated":475136,"data_compressed_original":974848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":506112,"data_compressed":95201,"data_compressed_allocated":151552,"data_compressed_original":425984,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":704512,"data_stored":1035641,"data_compressed":363878,"data_compressed_allocated":413696,"data_compressed_original":880640,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:01:11.419 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T22:01:11.419 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:01:11.420 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-21T22:01:11.420 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-21T22:01:11.448 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:11.448 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:11.458 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:11.464 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:11.462+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:11.550 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:11.549+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:11.554 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-21T22:01:11.561 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:11.562 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:11.571 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:11.655 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:11.654+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:11.715 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:11.715 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:11.724 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:11.726 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-21T22:01:11.765 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:11.764+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:11.830 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone9 from 0xc532690 (overlap 0xc85362) to 0x6429b1 2024-09-21T22:01:11.852 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:11.850+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:11.873 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:11.873 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:11.875 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-21T22:01:11.882 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:11.912 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-21T22:01:11.952 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:11.952+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:11.971 INFO:teuthology.orchestra.run.smithi102.stdout:1292 trunc from 0xc532690 to 0xb7528d0 2024-09-21T22:01:11.983 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:11.983 INFO:teuthology.orchestra.run.smithi102.stdout:1298 trunc from 0xb7528d0 to 0xbc59014 2024-09-21T22:01:11.988 INFO:teuthology.orchestra.run.smithi102.stdout:1302 punch from 0xf24547 to 0xf2b962, (0x741b bytes) 2024-09-21T22:01:11.989 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:11.989 INFO:teuthology.orchestra.run.smithi102.stdout:1304 punch from 0x2c1cf58 to 0x2c1f30a, (0x23b2 bytes) 2024-09-21T22:01:11.990 INFO:teuthology.orchestra.run.smithi102.stdout:1305 trunc from 0xbc59014 to 0xcccd101 2024-09-21T22:01:11.994 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:11.995 INFO:teuthology.orchestra.run.smithi102.stdout:1307 punch from 0x2d0f24d to 0x2d19a27, (0xa7da bytes) 2024-09-21T22:01:11.995 INFO:teuthology.orchestra.run.smithi102.stdout:1308 punch from 0x745f811 to 0x746f3b8, (0xfba7 bytes) 2024-09-21T22:01:11.995 INFO:teuthology.orchestra.run.smithi102.stdout:1309 writesame 0xbb4f19e thru 0xbb55e73 data_size 0x1(0x6cd6 bytes) 2024-09-21T22:01:11.995 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:11.995 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:12.006 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:12.008 INFO:teuthology.orchestra.run.smithi102.stdout:1310 punch from 0x75f12e9 to 0x75fa798, (0x94af bytes) 2024-09-21T22:01:12.021 INFO:teuthology.orchestra.run.smithi102.stdout:1312 trunc from 0xcccd101 to 0x1b22d1f 2024-09-21T22:01:12.039 INFO:teuthology.orchestra.run.smithi102.stdout:1313 read 0x2da268 thru 0x2df14b (0x4ee4 bytes) 2024-09-21T22:01:12.040 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:12.040 INFO:teuthology.orchestra.run.smithi102.stdout:1315 punch from 0x17a8c82 to 0x17b29fc, (0x9d7a bytes) 2024-09-21T22:01:12.040 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:12.040 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:12.040 INFO:teuthology.orchestra.run.smithi102.stdout:1318 read 0xd1eaf0 thru 0xd2a931 (0xbe42 bytes) 2024-09-21T22:01:12.041 INFO:teuthology.orchestra.run.smithi102.stdout:1319 trunc from 0x1b22d1f to 0x14278cb 2024-09-21T22:01:12.060 INFO:teuthology.orchestra.run.smithi102.stdout:1320 read 0xbea917 thru 0xbf574d (0xae37 bytes) 2024-09-21T22:01:12.060 INFO:teuthology.orchestra.run.smithi102.stdout:1321 clone 11 order 21 su 262144 sc 5 2024-09-21T22:01:12.068 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-21T22:01:12.090 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:12.089+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:12.150 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:12.150 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:12.154 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:12.153+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:12.158 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:12.203 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-21T22:01:12.255 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:12.254+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:12.302 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:12.302 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:12.311 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:12.337 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-21T22:01:12.395 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:12.394+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:12.455 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:12.455 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:12.456 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:12.455+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:12.464 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:12.557 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:12.555+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:12.609 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:12.609 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:12.618 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:12.661 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:12.660+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:12.721 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:12.721 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:12.729 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:12.758 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:01:12.771 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:12.770+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:12.825 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone10 from 0x14278cb (overlap 0x14278cb) to 0xe1baf4 2024-09-21T22:01:12.860 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:12.859+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:12.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:12.878 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:12.878 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:12.888 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:12.928 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-21T22:01:12.956 INFO:teuthology.orchestra.run.smithi102.stdout:1323 trunc from 0x14278cb to 0xa7c0a25 2024-09-21T22:01:12.965 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:12.965 INFO:teuthology.orchestra.run.smithi102.stdout:1326 flatten 2024-09-21T22:01:12.972 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:12.971+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:12.993 INFO:teuthology.orchestra.run.smithi102.stdout:1327 punch from 0x95e2542 to 0x95e8928, (0x63e6 bytes) 2024-09-21T22:01:12.993 INFO:teuthology.orchestra.run.smithi102.stdout:1328 write 0x2be6581 thru 0x2bf014f (0x9bcf bytes) 2024-09-21T22:01:12.998 INFO:teuthology.orchestra.run.smithi102.stdout:1329 read 0xa0461d thru 0xa0c749 (0x812d bytes) 2024-09-21T22:01:12.998 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:12.998 INFO:teuthology.orchestra.run.smithi102.stdout:1331 write 0x7aa1ed4 thru 0x7aaf2e4 (0xd411 bytes) 2024-09-21T22:01:13.001 INFO:teuthology.orchestra.run.smithi102.stdout:1332 read 0x8b7e771 thru 0x8b81de9 (0x3679 bytes) 2024-09-21T22:01:13.001 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.002 INFO:teuthology.orchestra.run.smithi102.stdout:1336 trunc from 0xa7c0a25 to 0xb8507b3 2024-09-21T22:01:13.007 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:13.007 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:13.008 INFO:teuthology.orchestra.run.smithi102.stdout:1337 read 0xb7889a0 thru 0xb797d37 (0xf398 bytes) 2024-09-21T22:01:13.008 INFO:teuthology.orchestra.run.smithi102.stdout:1338 read 0xa0ba79b thru 0xa0c7b9d (0xd403 bytes) 2024-09-21T22:01:13.008 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.008 INFO:teuthology.orchestra.run.smithi102.stdout:1344 writesame 0xb4478a8 thru 0xb44bb23 data_size 0x2e(0x427c bytes) 2024-09-21T22:01:13.011 INFO:teuthology.orchestra.run.smithi102.stdout:1346 writesame 0x90a1f2c thru 0x90a3a32 data_size 0x11(0x1b07 bytes) 2024-09-21T22:01:13.021 INFO:teuthology.orchestra.run.smithi102.stdout:1347 write 0xde06dac thru 0xde1644b (0xf6a0 bytes) 2024-09-21T22:01:13.024 INFO:teuthology.orchestra.run.smithi102.stdout:1348 read 0x8b97342 thru 0x8b9eb5d (0x781c bytes) 2024-09-21T22:01:13.024 INFO:teuthology.orchestra.run.smithi102.stdout:1349 write 0x6013666 thru 0x6018398 (0x4d33 bytes) 2024-09-21T22:01:13.027 INFO:teuthology.orchestra.run.smithi102.stdout:1351 read 0xd6cd22 thru 0xd75cee (0x8fcd bytes) 2024-09-21T22:01:13.028 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:13.028 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:13.040 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:13.040 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:13.041 INFO:teuthology.orchestra.run.smithi102.stdout:1352 trunc from 0xde1644c to 0x20e6b2b 2024-09-21T22:01:13.045 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:13.046 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:13.050 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:13.054 INFO:teuthology.orchestra.run.smithi102.stdout:1355 punch from 0x1b2cecd to 0x1b375b7, (0xa6ea bytes) 2024-09-21T22:01:13.054 INFO:teuthology.orchestra.run.smithi102.stdout:1356 write 0xc2770f thru 0xc2c896 (0x5188 bytes) 2024-09-21T22:01:13.057 INFO:teuthology.orchestra.run.smithi102.stdout:1357 read 0x14bdf08 thru 0x14cd46d (0xf566 bytes) 2024-09-21T22:01:13.070 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:13.070 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:13.075 INFO:teuthology.orchestra.run.smithi102.stdout:1358 writesame 0xb9eb894 thru 0xb9f749b data_size 0x2c(0xbc08 bytes) 2024-09-21T22:01:13.075 INFO:teuthology.orchestra.run.smithi102.stdout:1359 read 0xa454521 thru 0xa455cde (0x17be bytes) 2024-09-21T22:01:13.076 INFO:teuthology.orchestra.run.smithi102.stdout:1360 read 0x15467d9 thru 0x1547856 (0x107e bytes) 2024-09-21T22:01:13.083 INFO:teuthology.orchestra.run.smithi102.stdout:1361 write 0xd9640aa thru 0xd969b46 (0x5a9d bytes) 2024-09-21T22:01:13.086 INFO:teuthology.orchestra.run.smithi102.stdout:1362 punch from 0x1accb47 to 0x1ad0ee0, (0x4399 bytes) 2024-09-21T22:01:13.089 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:13.090 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:13.091 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:13.090+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:13.091 INFO:teuthology.orchestra.run.smithi102.stdout:1364 write 0xe09b429 thru 0xe0a2999 (0x7571 bytes) 2024-09-21T22:01:13.094 INFO:teuthology.orchestra.run.smithi102.stdout:1365 writesame 0xb7237a7 thru 0xb72f640 data_size 0x1f(0xbe9a bytes) 2024-09-21T22:01:13.097 INFO:teuthology.orchestra.run.smithi102.stdout:1368 writesame 0x491f3b thru 0x4971c0 data_size 0x15(0x5286 bytes) 2024-09-21T22:01:13.099 INFO:teuthology.orchestra.run.smithi102.stdout:1370 read 0x38cc517 thru 0x38d3893 (0x737d bytes) 2024-09-21T22:01:13.099 INFO:teuthology.orchestra.run.smithi102.stdout:1372 write 0x5615b57 thru 0x561b284 (0x572e bytes) 2024-09-21T22:01:13.102 INFO:teuthology.orchestra.run.smithi102.stdout:1373 read 0x5c52f49 thru 0x5c57de3 (0x4e9b bytes) 2024-09-21T22:01:13.102 INFO:teuthology.orchestra.run.smithi102.stdout:1374 write 0x3013166 thru 0x3022ed1 (0xfd6c bytes) 2024-09-21T22:01:13.105 INFO:teuthology.orchestra.run.smithi102.stdout:1376 punch from 0x692044b to 0x6928f91, (0x8b46 bytes) 2024-09-21T22:01:13.105 INFO:teuthology.orchestra.run.smithi102.stdout:1377 read 0x43febbe thru 0x440b30b (0xc74e bytes) 2024-09-21T22:01:13.105 INFO:teuthology.orchestra.run.smithi102.stdout:1378 write 0xa6f021e thru 0xa6f1ab0 (0x1893 bytes) 2024-09-21T22:01:13.107 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:13.110 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:13.113 INFO:teuthology.orchestra.run.smithi102.stdout:1379 trunc from 0xe0a299a to 0x9ebc14c 2024-09-21T22:01:13.123 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.123 INFO:teuthology.orchestra.run.smithi102.stdout:1383 write 0x71edeec thru 0x71f6ae3 (0x8bf8 bytes) 2024-09-21T22:01:13.126 INFO:teuthology.orchestra.run.smithi102.stdout:1384 writesame 0x3b5f284 thru 0x3b69e03 data_size 0x80(0xab80 bytes) 2024-09-21T22:01:13.126 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:13.127 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:13.129 INFO:teuthology.orchestra.run.smithi102.stdout:1385 read 0x5a9f2f6 thru 0x5aa8fd7 (0x9ce2 bytes) 2024-09-21T22:01:13.141 INFO:teuthology.orchestra.run.smithi102.stdout:1387 writesame 0xec54621 thru 0xec5fcf4 data_size 0x2(0xb6d4 bytes) 2024-09-21T22:01:13.141 INFO:teuthology.orchestra.run.smithi102.stdout:1388 punch from 0xd52801 to 0xd5ff1d, (0xd71c bytes) 2024-09-21T22:01:13.155 INFO:teuthology.orchestra.run.smithi102.stdout:1389 trunc from 0xec5fcf5 to 0x36dd75d 2024-09-21T22:01:13.156 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:13.156 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:13.162 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:13.161+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:13.165 INFO:teuthology.orchestra.run.smithi102.stdout:1390 read 0x1b21e5f thru 0x1b240f5 (0x2297 bytes) 2024-09-21T22:01:13.169 INFO:teuthology.orchestra.run.smithi102.stdout:1391 trunc from 0x36dd75d to 0x65863f3 2024-09-21T22:01:13.175 INFO:teuthology.orchestra.run.smithi102.stdout:1392 trunc from 0x65863f3 to 0x7aa7e40 2024-09-21T22:01:13.180 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.180 INFO:teuthology.orchestra.run.smithi102.stdout:1394 writesame 0x17a178f thru 0x17ab0d1 data_size 0x23(0x9943 bytes) 2024-09-21T22:01:13.181 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:12847 3.1b 3:da600bd2:::rbd_object_map.11248cd3db3a:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:13.179600+0000", 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001404193, 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0014087399999999999, 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.182 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 12847 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.179600+0000", 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.179600+0000", 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.179600+0000", 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6499999999999999e-07 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.179604+0000", 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5889999999999999e-06 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.179611+0000", 2024-09-21T22:01:13.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7130000000000005e-06 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.179615+0000", 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8530000000000002e-06 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.179647+0000", 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1903999999999998e-05 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.179696+0000", 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8384000000000003e-05 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.179887+0000", 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019129600000000001 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180396+0000", 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00050889200000000005 2024-09-21T22:01:13.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180918+0000", 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00052215599999999997 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180970+0000", 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799999999999999e-05 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.181008+0000", 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8587999999999997e-05 2024-09-21T22:01:13.187 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4388.0:12847 3.1b e42/23 ondisk, result = 0)", 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:13.180846+0000", 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00015822199999999999, 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00023264800000000001, 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180846+0000", 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180846+0000", 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180846+0000", 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:01:13.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180849+0000", 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.326e-06 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180858+0000", 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2109999999999998e-06 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180862+0000", 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2339999999999996e-06 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180903+0000", 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1396000000000001e-05 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.180912+0000", 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4120000000000001e-06 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.192 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:13.192 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 2 2024-09-21T22:01:13.192 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:13.193 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.193 INFO:teuthology.orchestra.run.smithi102.stdout:1396 write 0x184fe51 thru 0x185d1f6 (0xd3a6 bytes) 2024-09-21T22:01:13.193 INFO:teuthology.orchestra.run.smithi102.stdout:1397 write 0x50194f0 thru 0x5019690 (0x1a1 bytes) 2024-09-21T22:01:13.193 INFO:teuthology.orchestra.run.smithi102.stdout:1398 read 0x6351c6e thru 0x6352d6a (0x10fd bytes) 2024-09-21T22:01:13.193 INFO:teuthology.orchestra.run.smithi102.stdout:1399 read 0x66831d0 thru 0x6683926 (0x757 bytes) 2024-09-21T22:01:13.193 INFO:teuthology.orchestra.run.smithi102.stdout:1400 writesame 0x3d72640 thru 0x3d7db54 data_size 0x1(0xb515 bytes) 2024-09-21T22:01:13.194 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:13.215 INFO:teuthology.orchestra.run.smithi102.stdout:1401 trunc from 0x7aa7e40 to 0xb66fa1f 2024-09-21T22:01:13.226 INFO:teuthology.orchestra.run.smithi102.stdout:1402 write 0xc212a76 thru 0xc2211c2 (0xe74d bytes) 2024-09-21T22:01:13.229 INFO:teuthology.orchestra.run.smithi102.stdout:1403 punch from 0x98faec7 to 0x9902035, (0x716e bytes) 2024-09-21T22:01:13.229 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.229 INFO:teuthology.orchestra.run.smithi102.stdout:1405 read 0xba5a7af thru 0xba62fe5 (0x8837 bytes) 2024-09-21T22:01:13.237 INFO:teuthology.orchestra.run.smithi102.stdout:1407 write 0xe47d0ee thru 0xe488278 (0xb18b bytes) 2024-09-21T22:01:13.241 INFO:teuthology.orchestra.run.smithi102.stdout:1408 writesame 0x97c296f thru 0x97d28cf data_size 0x2f(0xff61 bytes) 2024-09-21T22:01:13.244 INFO:teuthology.orchestra.run.smithi102.stdout:1409 writesame 0x22c2a25 thru 0x22d0b74 data_size 0x8c(0xe150 bytes) 2024-09-21T22:01:13.247 INFO:teuthology.orchestra.run.smithi102.stdout:1410 punch from 0xe95798 to 0xea2395, (0xcbfd bytes) 2024-09-21T22:01:13.247 INFO:teuthology.orchestra.run.smithi102.stdout:1412 write 0xac59a91 thru 0xac62030 (0x85a0 bytes) 2024-09-21T22:01:13.252 INFO:teuthology.orchestra.run.smithi102.stdout:1413 read 0xc3f5d8c thru 0xc3f93f5 (0x366a bytes) 2024-09-21T22:01:13.252 INFO:teuthology.orchestra.run.smithi102.stdout:1414 writesame 0xd59841f thru 0xd598545 data_size 0x1(0x127 bytes) 2024-09-21T22:01:13.252 INFO:teuthology.orchestra.run.smithi102.stdout:1415 write 0x1859e2d thru 0x185c707 (0x28db bytes) 2024-09-21T22:01:13.254 INFO:teuthology.orchestra.run.smithi102.stdout:1416 write 0x613356c thru 0x613ec86 (0xb71b bytes) 2024-09-21T22:01:13.256 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.257 INFO:teuthology.orchestra.run.smithi102.stdout:1419 writesame 0x692a360 thru 0x6930663 data_size 0x2(0x6304 bytes) 2024-09-21T22:01:13.263 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:13.262+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:13.280 INFO:teuthology.orchestra.run.smithi102.stdout:1420 trunc from 0xe488279 to 0x742eef 2024-09-21T22:01:13.307 INFO:teuthology.orchestra.run.smithi102.stdout:1421 write 0x74b6f64 thru 0x74b9e36 (0x2ed3 bytes) 2024-09-21T22:01:13.309 INFO:teuthology.orchestra.run.smithi102.stdout:1422 read 0x275183 thru 0x27f184 (0xa002 bytes) 2024-09-21T22:01:13.310 INFO:teuthology.orchestra.run.smithi102.stdout:1423 read 0x769e5b thru 0x7729f7 (0x8b9d bytes) 2024-09-21T22:01:13.324 INFO:teuthology.orchestra.run.smithi102.stdout:1424 write 0xed90675 thru 0xed94587 (0x3f13 bytes) 2024-09-21T22:01:13.326 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.333 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:13.333 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:13.333 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:13.333 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:13.333 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:13.335 INFO:teuthology.orchestra.run.smithi102.stdout:1426 trunc from 0xed94588 to 0x7b9d26a 2024-09-21T22:01:13.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:13.345 INFO:teuthology.orchestra.run.smithi102.stdout:1427 read 0x3f47972 thru 0x3f53388 (0xba17 bytes) 2024-09-21T22:01:13.345 INFO:teuthology.orchestra.run.smithi102.stdout:1428 writesame 0x5789de7 thru 0x5797786 data_size 0x10(0xd9a0 bytes) 2024-09-21T22:01:13.353 INFO:teuthology.orchestra.run.smithi102.stdout:1432 trunc from 0x7b9d26a to 0x40d56c0 2024-09-21T22:01:13.364 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:13.363+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:13.371 INFO:teuthology.orchestra.run.smithi102.stdout:1433 write 0x57322fe thru 0x573a078 (0x7d7b bytes) 2024-09-21T22:01:13.375 INFO:teuthology.orchestra.run.smithi102.stdout:1434 read 0xf9dc5b thru 0xf9e714 (0xaba bytes) 2024-09-21T22:01:13.389 INFO:teuthology.orchestra.run.smithi102.stdout:1435 write 0xb9660f8 thru 0xb970d0c (0xac15 bytes) 2024-09-21T22:01:13.392 INFO:teuthology.orchestra.run.smithi102.stdout:1436 read 0x2254f78 thru 0x2256988 (0x1a11 bytes) 2024-09-21T22:01:13.406 INFO:teuthology.orchestra.run.smithi102.stdout:1437 trunc from 0xb970d0d to 0x12ecf91 2024-09-21T22:01:13.424 INFO:teuthology.orchestra.run.smithi102.stdout:1439 write 0x474c896 thru 0x4750ca9 (0x4414 bytes) 2024-09-21T22:01:13.427 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.433 INFO:teuthology.orchestra.run.smithi102.stdout:1441 write 0x5614cfe thru 0x561ffdf (0xb2e2 bytes) 2024-09-21T22:01:13.445 INFO:teuthology.orchestra.run.smithi102.stdout:1444 writesame 0x8b709e7 thru 0x8b7f90c data_size 0x7(0xef26 bytes) 2024-09-21T22:01:13.456 INFO:teuthology.orchestra.run.smithi102.stdout:1445 writesame 0xd4e6200 thru 0xd4ee096 data_size 0x1(0x7e97 bytes) 2024-09-21T22:01:13.456 INFO:teuthology.orchestra.run.smithi102.stdout:1447 read 0xa4000e1 thru 0xa404e6f (0x4d8f bytes) 2024-09-21T22:01:13.456 INFO:teuthology.orchestra.run.smithi102.stdout:1448 punch from 0xa9ab8eb to 0xa9b2bb7, (0x72cc bytes) 2024-09-21T22:01:13.457 INFO:teuthology.orchestra.run.smithi102.stdout:1449 writesame 0x1790c06 thru 0x179b61a data_size 0x1(0xaa15 bytes) 2024-09-21T22:01:13.465 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:13.463+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:13.473 INFO:teuthology.orchestra.run.smithi102.stdout:1450 read 0x9fd1a1b thru 0x9fd5946 (0x3f2c bytes) 2024-09-21T22:01:13.474 INFO:teuthology.orchestra.run.smithi102.stdout:1452 read 0xb3918ad thru 0xb3918dd (0x31 bytes) 2024-09-21T22:01:13.474 INFO:teuthology.orchestra.run.smithi102.stdout:1453 read 0x6fa06b1 thru 0x6fa6461 (0x5db1 bytes) 2024-09-21T22:01:13.478 INFO:teuthology.orchestra.run.smithi102.stdout:1454 writesame 0xd571d85 thru 0xd575ed3 data_size 0x1(0x414f bytes) 2024-09-21T22:01:13.479 INFO:teuthology.orchestra.run.smithi102.stdout:1455 read 0x3300a9d thru 0x330dafd (0xd061 bytes) 2024-09-21T22:01:13.479 INFO:teuthology.orchestra.run.smithi102.stdout:1457 punch from 0xae304e4 to 0xae397c9, (0x92e5 bytes) 2024-09-21T22:01:13.479 INFO:teuthology.orchestra.run.smithi102.stdout:1458 writesame 0x2d1d006 thru 0x2d2077b data_size 0x1f(0x3776 bytes) 2024-09-21T22:01:13.487 INFO:teuthology.orchestra.run.smithi102.stdout:1459 write 0xe966799 thru 0xe973841 (0xd0a9 bytes) 2024-09-21T22:01:13.490 INFO:teuthology.orchestra.run.smithi102.stdout:1460 write 0x5eadbe0 thru 0x5ebb76c (0xdb8d bytes) 2024-09-21T22:01:13.493 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1533 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1179648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461433+0000", 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.030091153000001, 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015889985999999998, 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.494 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1533 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461433+0000", 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461433+0000", 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461434+0000", 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461436+0000", 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461442+0000", 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2920000000000001e-06 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461446+0000", 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477177+0000", 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015730958999999999 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477253+0000", 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5967e-05 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477323+0000", 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9868000000000003e-05 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1534 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 933888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461453+0000", 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.030071620999999, 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016051202000000001, 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1534 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461453+0000", 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461453+0000", 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461453+0000", 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461455+0000", 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.21e-06 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461461+0000", 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1519999999999997e-06 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461477+0000", 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5559000000000001e-05 2024-09-21T22:01:13.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477351+0000", 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015874267000000001 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477425+0000", 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3705e-05 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477504+0000", 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8904000000000002e-05 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1538 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 950272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461485+0000", 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.030039666, 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016161572999999999, 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.503 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1538 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461485+0000", 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461485+0000", 2024-09-21T22:01:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461485+0000", 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461487+0000", 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3420000000000002e-06 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461493+0000", 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.127e-06 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461500+0000", 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0900000000000001e-06 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477528+0000", 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016028216000000001 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477597+0000", 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8972000000000003e-05 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477646+0000", 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9434999999999997e-05 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1539 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461507+0000", 2024-09-21T22:01:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.030017566, 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016268042, 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1539 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461507+0000", 2024-09-21T22:01:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461507+0000", 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461507+0000", 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461509+0000", 2024-09-21T22:01:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461517+0000", 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6389999999999992e-06 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461522+0000", 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3680000000000001e-06 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477672+0000", 2024-09-21T22:01:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016149587999999999 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477719+0000", 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7568999999999998e-05 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477775+0000", 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5377000000000002e-05 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1542 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461529+0000", 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029995323, 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016402301000000001, 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1542 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461529+0000", 2024-09-21T22:01:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461529+0000", 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461529+0000", 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6600000000000002e-07 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461531+0000", 2024-09-21T22:01:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.136e-06 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461539+0000", 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3470000000000001e-06 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461544+0000", 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9629999999999997e-06 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477801+0000", 2024-09-21T22:01:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016257147999999999 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477860+0000", 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9298e-05 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477931+0000", 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1043000000000004e-05 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1544 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1032192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461551+0000", 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029972860999999, 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016548994000000001, 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1544 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461551+0000", 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461551+0000", 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461552+0000", 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461563+0000", 2024-09-21T22:01:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0995000000000001e-05 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461570+0000", 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2540000000000003e-06 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461575+0000", 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.477960+0000", 2024-09-21T22:01:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016384920000000001 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478032+0000", 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1687000000000007e-05 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478100+0000", 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-05 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1546 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461582+0000", 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029941948999999, 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016702069999999999, 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1546 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461582+0000", 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461582+0000", 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461583+0000", 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8400000000000004e-07 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461586+0000", 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8700000000000001e-06 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461592+0000", 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2169999999999999e-06 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461597+0000", 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1839999999999998e-06 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478128+0000", 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016530675000000002 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478202+0000", 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4297999999999999e-05 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478284+0000", 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2242000000000003e-05 2024-09-21T22:01:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1548 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1327104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461604+0000", 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029920295, 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016876019999999999, 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1548 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461604+0000", 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461604+0000", 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461604+0000", 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7100000000000002e-07 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461607+0000", 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0820000000000001e-06 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461613+0000", 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3069999999999999e-06 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461617+0000", 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.622e-06 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478318+0000", 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016700261000000001 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478400+0000", 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2038000000000003e-05 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478480+0000", 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0239000000000002e-05 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1550 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461623+0000", 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029901006999999, 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017050681000000002, 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1550 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461623+0000", 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461623+0000", 2024-09-21T22:01:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461624+0000", 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461625+0000", 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7969999999999999e-06 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461631+0000", 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7230000000000001e-06 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461635+0000", 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2490000000000003e-06 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478511+0000", 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016876019999999999 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478594+0000", 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2177999999999998e-05 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478674+0000", 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0382000000000004e-05 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1552 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1409024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461641+0000", 2024-09-21T22:01:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029882874, 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017205169999999999, 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1552 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461641+0000", 2024-09-21T22:01:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461641+0000", 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461642+0000", 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461644+0000", 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461650+0000", 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461654+0000", 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5750000000000002e-06 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478702+0000", 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017047896 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478775+0000", 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3059999999999995e-05 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478847+0000", 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1365000000000005e-05 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1554 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1425408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461660+0000", 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029863987000001, 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017395931, 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1554 2024-09-21T22:01:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461660+0000", 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461660+0000", 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461661+0000", 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6199999999999999e-07 2024-09-21T22:01:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461662+0000", 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.852e-06 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461669+0000", 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.083e-06 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461673+0000", 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4630000000000003e-06 2024-09-21T22:01:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478892+0000", 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017219307 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.478979+0000", 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6419e-05 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479056+0000", 2024-09-21T22:01:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7445000000000001e-05 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1556 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461680+0000", 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029844316, 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017556394999999999, 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1556 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461680+0000", 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461680+0000", 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461680+0000", 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7e-07 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461682+0000", 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9120000000000001e-06 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461688+0000", 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7629999999999997e-06 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461693+0000", 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6639999999999997e-06 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479087+0000", 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017394012 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479162+0000", 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4918000000000003e-05 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479236+0000", 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4756000000000001e-05 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1558 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1196032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461699+0000", 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029825345000001, 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017715903000000002, 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1558 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461699+0000", 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461699+0000", 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461699+0000", 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461701+0000", 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8899999999999999e-06 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461707+0000", 2024-09-21T22:01:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8100000000000003e-06 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461712+0000", 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6399999999999996e-06 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479267+0000", 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017555775999999999 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479342+0000", 2024-09-21T22:01:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4250000000000002e-05 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479415+0000", 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3196999999999997e-05 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1559 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1458176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461718+0000", 2024-09-21T22:01:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029806175999999, 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017906390000000001, 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1559 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461718+0000", 2024-09-21T22:01:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461718+0000", 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461718+0000", 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461721+0000", 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0999999999999998e-06 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461727+0000", 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.054e-06 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461731+0000", 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4490000000000001e-06 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479476+0000", 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017745097000000001 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479552+0000", 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6184000000000001e-05 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479624+0000", 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2131000000000004e-05 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1562 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461964+0000", 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029560014999999, 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017858503000000001, 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1562 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461964+0000", 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461964+0000", 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461965+0000", 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0900000000000001e-07 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461969+0000", 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.493e-06 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461980+0000", 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0294e-05 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461987+0000", 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2130000000000002e-06 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479656+0000", 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017668637000000001 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479741+0000", 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5691000000000003e-05 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479823+0000", 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1465999999999996e-05 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1564 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1277952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.461999+0000", 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.02952515, 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018019938999999999, 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1564 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461999+0000", 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.461999+0000", 2024-09-21T22:01:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462000+0000", 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1500000000000005e-07 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462002+0000", 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8720000000000002e-06 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462009+0000", 2024-09-21T22:01:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9700000000000002e-06 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462016+0000", 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9e-06 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479855+0000", 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017838599 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.479942+0000", 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6928999999999994e-05 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480019+0000", 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7154e-05 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1566 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1294336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.462031+0000", 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029493656, 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018182304999999999, 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1566 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462031+0000", 2024-09-21T22:01:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462031+0000", 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462031+0000", 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7100000000000002e-07 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462034+0000", 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4899999999999999e-06 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462040+0000", 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7390000000000002e-06 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462045+0000", 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0289999999999996e-06 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480053+0000", 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018007472 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480136+0000", 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2847000000000001e-05 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480213+0000", 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7256999999999996e-05 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1568 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1212416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.462053+0000", 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029471661000001, 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018351408, 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1568 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462053+0000", 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462053+0000", 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462053+0000", 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6800000000000001e-07 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462071+0000", 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8372e-05 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462082+0000", 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0767999999999999e-05 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462088+0000", 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4079999999999997e-06 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480245+0000", 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018157957999999998 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480328+0000", 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2033000000000006e-05 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480404+0000", 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6501000000000005e-05 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1573 3.1b 3:dfec9e49:::rbd_data.1124354cd08a.0000000000000008:4 [read 1474560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.462096+0000", 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.029428392, 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018509907999999999, 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1573 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462096+0000", 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462096+0000", 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462096+0000", 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.89e-07 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462099+0000", 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.419e-06 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462105+0000", 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6080000000000001e-06 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.462110+0000", 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8119999999999998e-06 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480433+0000", 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018322432 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480538+0000", 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010541 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480606+0000", 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7737999999999994e-05 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:8347 3.17 3:e9914f4e:::rbd_data.11245d75990.0000000000000024:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.911134+0000", 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.5803902030000003, 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019107674000000002, 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 8347 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911134+0000", 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911134+0000", 2024-09-21T22:01:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911136+0000", 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9269999999999999e-06 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911144+0000", 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.49e-06 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911161+0000", 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.66e-05 2024-09-21T22:01:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911169+0000", 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6040000000000004e-06 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911221+0000", 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1909000000000001e-05 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.911284+0000", 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3885000000000002e-05 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 5", 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.914580+0000", 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003296027 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.930054+0000", 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015473948 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.930113+0000", 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9039000000000002e-05 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.930184+0000", 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0691999999999993e-05 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.930242+0000", 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7553000000000003e-05 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.581 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.581 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:13.581 INFO:teuthology.orchestra.run.smithi102.stdout:1461 trunc from 0xe973842 to 0x60967d4 2024-09-21T22:01:13.582 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:13.584 INFO:teuthology.orchestra.run.smithi102.stdout:1463 trunc from 0x60967d4 to 0x6065928 2024-09-21T22:01:13.584 INFO:teuthology.orchestra.run.smithi102.stdout:1465 read 0x181081a thru 0x1819e29 (0x9610 bytes) 2024-09-21T22:01:13.584 INFO:teuthology.orchestra.run.smithi102.stdout:1466 write 0xac7cf70 thru 0xac884d2 (0xb563 bytes) 2024-09-21T22:01:13.584 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.584 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.584 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.584 INFO:teuthology.orchestra.run.smithi102.stdout:1470 trunc from 0xac884d3 to 0x27d01c4 2024-09-21T22:01:13.584 INFO:teuthology.orchestra.run.smithi102.stdout:1471 punch from 0x16fc88b to 0x1705260, (0x89d5 bytes) 2024-09-21T22:01:13.584 INFO:teuthology.orchestra.run.smithi102.stdout:1472 read 0x10397c4 thru 0x1041e0c (0x8649 bytes) 2024-09-21T22:01:13.584 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.585 INFO:teuthology.orchestra.run.smithi102.stdout:1475 write 0x402f746 thru 0x4033157 (0x3a12 bytes) 2024-09-21T22:01:13.585 INFO:teuthology.orchestra.run.smithi102.stdout:1476 read 0x27489b0 thru 0x2758061 (0xf6b2 bytes) 2024-09-21T22:01:13.585 INFO:teuthology.orchestra.run.smithi102.stdout:1477 punch from 0x10b5246 to 0x10b9674, (0x442e bytes) 2024-09-21T22:01:13.585 INFO:teuthology.orchestra.run.smithi102.stdout:1478 read 0x1ff2c65 thru 0x1ffee5c (0xc1f8 bytes) 2024-09-21T22:01:13.585 INFO:teuthology.orchestra.run.smithi102.stdout:1479 writesame 0x6c079f9 thru 0x6c0b6ac data_size 0x7(0x3cb4 bytes) 2024-09-21T22:01:13.585 INFO:teuthology.orchestra.run.smithi102.stdout:1481 punch from 0x597fe15 to 0x598373a, (0x3925 bytes) 2024-09-21T22:01:13.585 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:13.580+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:13.585 INFO:teuthology.orchestra.run.smithi102.stdout:1482 write 0x98a5118 thru 0x98b41be (0xf0a7 bytes) 2024-09-21T22:01:13.587 INFO:teuthology.orchestra.run.smithi102.stdout:1483 trunc from 0x98b41bf to 0xade79d9 2024-09-21T22:01:13.592 INFO:teuthology.orchestra.run.smithi102.stdout:1484 read 0x3094876 thru 0x309f3bf (0xab4a bytes) 2024-09-21T22:01:13.592 INFO:teuthology.orchestra.run.smithi102.stdout:1485 punch from 0x7467e1b to 0x7471ff8, (0xa1dd bytes) 2024-09-21T22:01:13.593 INFO:teuthology.orchestra.run.smithi102.stdout:1486 trunc from 0xade79d9 to 0xb362c95 2024-09-21T22:01:13.599 INFO:teuthology.orchestra.run.smithi102.stdout:1487 read 0x2fe70e thru 0x30962e (0xaf21 bytes) 2024-09-21T22:01:13.599 INFO:teuthology.orchestra.run.smithi102.stdout:1488 write 0x731a226 thru 0x7326ecb (0xcca6 bytes) 2024-09-21T22:01:13.603 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.603 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.603 INFO:teuthology.orchestra.run.smithi102.stdout:1495 read 0x48ea8de thru 0x48f73cc (0xcaef bytes) 2024-09-21T22:01:13.608 INFO:teuthology.orchestra.run.smithi102.stdout:1496 write 0xb4f914b thru 0xb5032f2 (0xa1a8 bytes) 2024-09-21T22:01:13.616 INFO:teuthology.orchestra.run.smithi102.stdout:1497 trunc from 0xb5032f3 to 0x767a5dc 2024-09-21T22:01:13.628 INFO:teuthology.orchestra.run.smithi102.stdout:1500 trunc from 0x767a5dc to 0x61d8683 2024-09-21T22:01:13.638 INFO:teuthology.orchestra.run.smithi102.stdout:1501 write 0x33d7b32 thru 0x33e14ad (0x997c bytes) 2024-09-21T22:01:13.642 INFO:teuthology.orchestra.run.smithi102.stdout:1502 read 0x5c5b802 thru 0x5c5d4f8 (0x1cf7 bytes) 2024-09-21T22:01:13.642 INFO:teuthology.orchestra.run.smithi102.stdout:1504 read 0x2cf1530 thru 0x2cf6399 (0x4e6a bytes) 2024-09-21T22:01:13.642 INFO:teuthology.orchestra.run.smithi102.stdout:1505 read 0x299379e thru 0x299dba1 (0xa404 bytes) 2024-09-21T22:01:13.642 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.642 INFO:teuthology.orchestra.run.smithi102.stdout:1508 write 0x567e6a8 thru 0x568c318 (0xdc71 bytes) 2024-09-21T22:01:13.647 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.653 INFO:teuthology.orchestra.run.smithi102.stdout:1511 trunc from 0x61d8683 to 0xaf1ab0c 2024-09-21T22:01:13.659 INFO:teuthology.orchestra.run.smithi102.stdout:1512 read 0x4dec5a5 thru 0x4df9e71 (0xd8cd bytes) 2024-09-21T22:01:13.660 INFO:teuthology.orchestra.run.smithi102.stdout:1513 read 0x19d112b thru 0x19d3807 (0x26dd bytes) 2024-09-21T22:01:13.660 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.660 INFO:teuthology.orchestra.run.smithi102.stdout:1515 writesame 0xa99b8fa thru 0xa99e18c data_size 0x11(0x2893 bytes) 2024-09-21T22:01:13.666 INFO:teuthology.orchestra.run.smithi102.stdout:1516 trunc from 0xaf1ab0c to 0xe6f9e92 2024-09-21T22:01:13.672 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:13.673 INFO:teuthology.orchestra.run.smithi102.stdout:1519 write 0x7027d9d thru 0x702dfd6 (0x623a bytes) 2024-09-21T22:01:13.676 INFO:teuthology.orchestra.run.smithi102.stdout:1520 read 0x4cd4dc7 thru 0x4ce351b (0xe755 bytes) 2024-09-21T22:01:13.676 INFO:teuthology.orchestra.run.smithi102.stdout:1522 clone 12 order 24 su 65536 sc 14 2024-09-21T22:01:13.683 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:13.682+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:13.697 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:13.697 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:13.697 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:13.697 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:13.706 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:13.751 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:01:13.784 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:13.783+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:13.858 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:13.858 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:13.869 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:13.914 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:13.912+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:13.980 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:5733 3.6 e32/23 3:6711db61:::rbd_data.11241aed97b.0000000000000005:head v 32'8, mlcod=32'5)", 2024-09-21T22:01:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.027862759, 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031617640000000001, 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5000000000000002e-07 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950222+0000", 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6309999999999997e-06 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950235+0000", 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2848e-05 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950241+0000", 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9229999999999999e-06 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950292+0000", 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0767999999999999e-05 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950312+0000", 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0658000000000001e-05 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.953336+0000", 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030239329999999999 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.953377+0000", 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0352999999999998e-05 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6273 3.8 e34/23 3:17287710:::rbd_data.11241c6bf084.0000000000000004:head v 34'12, mlcod=33'8)", 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.779057+0000", 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.1990204040000005, 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039622850000000003, 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779057+0000", 2024-09-21T22:01:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779057+0000", 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779058+0000", 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0200000000000001e-07 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779065+0000", 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0219999999999999e-06 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779078+0000", 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2509e-05 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779085+0000", 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0060000000000003e-06 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779139+0000", 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4163000000000003e-05 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779159+0000", 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0653999999999999e-05 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.782978+0000", 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038188300000000001 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783019+0000", 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1298999999999999e-05 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6276 3.8 e34/23 3:139e13d6:::rbd_data.11241c6bf084.0000000000000006:head v 34'13, mlcod=33'8)", 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.779874+0000", 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.1982032399999998, 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059474469999999998, 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779874+0000", 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779874+0000", 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779875+0000", 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7899999999999998e-07 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779895+0000", 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9616e-05 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779906+0000", 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1759e-05 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779913+0000", 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4790000000000001e-06 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780183+0000", 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00027045699999999999 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780202+0000", 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8856e-05 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785800+0000", 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055976419999999999 2024-09-21T22:01:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785822+0000", 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1959000000000001e-05 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6277 3.8 e34/23 3:139e13d6:::rbd_data.11241c6bf084.0000000000000006:head v 34'15, mlcod=33'8)", 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.780632+0000", 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.1974455539999997, 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052038550000000003, 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780632+0000", 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780632+0000", 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780633+0000", 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9800000000000003e-07 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780639+0000", 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5849999999999996e-06 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780650+0000", 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0402e-05 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780657+0000", 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3350000000000001e-06 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780709+0000", 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2077999999999998e-05 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780730+0000", 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0755e-05 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785824+0000", 2024-09-21T22:01:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050940100000000004 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785836+0000", 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1992e-05 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6281 3.8 e34/23 3:1043a0b3:::rbd_object_map.11241c6bf084:head v 34'16, mlcod=34'9)", 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.783460+0000", 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.1946175070000002, 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047000590000000004, 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783460+0000", 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783460+0000", 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783461+0000", 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0900000000000001e-07 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783466+0000", 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8609999999999997e-06 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783483+0000", 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7252e-05 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783489+0000", 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783538+0000", 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8613999999999999e-05 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783554+0000", 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5931999999999999e-05 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.788134+0000", 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045798849999999997 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.788160+0000", 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6336e-05 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6283 3.8 e34/23 3:1043a0b3:::rbd_object_map.11241c6bf084:head v 34'17, mlcod=34'10)", 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:14.001 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.1937536729999998, 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064856749999999998, 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1200000000000003e-07 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784328+0000", 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9809999999999997e-06 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784336+0000", 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5669999999999997e-06 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784343+0000", 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.737e-06 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785563+0000", 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0012207590000000001 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785577+0000", 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3118999999999999e-05 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790766+0000", 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051893119999999997 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790810+0000", 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3687999999999999e-05 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6285 3.8 e34/23 3:1043a0b3:::rbd_object_map.11241c6bf084:head v 34'18, mlcod=34'10)", 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.1931957139999998, 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059974349999999997, 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.01e-07 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784886+0000", 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4189999999999998e-06 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784892+0000", 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999997e-06 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784897+0000", 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7530000000000001e-06 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785857+0000", 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096060000000000004 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785871+0000", 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3269e-05 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790813+0000", 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049422490000000001 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790879+0000", 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6383000000000005e-05 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6292 3.a e34/28 3:54ffb751:::rbd_data.11241c6bf084.0000000000000001:head v 34'25, mlcod=33'21)", 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.792368+0000", 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.1857093370000005, 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039734059999999996, 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792368+0000", 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792368+0000", 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792369+0000", 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1600000000000001e-07 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792375+0000", 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2450000000000003e-06 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792387+0000", 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1613e-05 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792393+0000", 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792650+0000", 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00025638199999999999 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792661+0000", 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1581e-05 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.796308+0000", 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0036463749999999999 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.796342+0000", 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4044999999999997e-05 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7626 3.4 e34/23 3:217b17c9:::rbd_data.11245d75990.0000000000000016:head v 34'44, mlcod=34'42)", 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.341873+0000", 2024-09-21T22:01:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.6362048530000006, 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028624459999999998, 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341873+0000", 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341873+0000", 2024-09-21T22:01:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341873+0000", 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2900000000000003e-07 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341882+0000", 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0909999999999993e-06 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341895+0000", 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3159999999999999e-05 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341902+0000", 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.832e-06 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341965+0000", 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3176000000000006e-05 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.341984+0000", 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8859999999999999e-05 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.344700+0000", 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00271595 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.344735+0000", 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5648000000000002e-05 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7628 3.1a e34/23 3:59997cf8:::rbd_object_map.11245d75990:head v 34'59, mlcod=34'57)", 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.634602933, 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039423549999999998, 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3600000000000003e-07 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343480+0000", 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5739999999999997e-06 2024-09-21T22:01:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343489+0000", 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9339999999999995e-06 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343495+0000", 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0260000000000004e-06 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343542+0000", 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6940000000000001e-05 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343562+0000", 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0591999999999999e-05 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.347359+0000", 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003796654 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.347417+0000", 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7998999999999998e-05 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7632 3.1a e34/23 3:59997cf8:::rbd_object_map.11245d75990:head v 34'61, mlcod=34'59)", 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.349031+0000", 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.6290462419999994, 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034961710000000002, 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349031+0000", 2024-09-21T22:01:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349031+0000", 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349032+0000", 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7400000000000002e-07 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349038+0000", 2024-09-21T22:01:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.964e-06 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349051+0000", 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2818e-05 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349058+0000", 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349101+0000", 2024-09-21T22:01:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2945000000000003e-05 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349113+0000", 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2422999999999999e-05 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352502+0000", 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033889879999999999 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352528+0000", 2024-09-21T22:01:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5551999999999999e-05 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7634 3.1a e34/23 3:59997cf8:::rbd_object_map.11245d75990:head v 34'63, mlcod=34'59)", 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.352190+0000", 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.6258874159999994, 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034284049999999998, 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352190+0000", 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352190+0000", 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352191+0000", 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5300000000000004e-07 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352195+0000", 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7260000000000002e-06 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352204+0000", 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7809999999999994e-06 2024-09-21T22:01:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352210+0000", 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2179999999999996e-06 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352245+0000", 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5024000000000002e-05 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352259+0000", 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295999999999999e-05 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.355589+0000", 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033299660000000002 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.355619+0000", 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9841000000000001e-05 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:8153 3.4 e35/23 3:217b17c9:::rbd_data.11245d75990.0000000000000016:head v 35'54, mlcod=34'51)", 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.760173+0000", 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.2179048639999994, 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002988133, 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760173+0000", 2024-09-21T22:01:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760173+0000", 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760174+0000", 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1100000000000005e-07 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760179+0000", 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9840000000000001e-06 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760192+0000", 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.326e-05 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760198+0000", 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6969999999999996e-06 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760240+0000", 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1758000000000002e-05 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.760274+0000", 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3772000000000001e-05 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.763129+0000", 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028549650000000001 2024-09-21T22:01:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.763161+0000", 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1885999999999999e-05 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:8258 3.4 e35/23 3:2443562f:::rbd_data.11245d75990.0000000000000006:head v 35'56, mlcod=35'54)", 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.1665280429999996, 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033350820000000001, 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811555+0000", 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0100000000000003e-06 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811564+0000", 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9069999999999996e-06 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811573+0000", 2024-09-21T22:01:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8720000000000008e-06 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811622+0000", 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9206999999999998e-05 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811637+0000", 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4789e-05 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814833+0000", 2024-09-21T22:01:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031957560000000001 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814885+0000", 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2021999999999998e-05 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:8253 3.0 e35/23 3:051bfba9:::rbd_data.11245d75990.0000000000000001:head v 35'28, mlcod=34'26)", 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.811791+0000", 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.1662869249999996, 2024-09-21T22:01:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030884749999999998, 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811791+0000", 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811791+0000", 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811791+0000", 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811796+0000", 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8300000000000003e-06 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811803+0000", 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5050000000000001e-06 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811811+0000", 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8480000000000001e-06 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811856+0000", 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4706999999999997e-05 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811872+0000", 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5931999999999999e-05 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814850+0000", 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029784960000000002 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814879+0000", 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8722999999999999e-05 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:8255 3.1a e35/23 3:5c2256b7:::rbd_data.11245d75990.0000000000000003:head v 35'125, mlcod=35'123)", 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.811912+0000", 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.1661654309999996, 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058016710000000004, 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811912+0000", 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811912+0000", 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811913+0000", 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4600000000000003e-07 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811921+0000", 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2024-09-21T22:01:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811932+0000", 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1368e-05 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811938+0000", 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3500000000000002e-06 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811996+0000", 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7216999999999998e-05 2024-09-21T22:01:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.812016+0000", 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0593000000000001e-05 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.817672+0000", 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056554689999999998 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.817714+0000", 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2191999999999999e-05 2024-09-21T22:01:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:8467 3.19 3:98c60cb6:::rbd_data.11245d75990.0000000000000021:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:06.053457+0000", 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.924620343, 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0089674449999999992, 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 8467 2024-09-21T22:01:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053457+0000", 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053457+0000", 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053459+0000", 2024-09-21T22:01:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8780000000000001e-06 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053473+0000", 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3369e-05 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053489+0000", 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.647e-05 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053498+0000", 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1910000000000006e-06 2024-09-21T22:01:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053549+0000", 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0639000000000001e-05 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053642+0000", 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3306000000000004e-05 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.055069+0000", 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0014269630000000001 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062351+0000", 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0072819060000000003 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062363+0000", 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.17e-05 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062394+0000", 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1247000000000001e-05 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062425+0000", 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0775999999999998e-05 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:10543 3.a e37/28 3:52b77e0f:::rbd_data.11246f0f1a8f.00000000000000ee:head v 37'29, mlcod=37'27)", 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5007919919999999, 2024-09-21T22:01:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040004919999999996, 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5799999999999998e-07 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477294+0000", 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2790000000000001e-06 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477305+0000", 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1843e-05 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477312+0000", 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8870000000000003e-06 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477364+0000", 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1362000000000001e-05 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477385+0000", 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1321000000000001e-05 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.481247+0000", 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038619549999999998 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.481286+0000", 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9087e-05 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:11169 3.19 3:98c01e0c:::rbd_object_map.1124168bc283:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T22:01:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:10.015671+0000", 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.9624061230000001, 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029208799999999998, 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 11169 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015671+0000", 2024-09-21T22:01:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015671+0000", 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015672+0000", 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6600000000000002e-07 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015675+0000", 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8739999999999999e-06 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015681+0000", 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8860000000000001e-06 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.015686+0000", 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.412e-06 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.017163+0000", 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0014770790000000001 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.017219+0000", 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5801000000000003e-05 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.017509+0000", 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00029008499999999998 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.018378+0000", 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00086877000000000005 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.018530+0000", 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015228900000000001 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.018558+0000", 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489000000000001e-05 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.018592+0000", 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4728999999999999e-05 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:11223 3.19 3:98c01e0c:::rbd_object_map.1124168bc283:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:10.062951+0000", 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.9151267920000001, 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002793776, 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 11223 2024-09-21T22:01:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062951+0000", 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062951+0000", 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062952+0000", 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.92e-07 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062963+0000", 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1667e-05 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062973+0000", 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.302e-06 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.062982+0000", 2024-09-21T22:01:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.098e-06 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.063627+0000", 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064574700000000001 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.063723+0000", 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.064092+0000", 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00036968299999999999 2024-09-21T22:01:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.065642+0000", 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001550034 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.065654+0000", 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.19e-05 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.065705+0000", 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0339e-05 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:10.065745+0000", 2024-09-21T22:01:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9910000000000002e-05 2024-09-21T22:01:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.069 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:14.070 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-21T22:01:14.071 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:14.072 INFO:teuthology.orchestra.run.smithi102.stdout:1523 punch from 0x7ab328f to 0x7ab459d, (0x130e bytes) 2024-09-21T22:01:14.072 INFO:teuthology.orchestra.run.smithi102.stdout:1524 write 0x508379b thru 0x5084269 (0xacf bytes) 2024-09-21T22:01:14.072 INFO:teuthology.orchestra.run.smithi102.stdout:1525 write 0xa2ce30a thru 0xa2ce89d (0x594 bytes) 2024-09-21T22:01:14.072 INFO:teuthology.orchestra.run.smithi102.stdout:1527 write 0xbcea754 thru 0xbcf3418 (0x8cc5 bytes) 2024-09-21T22:01:14.072 INFO:teuthology.orchestra.run.smithi102.stdout:1528 write 0x8af9a35 thru 0x8b04e71 (0xb43d bytes) 2024-09-21T22:01:14.072 INFO:teuthology.orchestra.run.smithi102.stdout:1532 read 0xe6dd9ed thru 0xe6ddc33 (0x247 bytes) 2024-09-21T22:01:14.073 INFO:teuthology.orchestra.run.smithi102.stdout:1533 punch from 0x699904a to 0x69a1abb, (0x8a71 bytes) 2024-09-21T22:01:14.073 INFO:teuthology.orchestra.run.smithi102.stdout:1535 write 0x9848319 thru 0x9850268 (0x7f50 bytes) 2024-09-21T22:01:14.073 INFO:teuthology.orchestra.run.smithi102.stdout:1536 writesame 0xba6e775 thru 0xba7e533 data_size 0x3b(0xfdbf bytes) 2024-09-21T22:01:14.073 INFO:teuthology.orchestra.run.smithi102.stdout:1538 read 0xc06365e thru 0xc06aa7c (0x741f bytes) 2024-09-21T22:01:14.073 INFO:teuthology.orchestra.run.smithi102.stdout:1539 write 0xc537a thru 0xc9b7c (0x4803 bytes) 2024-09-21T22:01:14.073 INFO:teuthology.orchestra.run.smithi102.stdout:1540 trunc from 0xe6f9e92 to 0x901833a 2024-09-21T22:01:14.073 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:14.069+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:14.096 INFO:teuthology.orchestra.run.smithi102.stdout:1541 write 0xecafc05 thru 0xecbdcb2 (0xe0ae bytes) 2024-09-21T22:01:14.102 INFO:teuthology.orchestra.run.smithi102.stdout:1542 write 0xe16d6f8 thru 0xe17cc2f (0xf538 bytes) 2024-09-21T22:01:14.107 INFO:teuthology.orchestra.run.smithi102.stdout:1543 read 0x9bbef93 thru 0x9bc199e (0x2a0c bytes) 2024-09-21T22:01:14.107 INFO:teuthology.orchestra.run.smithi102.stdout:1544 read 0xaabde75 thru 0xaac6ab9 (0x8c45 bytes) 2024-09-21T22:01:14.108 INFO:teuthology.orchestra.run.smithi102.stdout:1546 write 0x108d8fb thru 0x109a0c7 (0xc7cd bytes) 2024-09-21T22:01:14.110 INFO:teuthology.orchestra.run.smithi102.stdout:1548 trunc from 0xecbdcb3 to 0xe7c02ae 2024-09-21T22:01:14.115 INFO:teuthology.orchestra.run.smithi102.stdout:1550 writesame 0x270523c thru 0x270bf1e data_size 0x5(0x6ce3 bytes) 2024-09-21T22:01:14.118 INFO:teuthology.orchestra.run.smithi102.stdout:1551 writesame 0x6240c36 thru 0x62410fe data_size 0x7(0x4c9 bytes) 2024-09-21T22:01:14.120 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:14.120 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:14.120 INFO:teuthology.orchestra.run.smithi102.stdout:1554 read 0xed97d6 thru 0xee0f94 (0x77bf bytes) 2024-09-21T22:01:14.120 INFO:teuthology.orchestra.run.smithi102.stdout:1555 punch from 0x16e2d48 to 0x16ea4cb, (0x7783 bytes) 2024-09-21T22:01:14.120 INFO:teuthology.orchestra.run.smithi102.stdout:1557 write 0x95fc951 thru 0x960437e (0x7a2e bytes) 2024-09-21T22:01:14.122 INFO:teuthology.orchestra.run.smithi102.stdout:1558 writesame 0x8959845 thru 0x8967b42 data_size 0x4e(0xe2fe bytes) 2024-09-21T22:01:14.123 INFO:teuthology.orchestra.run.smithi102.stdout:1559 read 0xb730636 thru 0xb73df69 (0xd934 bytes) 2024-09-21T22:01:14.124 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:14.124 INFO:teuthology.orchestra.run.smithi102.stdout:1561 write 0x48676b4 thru 0x486e0f4 (0x6a41 bytes) 2024-09-21T22:01:14.125 INFO:teuthology.orchestra.run.smithi102.stdout:1562 trunc from 0xe7c02ae to 0xeabca00 2024-09-21T22:01:14.130 INFO:teuthology.orchestra.run.smithi102.stdout:1564 write 0x516e9ff thru 0x517a87c (0xbe7e bytes) 2024-09-21T22:01:14.131 INFO:teuthology.orchestra.run.smithi102.stdout:1566 write 0x42592f5 thru 0x4264335 (0xb041 bytes) 2024-09-21T22:01:14.136 INFO:teuthology.orchestra.run.smithi102.stdout:1567 punch from 0x2124096 to 0x2124199, (0x103 bytes) 2024-09-21T22:01:14.136 INFO:teuthology.orchestra.run.smithi102.stdout:1568 read 0x3804946 thru 0x38079da (0x3095 bytes) 2024-09-21T22:01:14.137 INFO:teuthology.orchestra.run.smithi102.stdout:1569 writesame 0xac69839 thru 0xac72f27 data_size 0x1(0x96ef bytes) 2024-09-21T22:01:14.149 INFO:teuthology.orchestra.run.smithi102.stdout:1571 write 0x59e5620 thru 0x59e9243 (0x3c24 bytes) 2024-09-21T22:01:14.151 INFO:teuthology.orchestra.run.smithi102.stdout:1572 write 0x52bcda5 thru 0x52ccc25 (0xfe81 bytes) 2024-09-21T22:01:14.153 INFO:teuthology.orchestra.run.smithi102.stdout:1573 read 0x5a53aa4 thru 0x5a5caf0 (0x904d bytes) 2024-09-21T22:01:14.153 INFO:teuthology.orchestra.run.smithi102.stdout:1574 read 0x1097a69 thru 0x109a1d4 (0x276c bytes) 2024-09-21T22:01:14.154 INFO:teuthology.orchestra.run.smithi102.stdout:1575 punch from 0x9eaadf2 to 0x9eaca23, (0x1c31 bytes) 2024-09-21T22:01:14.154 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:14.154 INFO:teuthology.orchestra.run.smithi102.stdout:1577 write 0x19d7379 thru 0x19d82f7 (0xf7f bytes) 2024-09-21T22:01:14.159 INFO:teuthology.orchestra.run.smithi102.stdout:1579 trunc from 0xeabca00 to 0xb1d265c 2024-09-21T22:01:14.171 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:14.170+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:14.176 INFO:teuthology.orchestra.run.smithi102.stdout:1581 writesame 0x111517e thru 0x1119ae4 data_size 0x17(0x4967 bytes) 2024-09-21T22:01:14.177 INFO:teuthology.orchestra.run.smithi102.stdout:1582 punch from 0x5fe623d to 0x5ff60b2, (0xfe75 bytes) 2024-09-21T22:01:14.177 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:14.178 INFO:teuthology.orchestra.run.smithi102.stdout:1586 punch from 0x3175cc6 to 0x317c440, (0x677a bytes) 2024-09-21T22:01:14.178 INFO:teuthology.orchestra.run.smithi102.stdout:1587 read 0x734cdc0 thru 0x735840e (0xb64f bytes) 2024-09-21T22:01:14.186 INFO:teuthology.orchestra.run.smithi102.stdout:1590 writesame 0xd503960 thru 0xd5100b7 data_size 0x4(0xc758 bytes) 2024-09-21T22:01:14.187 INFO:teuthology.orchestra.run.smithi102.stdout:1591 punch from 0x7dbc091 to 0x7dc97e4, (0xd753 bytes) 2024-09-21T22:01:14.187 INFO:teuthology.orchestra.run.smithi102.stdout:1592 read 0x7baf628 thru 0x7baf82a (0x203 bytes) 2024-09-21T22:01:14.188 INFO:teuthology.orchestra.run.smithi102.stdout:1594 write 0x45dca4a thru 0x45ea925 (0xdedc bytes) 2024-09-21T22:01:14.190 INFO:teuthology.orchestra.run.smithi102.stdout:1595 punch from 0x372902d to 0x372c9a2, (0x3975 bytes) 2024-09-21T22:01:14.196 INFO:teuthology.orchestra.run.smithi102.stdout:1596 writesame 0xda51d96 thru 0xda5c574 data_size 0x4b(0xa7df bytes) 2024-09-21T22:01:14.197 INFO:teuthology.orchestra.run.smithi102.stdout:1599 writesame 0x9b5c929 thru 0x9b5eedf data_size 0x1(0x25b7 bytes) 2024-09-21T22:01:14.201 INFO:teuthology.orchestra.run.smithi102.stdout:1600 write 0x236bdca thru 0x237af37 (0xf16e bytes) 2024-09-21T22:01:14.203 INFO:teuthology.orchestra.run.smithi102.stdout:1601 read 0x3599df2 thru 0x359d4f1 (0x3700 bytes) 2024-09-21T22:01:14.204 INFO:teuthology.orchestra.run.smithi102.stdout:1602 read 0x7604f84 thru 0x761185e (0xc8db bytes) 2024-09-21T22:01:14.211 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:14.211 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:14.211 INFO:teuthology.orchestra.run.smithi102.stdout:1603 trunc from 0xda5c575 to 0x7e705d1 2024-09-21T22:01:14.222 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:14.222 INFO:teuthology.orchestra.run.smithi102.stdout:1605 read 0xdae872 thru 0xdbc487 (0xdc16 bytes) 2024-09-21T22:01:14.224 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:14.224 INFO:teuthology.orchestra.run.smithi102.stdout:1607 write 0x741d34e thru 0x742b93a (0xe5ed bytes) 2024-09-21T22:01:14.236 INFO:teuthology.orchestra.run.smithi102.stdout:1610 write 0xc8af2dc thru 0xc8bcf53 (0xdc78 bytes) 2024-09-21T22:01:14.237 INFO:teuthology.orchestra.run.smithi102.stdout:1611 read 0x883cfc thru 0x88e207 (0xa50c bytes) 2024-09-21T22:01:14.245 INFO:teuthology.orchestra.run.smithi102.stdout:1612 trunc from 0xc8bcf54 to 0x6736723 2024-09-21T22:01:14.273 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:14.270+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:14.329 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:14.329 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:14.329 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:14.329 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:14.329 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:14.337 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:14.373 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:14.372+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:14.455 INFO:teuthology.orchestra.run.smithi102.stdout:1613 clone 13 order 25 su 524288 sc 6 2024-09-21T22:01:14.474 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:14.472+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4223.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:00:44.111294+0000", 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.369427117000001, 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043357339999999999, 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.483 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111294+0000", 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111294+0000", 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111295+0000", 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111305+0000", 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8859999999999999e-06 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111319+0000", 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4168000000000001e-05 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111330+0000", 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1615e-05 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111388+0000", 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7336999999999997e-05 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.111422+0000", 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4663000000000003e-05 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.115586+0000", 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004163529 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:00:44.115630+0000", 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4135999999999999e-05 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1914 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468508+0000", 2024-09-21T22:01:14.487 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012213639, 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039224159999999998, 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1914 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468508+0000", 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468508+0000", 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468508+0000", 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9999999999999998e-07 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468510+0000", 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7269999999999999e-06 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468515+0000", 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.288e-06 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468519+0000", 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9439999999999998e-06 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472278+0000", 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037592459999999999 2024-09-21T22:01:14.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472347+0000", 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8732000000000005e-05 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472430+0000", 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2979000000000006e-05 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1928 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468524+0000", 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012197049999999, 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041225280000000003, 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1928 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468524+0000", 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468524+0000", 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468525+0000", 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4900000000000001e-07 2024-09-21T22:01:14.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468527+0000", 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7579999999999999e-06 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468532+0000", 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.305e-06 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468536+0000", 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.985e-06 2024-09-21T22:01:14.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472455+0000", 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039193459999999998 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472550+0000", 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4943000000000002e-05 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472647+0000", 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6742000000000003e-05 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.495 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1948 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468541+0000", 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012180243, 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042840339999999999, 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1948 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.496 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468541+0000", 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468541+0000", 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468541+0000", 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9299999999999999e-07 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468543+0000", 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.73e-06 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468549+0000", 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5809999999999996e-06 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468553+0000", 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0910000000000003e-06 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472674+0000", 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041206860000000001 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472743+0000", 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9799e-05 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472825+0000", 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1854000000000006e-05 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1949 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 868352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468558+0000", 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012163470999999, 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044537359999999998, 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1949 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468558+0000", 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468558+0000", 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468558+0000", 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468560+0000", 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.657e-06 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468565+0000", 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3789999999999997e-06 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468570+0000", 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2470000000000002e-06 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472851+0000", 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042813640000000002 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.472919+0000", 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8013000000000001e-05 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473012+0000", 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2732999999999995e-05 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.503 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1976 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 622592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468575+0000", 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012146561, 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00462482, 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.504 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1976 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468575+0000", 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468575+0000", 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468575+0000", 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468580+0000", 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3009999999999997e-06 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468586+0000", 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8429999999999998e-06 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468591+0000", 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2699999999999998e-06 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473039+0000", 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044480769999999999 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473111+0000", 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1993e-05 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473200+0000", 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8954000000000002e-05 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1977 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 884736~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468596+0000", 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.01212527, 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004810496, 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1977 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468596+0000", 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468596+0000", 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468596+0000", 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468598+0000", 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7540000000000001e-06 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468604+0000", 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2599999999999996e-06 2024-09-21T22:01:14.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468608+0000", 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0149999999999997e-06 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473230+0000", 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004622162 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473310+0000", 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0092000000000005e-05 2024-09-21T22:01:14.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473407+0000", 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6806999999999997e-05 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1998 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468613+0000", 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012108674, 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049881500000000002, 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.512 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1998 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468613+0000", 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468613+0000", 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468613+0000", 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468615+0000", 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7829999999999999e-06 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468620+0000", 2024-09-21T22:01:14.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4349999999999996e-06 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468629+0000", 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8570000000000001e-06 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473437+0000", 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048074679999999996 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473517+0000", 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0537999999999994e-05 2024-09-21T22:01:14.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473601+0000", 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3764000000000006e-05 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2012 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 655360~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468635+0000", 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012086815, 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051593519999999999, 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.516 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2012 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468635+0000", 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468635+0000", 2024-09-21T22:01:14.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468635+0000", 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468641+0000", 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9850000000000003e-06 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.518 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468647+0000", 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7930000000000003e-06 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468651+0000", 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2889999999999999e-06 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473630+0000", 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049792320000000001 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473710+0000", 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9833000000000006e-05 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473794+0000", 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3813999999999994e-05 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2026 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468656+0000", 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012064874, 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053145570000000001, 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.520 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2026 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468656+0000", 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468656+0000", 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468657+0000", 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468659+0000", 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9810000000000002e-06 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468664+0000", 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5049999999999998e-06 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468668+0000", 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0169999999999998e-06 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473822+0000", 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005153492 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473894+0000", 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2626999999999994e-05 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473971+0000", 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.524 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2040 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468673+0000", 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012048064, 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0054722579999999998, 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2040 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468673+0000", 2024-09-21T22:01:14.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468673+0000", 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468674+0000", 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468675+0000", 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7269999999999999e-06 2024-09-21T22:01:14.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468681+0000", 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.339e-06 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468685+0000", 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9249999999999997e-06 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.473996+0000", 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053116190000000001 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474067+0000", 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0364000000000006e-05 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474146+0000", 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8901999999999998e-05 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2054 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468690+0000", 2024-09-21T22:01:14.528 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012031681, 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056318599999999998, 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2054 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468690+0000", 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468690+0000", 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468690+0000", 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0399999999999996e-07 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468692+0000", 2024-09-21T22:01:14.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.691e-06 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468697+0000", 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2689999999999999e-06 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468701+0000", 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9620000000000004e-06 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474171+0000", 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0054697189999999996 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474242+0000", 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1594999999999995e-05 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474322+0000", 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9120000000000001e-05 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2068 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 753664~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.532 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468708+0000", 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.012013025, 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059037509999999996, 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2068 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468708+0000", 2024-09-21T22:01:14.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468708+0000", 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468709+0000", 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4799999999999999e-07 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468715+0000", 2024-09-21T22:01:14.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468720+0000", 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5670000000000002e-06 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468725+0000", 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3669999999999999e-06 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474348+0000", 2024-09-21T22:01:14.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056228579999999997 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474419+0000", 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1328999999999994e-05 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474612+0000", 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019319699999999999 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.536 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2082 3.0 3:0283950e:::rbd_data.1124354cd08a.0000000000000014:4 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.468731+0000", 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.011990163, 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060843360000000001, 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2082 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468731+0000", 2024-09-21T22:01:14.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468731+0000", 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468732+0000", 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468733+0000", 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8530000000000001e-06 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468739+0000", 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.271e-06 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.468743+0000", 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0489999999999997e-06 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474637+0000", 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058945689999999997 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474714+0000", 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6477999999999995e-05 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.474816+0000", 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010169400000000001 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6149 3.9 e34/23 3:93883a22:::rbd_header.11245d75990:head v 34'52, mlcod=34'50)", 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.757918+0000", 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7228036390000003, 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047047809999999999, 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.757918+0000", 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.757918+0000", 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.757918+0000", 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3499999999999996e-07 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.757923+0000", 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5329999999999996e-06 2024-09-21T22:01:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.757932+0000", 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5130000000000002e-06 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.757937+0000", 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6670000000000004e-06 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.757978+0000", 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0562000000000002e-05 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.757990+0000", 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2288e-05 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.762585+0000", 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045949620000000002 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.762623+0000", 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7620999999999998e-05 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:7437 3.0 3:07a4a286:::rbd_data.11245d75990.0000000000000037:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.304770+0000", 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.1759517969999997, 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0117459, 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.545 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 7437 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.304770+0000", 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.304770+0000", 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.304771+0000", 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.11e-06 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.304776+0000", 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8170000000000004e-06 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.304789+0000", 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2686e-05 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.304795+0000", 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3160000000000002e-06 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.304840+0000", 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4227999999999997e-05 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.304919+0000", 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9301000000000005e-05 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.307034+0000", 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0021150869999999999 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.316434+0000", 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093994149999999995 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.316444+0000", 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0845999999999999e-05 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.316486+0000", 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1514000000000003e-05 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.316515+0000", 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9580000000000001e-05 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.550 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:8253 3.0 3:051bfba9:::rbd_data.11245d75990.0000000000000001:head [stat,truncate 1835008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.810762+0000", 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.6699595479999996, 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043077849999999997, 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 8253 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810762+0000", 2024-09-21T22:01:14.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810762+0000", 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810764+0000", 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2800000000000002e-06 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810777+0000", 2024-09-21T22:01:14.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2979000000000001e-05 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810802+0000", 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4749999999999999e-05 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810816+0000", 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3701e-05 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810917+0000", 2024-09-21T22:01:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000101709 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811216+0000", 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00029832900000000001 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811325+0000", 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109639 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.812210+0000", 2024-09-21T22:01:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088520299999999999 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814988+0000", 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002777411 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.815032+0000", 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3735000000000001e-05 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.815070+0000", 2024-09-21T22:01:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8049000000000001e-05 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:8258 3.4 3:2443562f:::rbd_data.11245d75990.0000000000000006:head [stat,truncate 1725170] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.810847+0000", 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.6698738899999999, 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042809759999999997, 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 8258 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810847+0000", 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810847+0000", 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810848+0000", 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5199999999999997e-07 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810852+0000", 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810859+0000", 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1840000000000002e-06 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810864+0000", 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9459999999999997e-06 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.810919+0000", 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5377000000000002e-05 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811026+0000", 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107256 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811160+0000", 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000133628 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811860+0000", 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00070000699999999999 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.815026+0000", 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031659499999999998 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.815085+0000", 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9061000000000003e-05 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.815128+0000", 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3534e-05 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:8356 3.4 3:24650f10:::rbd_data.11245d75990.0000000000000015:head [set-alloc-hint object_size 4194304 write_size 4194304,write 655360~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T22:01:14.561 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.938625+0000", 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5420967700000006, 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038997189999999998, 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 8356 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.938625+0000", 2024-09-21T22:01:14.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.938625+0000", 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.938627+0000", 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9989999999999998e-06 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.938642+0000", 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5588999999999999e-05 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.938659+0000", 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7039999999999999e-05 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.938667+0000", 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9510000000000006e-06 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.938736+0000", 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8417000000000006e-05 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.938846+0000", 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010999 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.939007+0000", 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016117599999999999 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:14.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.939977+0000", 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00097069300000000001 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.942405+0000", 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002427551 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.942467+0000", 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1501999999999995e-05 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.942524+0000", 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7810999999999999e-05 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:13939 3.4 3:21977d81:::rbd_data.112457ad1d60.0000000000000007:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:14.196800+0000", 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.28392178400000001, 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044217830000000003, 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:14.567 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 13939 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.196800+0000", 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.196800+0000", 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.196801+0000", 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5999999999999991e-07 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.196806+0000", 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.553e-06 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.196820+0000", 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.379e-05 2024-09-21T22:01:14.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.196828+0000", 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0090000000000007e-06 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.196873+0000", 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5077999999999998e-05 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.196919+0000", 2024-09-21T22:01:14.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5785000000000003e-05 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.197664+0000", 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00074491200000000003 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.201115+0000", 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003451712 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.201132+0000", 2024-09-21T22:01:14.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6200000000000001e-05 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.201181+0000", 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9628e-05 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.201221+0000", 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0156e-05 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:14.572 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:14.573 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:14.615 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:14.613+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:14.675 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:14.675+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:14.716 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:14.717 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:14.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:14.776 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:14.774+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:14.811 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone12 from 0x6736723 (overlap 0x6736723) to 0x483fb65 2024-09-21T22:01:14.839 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:14.839 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:14.849 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:14.890 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:14.888+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:14.904 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-21T22:01:14.978 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:14.977+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:15.008 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1850 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 425984~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.480267+0000", 2024-09-21T22:01:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.525508205, 2024-09-21T22:01:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015471591999999999, 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1850 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480267+0000", 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480267+0000", 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480268+0000", 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7599999999999998e-07 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480276+0000", 2024-09-21T22:01:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4789999999999996e-06 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480282+0000", 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7969999999999997e-06 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480287+0000", 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8720000000000001e-06 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.495549+0000", 2024-09-21T22:01:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015262169000000001 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.495646+0000", 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6749999999999994e-05 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.495739+0000", 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3148999999999999e-05 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1862 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 212992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.480329+0000", 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.525446643, 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015535904999999999, 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1862 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480329+0000", 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480329+0000", 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480329+0000", 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000004e-07 2024-09-21T22:01:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480332+0000", 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8600000000000001e-06 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480338+0000", 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480342+0000", 2024-09-21T22:01:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.498e-06 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.495767+0000", 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015424784 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.495809+0000", 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1656999999999998e-05 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.495865+0000", 2024-09-21T22:01:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5996999999999999e-05 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1876 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.480385+0000", 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.525390725999999, 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015699894999999998, 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1876 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480385+0000", 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480385+0000", 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480385+0000", 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480388+0000", 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1080000000000001e-06 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480394+0000", 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4809999999999997e-06 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480398+0000", 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4009999999999999e-06 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.495899+0000", 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015501331 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.495986+0000", 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6222000000000002e-05 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496085+0000", 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8992000000000004e-05 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1890 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 475136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.480441+0000", 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.525334869, 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015778572000000001, 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1890 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480441+0000", 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480441+0000", 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480441+0000", 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480443+0000", 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8169999999999999e-06 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480448+0000", 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8139999999999997e-06 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480453+0000", 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5689999999999998e-06 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496111+0000", 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015658406999999999 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496151+0000", 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9928000000000001e-05 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496219+0000", 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7676999999999996e-05 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1904 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.480500+0000", 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.52527519, 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015933892000000002, 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1904 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480500+0000", 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480500+0000", 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480501+0000", 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480506+0000", 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6300000000000003e-06 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480512+0000", 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1870000000000002e-06 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480517+0000", 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2660000000000003e-06 2024-09-21T22:01:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496255+0000", 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015737976000000001 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496338+0000", 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3622000000000007e-05 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496434+0000", 2024-09-21T22:01:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5847999999999994e-05 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1918 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 786432~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.480814+0000", 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524961845, 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015844503999999999, 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1918 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480814+0000", 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480814+0000", 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480814+0000", 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000001e-07 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480816+0000", 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9420000000000002e-06 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480822+0000", 2024-09-21T22:01:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0070000000000003e-06 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480826+0000", 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3390000000000003e-06 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496484+0000", 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015657568 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496559+0000", 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5574999999999994e-05 2024-09-21T22:01:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496658+0000", 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8580999999999997e-05 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1932 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.480870+0000", 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524904873000001, 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016012187000000001, 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1932 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480870+0000", 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480870+0000", 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480871+0000", 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4799999999999999e-07 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480873+0000", 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9319999999999999e-06 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480879+0000", 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2890000000000003e-06 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480883+0000", 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3669999999999999e-06 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496695+0000", 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015811434999999999 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496775+0000", 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0563999999999996e-05 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496883+0000", 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107252 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1956 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 589824~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.480955+0000", 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524820719000001, 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016130190999999999, 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1956 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480955+0000", 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480955+0000", 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480955+0000", 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4000000000000002e-07 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.480957+0000", 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2060000000000001e-06 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481149+0000", 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019179099999999999 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481155+0000", 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5029999999999997e-06 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496913+0000", 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015758489000000001 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.496989+0000", 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6200999999999998e-05 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497085+0000", 2024-09-21T22:01:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5461e-05 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1957 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.481165+0000", 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524610538999999, 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016121783000000001, 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1957 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481165+0000", 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481165+0000", 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481165+0000", 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3099999999999997e-07 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481168+0000", 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8789999999999999e-06 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481175+0000", 2024-09-21T22:01:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4289999999999998e-06 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481180+0000", 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497113+0000", 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015933750999999999 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497193+0000", 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9806000000000001e-05 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497287+0000", 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3453000000000001e-05 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1984 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 606208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.481268+0000", 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524507829999999, 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016228860000000001, 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1984 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481268+0000", 2024-09-21T22:01:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481268+0000", 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481268+0000", 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481270+0000", 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481275+0000", 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5310000000000001e-06 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481280+0000", 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6140000000000002e-06 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497316+0000", 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016036235999999999 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497386+0000", 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9716999999999997e-05 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497496+0000", 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011033500000000001 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:1985 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 868352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.481286+0000", 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524489428999999, 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016426657000000001, 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1985 2024-09-21T22:01:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481286+0000", 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481286+0000", 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481286+0000", 2024-09-21T22:01:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.46e-07 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481288+0000", 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9209999999999999e-06 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481294+0000", 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.553e-06 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481299+0000", 2024-09-21T22:01:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9899999999999997e-06 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497524+0000", 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016225607 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497607+0000", 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2748000000000001e-05 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497713+0000", 2024-09-21T22:01:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000105492 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2002 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.481363+0000", 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.52441205, 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016682232000000002, 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2002 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481363+0000", 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481363+0000", 2024-09-21T22:01:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481364+0000", 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481365+0000", 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.784e-06 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481371+0000", 2024-09-21T22:01:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9270000000000002e-06 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481376+0000", 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4100000000000001e-06 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497827+0000", 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016451308000000001 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.497949+0000", 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121592 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498046+0000", 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6905999999999997e-05 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2016 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 655360~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.481420+0000", 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524355322, 2024-09-21T22:01:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016813242999999999, 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2016 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481420+0000", 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481420+0000", 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481420+0000", 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7e-07 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481426+0000", 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7270000000000004e-06 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481432+0000", 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1700000000000002e-06 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481437+0000", 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3209999999999998e-06 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498123+0000", 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016686013999999999 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498172+0000", 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9718000000000001e-05 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498233+0000", 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0922999999999999e-05 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2030 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.481510+0000", 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524264876, 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017001965000000001, 2024-09-21T22:01:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2030 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481510+0000", 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481510+0000", 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481511+0000", 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1699999999999999e-07 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481512+0000", 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.192e-06 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481515+0000", 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0199999999999999e-06 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481518+0000", 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3440000000000001e-06 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498312+0000", 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016794072 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498397+0000", 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4789000000000004e-05 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498512+0000", 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011523099999999999 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2044 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.481561+0000", 2024-09-21T22:01:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524214617, 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017082739999999999, 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2044 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481561+0000", 2024-09-21T22:01:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481561+0000", 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481561+0000", 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0699999999999998e-07 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481563+0000", 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2259999999999999e-06 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481568+0000", 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7249999999999997e-06 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481571+0000", 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2090000000000001e-06 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498530+0000", 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016959144999999998 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498589+0000", 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8666999999999999e-05 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498643+0000", 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4360999999999997e-05 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2058 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 720896~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.481595+0000", 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524180037000001, 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017317608000000002, 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2058 2024-09-21T22:01:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481595+0000", 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481595+0000", 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481596+0000", 2024-09-21T22:01:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-07 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481597+0000", 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8400000000000002e-07 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481599+0000", 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9349999999999999e-06 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481602+0000", 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3460000000000001e-06 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498723+0000", 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017120874000000001 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498808+0000", 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5208000000000001e-05 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498913+0000", 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000105058 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2072 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 737280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.481628+0000", 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524147528, 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017547737000000001, 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2072 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481628+0000", 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481628+0000", 2024-09-21T22:01:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481628+0000", 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5800000000000001e-07 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481630+0000", 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.415e-06 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481633+0000", 2024-09-21T22:01:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.179e-06 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481635+0000", 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.509e-06 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.498988+0000", 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017353059000000001 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.499071+0000", 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2348000000000005e-05 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.499176+0000", 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000104969 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:2086 3.18 3:1bdec108:::rbd_data.1124354cd08a.0000000000000018:4 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:01.481661+0000", 2024-09-21T22:01:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.524114125000001, 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017790283, 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 2086 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481661+0000", 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481661+0000", 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481662+0000", 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.44e-07 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481664+0000", 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.824e-06 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481669+0000", 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3920000000000002e-06 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.481674+0000", 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.544e-06 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.499263+0000", 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017588995999999999 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.499353+0000", 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9969999999999994e-05 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:01.499452+0000", 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9012999999999995e-05 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:12854 3.1e 3:7c4ff0c3:::rbd_data.11248cd3db3a.000000000000001e:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:13.190112+0000", 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.8156633979999999, 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.020239450999999999, 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 12854 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.190112+0000", 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.190112+0000", 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.190113+0000", 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.358e-06 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.190122+0000", 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1759999999999993e-06 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.190136+0000", 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4246e-05 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.190143+0000", 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.764e-06 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.190189+0000", 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6712999999999998e-05 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.190289+0000", 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000100139 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.193709+0000", 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003419886 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.210238+0000", 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016528898 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.210278+0000", 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0108999999999998e-05 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.210317+0000", 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8438e-05 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.210351+0000", 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4724000000000002e-05 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:13056 3.7 3:e6fd2250:::rbd_data.11248cd3db3a.000000000000000e:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:13.457576+0000", 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.5481992519999999, 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015391586000000001, 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 13056 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.457576+0000", 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.457576+0000", 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.457578+0000", 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9209999999999999e-06 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.457586+0000", 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8180000000000004e-06 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.457601+0000", 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4735e-05 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.457607+0000", 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8159999999999996e-06 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.457658+0000", 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1072999999999997e-05 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.457711+0000", 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2568999999999998e-05 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 7", 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.460668+0000", 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029564600000000002 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.472840+0000", 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012172281 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.472860+0000", 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9738999999999999e-05 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.472916+0000", 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6647999999999997e-05 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:13.472968+0000", 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1526000000000001e-05 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:15.096 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:15.098 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:15.098 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:15.097+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:15.158 INFO:teuthology.orchestra.run.smithi102.stdout:1614 writesame 0x6488ec9 thru 0x649554d data_size 0x1(0xc685 bytes) 2024-09-21T22:01:15.169 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:15.197 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:15.197 INFO:teuthology.orchestra.run.smithi102.stdout:1616 read 0x10c7ab4 thru 0x10cf23a (0x7787 bytes) 2024-09-21T22:01:15.198 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:15.196+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:15.205 INFO:teuthology.orchestra.run.smithi102.stdout:1617 write 0x8dc40ef thru 0x8dd1dd4 (0xdce6 bytes) 2024-09-21T22:01:15.205 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:15.205 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:15.205 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:15.206 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:15.217 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:15.221 INFO:teuthology.orchestra.run.smithi102.stdout:1618 trunc from 0x8dd1dd5 to 0x71a6530 2024-09-21T22:01:15.275 INFO:teuthology.orchestra.run.smithi102.stdout:1619 read 0x60fd231 thru 0x61055b5 (0x8385 bytes) 2024-09-21T22:01:15.276 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:15.284 INFO:teuthology.orchestra.run.smithi102.stdout:1621 write 0x9e0b312 thru 0x9e1606b (0xad5a bytes) 2024-09-21T22:01:15.285 INFO:teuthology.orchestra.run.smithi102.stdout:1622 clone 14 order 20 su 4096 sc 10 2024-09-21T22:01:15.298 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:15.297+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:15.316 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:15.332 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:15.333 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:15.334 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:15.335 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:15.335 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:15.335 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:15.335 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:15.343 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:15.348 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:15.364 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:15.381 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:15.381 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:15.397 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:15.397 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:15.399 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:15.397+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:15.414 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:15.415 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:15.431 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:15.488 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:15.488 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:15.497 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:15.541 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:15.540+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:15.600 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:15.600 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:15.601 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:15.600+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:15.609 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:15.701 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:15.700+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:15.752 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:15.752 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:15.761 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:15.768 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:01:15.805 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:15.804+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:15.832 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone13 from 0x9e1606c (overlap 0x6736723) to 0x1ef6bbd 2024-09-21T22:01:15.869 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:15.869 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:15.878 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:15.907 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-21T22:01:15.921 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:15.920+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:15.996 INFO:teuthology.orchestra.run.smithi102.stdout:1623 write 0x866969a thru 0x867621b (0xcb82 bytes) 2024-09-21T22:01:16.003 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:16.002+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:16.044 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:16.044 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:16.056 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:16.103 INFO:teuthology.orchestra.run.smithi102.stdout:1624 punch from 0x29ecd7a to 0x29f61ec, (0x9472 bytes) 2024-09-21T22:01:16.103 INFO:teuthology.orchestra.run.smithi102.stdout:1626 read 0x1e1f9ef thru 0x1e2abd7 (0xb1e9 bytes) 2024-09-21T22:01:16.104 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:16.102+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:16.182 INFO:teuthology.orchestra.run.smithi102.stdout:1628 trunc from 0x9e1606c to 0x2ca91d7 2024-09-21T22:01:16.204 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:16.202+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:16.248 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:16.248 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:16.261 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:16.306 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:16.304+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:16.364 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:16.365 INFO:teuthology.orchestra.run.smithi102.stdout:1631 read 0x1d9dde5 thru 0x1da26cb (0x48e7 bytes) 2024-09-21T22:01:16.393 INFO:teuthology.orchestra.run.smithi102.stdout:1633 trunc from 0x2ca91d7 to 0x92ae464 2024-09-21T22:01:16.398 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:16.398 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:16.406 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:16.405+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:16.410 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:16.438 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:16.444 INFO:teuthology.orchestra.run.smithi102.stdout:1635 trunc from 0x92ae464 to 0x455d538 2024-09-21T22:01:16.449 INFO:teuthology.orchestra.run.smithi102.stdout:1636 read 0x44c7176 thru 0x44d4c7f (0xdb0a bytes) 2024-09-21T22:01:16.449 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:16.465 INFO:teuthology.orchestra.run.smithi102.stdout:1640 write 0xd34c23e thru 0xd34da31 (0x17f4 bytes) 2024-09-21T22:01:16.471 INFO:teuthology.orchestra.run.smithi102.stdout:1641 writesame 0x6d181 thru 0x70f9f data_size 0x1f(0x3e1f bytes) 2024-09-21T22:01:16.507 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:16.507+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:16.535 INFO:teuthology.orchestra.run.smithi102.stdout:1642 read 0xa7959c8 thru 0xa79fa23 (0xa05c bytes) 2024-09-21T22:01:16.535 INFO:teuthology.orchestra.run.smithi102.stdout:1645 read 0x3fc1e38 thru 0x3fc8b4c (0x6d15 bytes) 2024-09-21T22:01:16.535 INFO:teuthology.orchestra.run.smithi102.stdout:1646 read 0x49eb58c thru 0x49f9a38 (0xe4ad bytes) 2024-09-21T22:01:16.537 INFO:teuthology.orchestra.run.smithi102.stdout:1647 trunc from 0xd34da32 to 0xbce787f 2024-09-21T22:01:16.546 INFO:teuthology.orchestra.run.smithi102.stdout:1648 write 0xb6a382a thru 0xb6a698e (0x3165 bytes) 2024-09-21T22:01:16.554 INFO:teuthology.orchestra.run.smithi102.stdout:1649 write 0xa6d6ee2 thru 0xa6ddccd (0x6dec bytes) 2024-09-21T22:01:16.567 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:16.567 INFO:teuthology.orchestra.run.smithi102.stdout:1651 write 0x35b8798 thru 0x35b946d (0xcd6 bytes) 2024-09-21T22:01:16.576 INFO:teuthology.orchestra.run.smithi102.stdout:1652 read 0x81eee66 thru 0x81ef0bf (0x25a bytes) 2024-09-21T22:01:16.576 INFO:teuthology.orchestra.run.smithi102.stdout:1653 punch from 0x3f39be6 to 0x3f40b6e, (0x6f88 bytes) 2024-09-21T22:01:16.576 INFO:teuthology.orchestra.run.smithi102.stdout:1654 read 0xb87278b thru 0xb87f374 (0xcbea bytes) 2024-09-21T22:01:16.576 INFO:teuthology.orchestra.run.smithi102.stdout:1655 read 0xa886fef thru 0xa88dc82 (0x6c94 bytes) 2024-09-21T22:01:16.576 INFO:teuthology.orchestra.run.smithi102.stdout:1657 read 0x32626e9 thru 0x326b297 (0x8baf bytes) 2024-09-21T22:01:16.577 INFO:teuthology.orchestra.run.smithi102.stdout:1659 read 0x20533a6 thru 0x205e563 (0xb1be bytes) 2024-09-21T22:01:16.578 INFO:teuthology.orchestra.run.smithi102.stdout:1660 read 0x912ea57 thru 0x91314a6 (0x2a50 bytes) 2024-09-21T22:01:16.578 INFO:teuthology.orchestra.run.smithi102.stdout:1661 write 0x3a6d2fb thru 0x3a785ae (0xb2b4 bytes) 2024-09-21T22:01:16.582 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:16.582 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:16.592 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:16.602 INFO:teuthology.orchestra.run.smithi102.stdout:1662 trunc from 0xbce787f to 0x20bb736 2024-09-21T22:01:16.632 INFO:teuthology.orchestra.run.smithi102.stdout:1663 write 0x8220ae5 thru 0x822582c (0x4d48 bytes) 2024-09-21T22:01:16.634 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:16.633+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:16.643 INFO:teuthology.orchestra.run.smithi102.stdout:1665 punch from 0x3c2328f to 0x3c2f1e2, (0xbf53 bytes) 2024-09-21T22:01:16.643 INFO:teuthology.orchestra.run.smithi102.stdout:1666 punch from 0x741f057 to 0x742cd0f, (0xdcb8 bytes) 2024-09-21T22:01:16.653 INFO:teuthology.orchestra.run.smithi102.stdout:1667 write 0xbd0565e thru 0xbd0f2a1 (0x9c44 bytes) 2024-09-21T22:01:16.668 INFO:teuthology.orchestra.run.smithi102.stdout:1668 write 0x58a0bf7 thru 0x58a8828 (0x7c32 bytes) 2024-09-21T22:01:16.686 INFO:teuthology.orchestra.run.smithi102.stdout:1669 punch from 0x4751235 to 0x4754be6, (0x39b1 bytes) 2024-09-21T22:01:16.686 INFO:teuthology.orchestra.run.smithi102.stdout:1670 writesame 0x5bb230f thru 0x5bc0f4f data_size 0x1(0xec41 bytes) 2024-09-21T22:01:16.708 INFO:teuthology.orchestra.run.smithi102.stdout:1671 trunc from 0xbd0f2a2 to 0x82b870d 2024-09-21T22:01:16.709 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:16.707+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:16.719 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:16.719 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:16.720 INFO:teuthology.orchestra.run.smithi102.stdout:1674 writesame 0x2f4209a thru 0x2f48d03 data_size 0x1(0x6c6a bytes) 2024-09-21T22:01:16.730 INFO:teuthology.orchestra.run.smithi102.stdout:1675 write 0x46e2acc thru 0x46e7ad0 (0x5005 bytes) 2024-09-21T22:01:16.740 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:16.740 INFO:teuthology.orchestra.run.smithi102.stdout:1678 writesame 0x5b06609 thru 0x5b159e3 data_size 0x1(0xf3db bytes) 2024-09-21T22:01:16.748 INFO:teuthology.orchestra.run.smithi102.stdout:1680 read 0x25b31f2 thru 0x25bb42f (0x823e bytes) 2024-09-21T22:01:16.749 INFO:teuthology.orchestra.run.smithi102.stdout:1681 read 0x5de3401 thru 0x5df308c (0xfc8c bytes) 2024-09-21T22:01:16.750 INFO:teuthology.orchestra.run.smithi102.stdout:1682 punch from 0x83522e to 0x84115c, (0xbf2e bytes) 2024-09-21T22:01:16.754 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:16.754 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:16.757 INFO:teuthology.orchestra.run.smithi102.stdout:1683 write 0xa5009b3 thru 0xa507569 (0x6bb7 bytes) 2024-09-21T22:01:16.764 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:01:16.772 INFO:teuthology.orchestra.run.smithi102.stdout:1684 read 0x5505429 thru 0x550c169 (0x6d41 bytes) 2024-09-21T22:01:16.775 INFO:teuthology.orchestra.run.smithi102.stdout:1685 punch from 0x3d1865b to 0x3d27a6c, (0xf411 bytes) 2024-09-21T22:01:16.775 INFO:teuthology.orchestra.run.smithi102.stdout:1686 read 0x4226e0c thru 0x42306e5 (0x98da bytes) 2024-09-21T22:01:16.776 INFO:teuthology.orchestra.run.smithi102.stdout:1687 read 0x6e45f87 thru 0x6e555bd (0xf637 bytes) 2024-09-21T22:01:16.776 INFO:teuthology.orchestra.run.smithi102.stdout:1688 write 0x705a05d thru 0x7060577 (0x651b bytes) 2024-09-21T22:01:16.788 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:16.788 INFO:teuthology.orchestra.run.smithi102.stdout:1691 writesame 0x189d397 thru 0x18a5edd data_size 0x5(0x8b47 bytes) 2024-09-21T22:01:16.810 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:16.809+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:16.832 INFO:teuthology.orchestra.run.smithi102.stdout:1692 write 0x8726b72 thru 0x872768a (0xb19 bytes) 2024-09-21T22:01:16.838 INFO:teuthology.orchestra.run.smithi102.stdout:1695 trunc from 0xa50756a to 0xb015f49 2024-09-21T22:01:16.843 INFO:teuthology.orchestra.run.smithi102.stdout:1696 write 0x1423eb9 thru 0x1425783 (0x18cb bytes) 2024-09-21T22:01:16.845 INFO:teuthology.orchestra.run.smithi102.stdout:1697 punch from 0x55b9e13 to 0x55be5cb, (0x47b8 bytes) 2024-09-21T22:01:16.845 INFO:teuthology.orchestra.run.smithi102.stdout:1698 punch from 0x24dd64 to 0x258e66, (0xb102 bytes) 2024-09-21T22:01:16.845 INFO:teuthology.orchestra.run.smithi102.stdout:1699 punch from 0xaf1a00e to 0xaf1b769, (0x175b bytes) 2024-09-21T22:01:16.845 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:16.845 INFO:teuthology.orchestra.run.smithi102.stdout:1702 clone 15 order 23 su 2097152 sc 4 2024-09-21T22:01:16.883 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:16.883 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:16.892 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:16.933 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:16.932+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:16.995 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:16.995 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:17.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:17.047 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:17.045+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:17.107 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:17.107 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:17.112 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:17.111+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:17.116 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:17.213 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:17.211+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:17.260 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:17.260 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:17.268 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:17.314 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:17.313+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:17.411 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:17.411 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:17.415 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:17.414+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:17.420 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:17.442 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:17.470 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:01:17.471 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:01:17.471 INFO:tasks.thrashosds.thrasher:Adding osd 6 2024-09-21T22:01:17.471 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 6 2024-09-21T22:01:17.515 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:17.514+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:17.527 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:17.527 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:17.536 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:17.585 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:17.585 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:17.604 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:17.604 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:17.616 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:17.614+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:17.623 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:17.639 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:17.639 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:17.656 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:17.656 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:17.673 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:17.673 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:17.688 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:17.688 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:17.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:5733 3.6 e32/23 3:6711db61:::rbd_data.11241aed97b.0000000000000005:head v 32'8, mlcod=32'5)", 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.736300474, 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031617640000000001, 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:17.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950215+0000", 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5000000000000002e-07 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950222+0000", 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6309999999999997e-06 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950235+0000", 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2848e-05 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950241+0000", 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9229999999999999e-06 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950292+0000", 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0767999999999999e-05 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.950312+0000", 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0658000000000001e-05 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.953336+0000", 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030239329999999999 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:03.953377+0000", 2024-09-21T22:01:17.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0352999999999998e-05 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6273 3.8 e34/23 3:17287710:::rbd_data.11241c6bf084.0000000000000004:head v 34'12, mlcod=33'8)", 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.779057+0000", 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.907458118999999, 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039622850000000003, 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779057+0000", 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779057+0000", 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779058+0000", 2024-09-21T22:01:17.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0200000000000001e-07 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779065+0000", 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0219999999999999e-06 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779078+0000", 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2509e-05 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779085+0000", 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0060000000000003e-06 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779139+0000", 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4163000000000003e-05 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779159+0000", 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0653999999999999e-05 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.782978+0000", 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038188300000000001 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783019+0000", 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1298999999999999e-05 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6276 3.8 e34/23 3:139e13d6:::rbd_data.11241c6bf084.0000000000000006:head v 34'13, mlcod=33'8)", 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.779874+0000", 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.906640955, 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059474469999999998, 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779874+0000", 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779874+0000", 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779875+0000", 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7899999999999998e-07 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779895+0000", 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9616e-05 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779906+0000", 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1759e-05 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.779913+0000", 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4790000000000001e-06 2024-09-21T22:01:17.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780183+0000", 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00027045699999999999 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780202+0000", 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8856e-05 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785800+0000", 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055976419999999999 2024-09-21T22:01:17.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785822+0000", 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1959000000000001e-05 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6277 3.8 e34/23 3:139e13d6:::rbd_data.11241c6bf084.0000000000000006:head v 34'15, mlcod=33'8)", 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.780632+0000", 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.905883269, 2024-09-21T22:01:17.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052038550000000003, 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780632+0000", 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780632+0000", 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780633+0000", 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9800000000000003e-07 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780639+0000", 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5849999999999996e-06 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780650+0000", 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0402e-05 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780657+0000", 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3350000000000001e-06 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780709+0000", 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2077999999999998e-05 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.780730+0000", 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0755e-05 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785824+0000", 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050940100000000004 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785836+0000", 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1992e-05 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.706 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6281 3.8 e34/23 3:1043a0b3:::rbd_object_map.11241c6bf084:head v 34'16, mlcod=34'9)", 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.783460+0000", 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.903055222000001, 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047000590000000004, 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783460+0000", 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783460+0000", 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783461+0000", 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0900000000000001e-07 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783466+0000", 2024-09-21T22:01:17.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8609999999999997e-06 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783483+0000", 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7252e-05 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783489+0000", 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5699999999999998e-06 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783538+0000", 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8613999999999999e-05 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.783554+0000", 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5931999999999999e-05 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.788134+0000", 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045798849999999997 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.788160+0000", 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6336e-05 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6283 3.8 e34/23 3:1043a0b3:::rbd_object_map.11241c6bf084:head v 34'17, mlcod=34'10)", 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.902191388, 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064856749999999998, 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784324+0000", 2024-09-21T22:01:17.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1200000000000003e-07 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784328+0000", 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9809999999999997e-06 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784336+0000", 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5669999999999997e-06 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784343+0000", 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.737e-06 2024-09-21T22:01:17.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785563+0000", 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0012207590000000001 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785577+0000", 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3118999999999999e-05 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790766+0000", 2024-09-21T22:01:17.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051893119999999997 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790810+0000", 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3687999999999999e-05 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6285 3.8 e34/23 3:1043a0b3:::rbd_object_map.11241c6bf084:head v 34'18, mlcod=34'10)", 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.901633429, 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059974349999999997, 2024-09-21T22:01:17.715 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784882+0000", 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.01e-07 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784886+0000", 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4189999999999998e-06 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784892+0000", 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999997e-06 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.784897+0000", 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7530000000000001e-06 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785857+0000", 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096060000000000004 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.785871+0000", 2024-09-21T22:01:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3269e-05 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790813+0000", 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049422490000000001 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.790879+0000", 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6383000000000005e-05 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:6292 3.a e34/28 3:54ffb751:::rbd_data.11241c6bf084.0000000000000001:head v 34'25, mlcod=33'21)", 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:04.792368+0000", 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.894147051999999, 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039734059999999996, 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792368+0000", 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792368+0000", 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792369+0000", 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1600000000000001e-07 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792375+0000", 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2450000000000003e-06 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792387+0000", 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1613e-05 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792393+0000", 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792650+0000", 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00025638199999999999 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.792661+0000", 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1581e-05 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.796308+0000", 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0036463749999999999 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:04.796342+0000", 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4044999999999997e-05 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7628 3.1a e34/23 3:59997cf8:::rbd_object_map.11245d75990:head v 34'59, mlcod=34'57)", 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.343040648000001, 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039423549999999998, 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343475+0000", 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3600000000000003e-07 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343480+0000", 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5739999999999997e-06 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343489+0000", 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9339999999999995e-06 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343495+0000", 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0260000000000004e-06 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343542+0000", 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6940000000000001e-05 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.343562+0000", 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0591999999999999e-05 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.347359+0000", 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003796654 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.347417+0000", 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7998999999999998e-05 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.727 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7632 3.1a e34/23 3:59997cf8:::rbd_object_map.11245d75990:head v 34'61, mlcod=34'59)", 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.349031+0000", 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.337483957, 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034961710000000002, 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349031+0000", 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349031+0000", 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349032+0000", 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7400000000000002e-07 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349038+0000", 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.964e-06 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349051+0000", 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2818e-05 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349058+0000", 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349101+0000", 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2945000000000003e-05 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.349113+0000", 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2422999999999999e-05 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352502+0000", 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033889879999999999 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352528+0000", 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5551999999999999e-05 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:7634 3.1a e34/23 3:59997cf8:::rbd_object_map.11245d75990:head v 34'63, mlcod=34'59)", 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.352190+0000", 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.334325131, 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034284049999999998, 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352190+0000", 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352190+0000", 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352191+0000", 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5300000000000004e-07 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352195+0000", 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7260000000000002e-06 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352204+0000", 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7809999999999994e-06 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352210+0000", 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2179999999999996e-06 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352245+0000", 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5024000000000002e-05 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.352259+0000", 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295999999999999e-05 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.355589+0000", 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033299660000000002 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.355619+0000", 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9841000000000001e-05 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:8258 3.4 e35/23 3:2443562f:::rbd_data.11245d75990.0000000000000006:head v 35'56, mlcod=35'54)", 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.874965758, 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033350820000000001, 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.736 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811550+0000", 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1900000000000003e-07 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811555+0000", 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0100000000000003e-06 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811564+0000", 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9069999999999996e-06 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811573+0000", 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8720000000000008e-06 2024-09-21T22:01:17.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811622+0000", 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9206999999999998e-05 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811637+0000", 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4789e-05 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814833+0000", 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031957560000000001 2024-09-21T22:01:17.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.814885+0000", 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2021999999999998e-05 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:8255 3.1a e35/23 3:5c2256b7:::rbd_data.11245d75990.0000000000000003:head v 35'125, mlcod=35'123)", 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:05.811912+0000", 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.874603146, 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058016710000000004, 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.740 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811912+0000", 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811912+0000", 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811913+0000", 2024-09-21T22:01:17.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4600000000000003e-07 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811921+0000", 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811932+0000", 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1368e-05 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811938+0000", 2024-09-21T22:01:17.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3500000000000002e-06 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.811996+0000", 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7216999999999998e-05 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.812016+0000", 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0593000000000001e-05 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.817672+0000", 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056554689999999998 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:05.817714+0000", 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2191999999999999e-05 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:8467 3.19 3:98c60cb6:::rbd_data.11245d75990.0000000000000021:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:06.053457+0000", 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.633058058, 2024-09-21T22:01:17.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0089674449999999992, 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 8467 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053457+0000", 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053457+0000", 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053459+0000", 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8780000000000001e-06 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053473+0000", 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3369e-05 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053489+0000", 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.647e-05 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053498+0000", 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1910000000000006e-06 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053549+0000", 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0639000000000001e-05 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.053642+0000", 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3306000000000004e-05 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.055069+0000", 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0014269630000000001 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062351+0000", 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0072819060000000003 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062363+0000", 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.17e-05 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062394+0000", 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1247000000000001e-05 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:06.062425+0000", 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0775999999999998e-05 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.749 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:10543 3.a e37/28 3:52b77e0f:::rbd_data.11246f0f1a8f.00000000000000ee:head v 37'29, mlcod=37'27)", 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.2092297070000004, 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040004919999999996, 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:17.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477286+0000", 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5799999999999998e-07 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477294+0000", 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2790000000000001e-06 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477305+0000", 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1843e-05 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477312+0000", 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8870000000000003e-06 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477364+0000", 2024-09-21T22:01:17.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1362000000000001e-05 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.477385+0000", 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1321000000000001e-05 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.481247+0000", 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038619549999999998 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:08.481286+0000", 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9087e-05 2024-09-21T22:01:17.753 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:13946 3.6 e43/23 3:60bbeb53:::rbd_data.112457ad1d60.0000000000000001:head v 43'40, mlcod=43'38)", 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:14.211601+0000", 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.4749146089999998, 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003457594, 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.211601+0000", 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.211601+0000", 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.211602+0000", 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2920000000000001e-06 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.211612+0000", 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7140000000000005e-06 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.211632+0000", 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0737000000000002e-05 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.211643+0000", 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.01e-05 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.211717+0000", 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4534000000000002e-05 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.211737+0000", 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9811000000000001e-05 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.215023+0000", 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003286396 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.215058+0000", 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5009999999999999e-05 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4388.0:14110 3.6 e44/23 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:head v 44'47, mlcod=43'42)", 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:14.815950+0000", 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 2.8705649040000001, 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031240339999999999, 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.758 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.815950+0000", 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.815950+0000", 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.815951+0000", 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4600000000000005e-07 2024-09-21T22:01:17.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.815957+0000", 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7089999999999999e-06 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.815965+0000", 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2490000000000001e-06 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.815969+0000", 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:01:17.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.816010+0000", 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0842e-05 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.816031+0000", 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0517e-05 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.819034+0000", 2024-09-21T22:01:17.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030033170000000001 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:14.819074+0000", 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0346000000000003e-05 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:14490 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.173693+0000", 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 2.5128219559999998, 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.022548156, 2024-09-21T22:01:17.762 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 14490 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.173693+0000", 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.173693+0000", 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.173695+0000", 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.327e-06 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.173801+0000", 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010671999999999999 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.173813+0000", 2024-09-21T22:01:17.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1423999999999999e-05 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.173818+0000", 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4110000000000004e-06 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.173874+0000", 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5325999999999998e-05 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.174007+0000", 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013387499999999999 2024-09-21T22:01:17.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.178246+0000", 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042385909999999999 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.196161+0000", 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017915239999999999 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.196171+0000", 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0023999999999999e-05 2024-09-21T22:01:17.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.196206+0000", 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5064999999999997e-05 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.196242+0000", 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5153e-05 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.767 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4388.0:14490 3.19 e44/23 ondisk, result = 0)", 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.189433+0000", 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 2.4970820530000002, 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.006732544, 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.189433+0000", 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.189433+0000", 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.189434+0000", 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5099999999999998e-07 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.189440+0000", 2024-09-21T22:01:17.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4859999999999997e-06 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.189453+0000", 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3570000000000001e-05 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.189461+0000", 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2740000000000002e-06 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.196149+0000", 2024-09-21T22:01:17.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066884429999999996 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.196156+0000", 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5070000000000003e-06 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.196166+0000", 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3130000000000004e-06 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:head [stat,zero 19922944~4718592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.227874+0000", 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 2.4586414009999999, 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0072148339999999998, 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15340 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:17.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.227874+0000", 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.227874+0000", 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.227876+0000", 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.227884+0000", 2024-09-21T22:01:17.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8769999999999993e-06 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.227903+0000", 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9329000000000001e-05 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.227913+0000", 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.662e-06 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:17.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.227982+0000", 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9066000000000006e-05 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.228069+0000", 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.708e-05 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.235089+0000", 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070195500000000003 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:17.775 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:17.776 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:17.776 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:17.776 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:17.777 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:17.778 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:17.778 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:17.779 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:17.776+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:17.822 INFO:tasks.ceph.mon.a.smithi102.stderr:2024-09-21T22:01:17.820+0000 7f46e9689640 -1 mon.a@0(leader).osd e47 definitely_dead 0 2024-09-21T22:01:17.846 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone14 from 0xb015f49 (overlap 0x20bb736) to 0x0 2024-09-21T22:01:17.878 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:17.876+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:17.979 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:17.978+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:17.981 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:17.981 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:17.981 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:17.981 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:17.996 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:18.081 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:18.079+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:18.139 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-21T22:01:18.154 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:18.154 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:18.154 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:18.154 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:18.154 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:18.165 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:18.180 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:18.179+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:18.183 INFO:teuthology.orchestra.run.smithi102.stdout:1703 punch from 0x73c9599 to 0x73d8863, (0xf2ca bytes) 2024-09-21T22:01:18.187 INFO:teuthology.orchestra.run.smithi102.stdout:1705 punch from 0x5770eec to 0x57761bd, (0x52d1 bytes) 2024-09-21T22:01:18.195 INFO:teuthology.orchestra.run.smithi102.stdout:1706 write 0xcfaab13 thru 0xcfb7161 (0xc64f bytes) 2024-09-21T22:01:18.198 INFO:teuthology.orchestra.run.smithi102.stdout:1707 punch from 0x67d4fad to 0x67e0431, (0xb484 bytes) 2024-09-21T22:01:18.198 INFO:teuthology.orchestra.run.smithi102.stdout:1708 read 0x353aaf8 thru 0x35439eb (0x8ef4 bytes) 2024-09-21T22:01:18.199 INFO:teuthology.orchestra.run.smithi102.stdout:1709 read 0x479e201 thru 0x47aae98 (0xcc98 bytes) 2024-09-21T22:01:18.200 INFO:teuthology.orchestra.run.smithi102.stdout:1710 punch from 0x1434d19 to 0x1444670, (0xf957 bytes) 2024-09-21T22:01:18.209 INFO:teuthology.orchestra.run.smithi102.stdout:1712 write 0xed942cc thru 0xed9ed0f (0xaa44 bytes) 2024-09-21T22:01:18.221 INFO:teuthology.orchestra.run.smithi102.stdout:1717 trunc from 0xed9ed10 to 0x8a1ef1e 2024-09-21T22:01:18.241 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.241 INFO:teuthology.orchestra.run.smithi102.stdout:1721 write 0x782ae28 thru 0x7836bd2 (0xbdab bytes) 2024-09-21T22:01:18.256 INFO:teuthology.orchestra.run.smithi102.stdout:1722 trunc from 0x8a1ef1e to 0x18490e5 2024-09-21T22:01:18.281 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:18.280+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:18.324 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:18.324 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:18.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:18.324 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45256352300000002, 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:01:18.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:01:18.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.328 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45254353000000003, 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:01:18.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:18.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:01:18.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45242409500000003, 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45215738900000002, 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.337 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:01:18.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:18.341 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45212722700000002, 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:01:18.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:01:18.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45210169100000003, 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.346 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:01:18.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:01:18.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45207916300000001, 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:01:18.350 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.354 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.452055543, 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:01:18.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:01:18.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45203519399999997, 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45201278, 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:01:18.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.366 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.451836713, 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:01:18.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:01:18.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.370 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.451807705, 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.374 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45178587399999998, 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:01:18.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:01:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:01:18.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:01:18.378 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45162872900000001, 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:01:18.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.451596259, 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45157472799999998, 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:01:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45155341100000002, 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45152796899999997, 2024-09-21T22:01:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.45150727000000002, 2024-09-21T22:01:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:18.403 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.451486638, 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.407 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:18.409 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:18.410 INFO:teuthology.orchestra.run.smithi102.stdout:1723 write 0xedb3c91 thru 0xedbf336 (0xb6a6 bytes) 2024-09-21T22:01:18.410 INFO:teuthology.orchestra.run.smithi102.stdout:1726 read 0x404a94c thru 0x405479f (0x9e54 bytes) 2024-09-21T22:01:18.410 INFO:teuthology.orchestra.run.smithi102.stdout:1727 write 0x781c6c0 thru 0x7822d50 (0x6691 bytes) 2024-09-21T22:01:18.410 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.410 INFO:teuthology.orchestra.run.smithi102.stdout:1729 punch from 0x82ace11 to 0x82b995b, (0xcb4a bytes) 2024-09-21T22:01:18.410 INFO:teuthology.orchestra.run.smithi102.stdout:1730 read 0x9b35968 thru 0x9b3dc73 (0x830c bytes) 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1731 punch from 0x4af7ae9 to 0x4b018b9, (0x9dd0 bytes) 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1733 writesame 0x60762e thru 0x612ffd data_size 0x18(0xb9d0 bytes) 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1734 read 0xcb922cf thru 0xcba21b1 (0xfee3 bytes) 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1735 trunc from 0xedbf337 to 0x7eaac70 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1736 read 0x4d7d3b thru 0x4e110f (0x93d5 bytes) 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1737 read 0x1066b2 thru 0x115eec (0xf83b bytes) 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1738 write 0xb73ed34 thru 0xb749c9d (0xaf6a bytes) 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1739 punch from 0x4bd7cd to 0x4be100, (0x933 bytes) 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1740 trunc from 0xb749c9e to 0x248f25d 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1742 read 0x1442ff0 thru 0x144ca46 (0x9a57 bytes) 2024-09-21T22:01:18.411 INFO:teuthology.orchestra.run.smithi102.stdout:1743 write 0x3dee22b thru 0x3df3fc4 (0x5d9a bytes) 2024-09-21T22:01:18.411 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:18.406+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:18.413 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.413 INFO:teuthology.orchestra.run.smithi102.stdout:1746 writesame 0x34b5e21 thru 0x34b7408 data_size 0x2(0x15e8 bytes) 2024-09-21T22:01:18.415 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.422 INFO:teuthology.orchestra.run.smithi102.stdout:1749 write 0x633b4a6 thru 0x63404ad (0x5008 bytes) 2024-09-21T22:01:18.425 INFO:teuthology.orchestra.run.smithi102.stdout:1751 writesame 0x5fd9cee thru 0x5fdbb0a data_size 0x1(0x1e1d bytes) 2024-09-21T22:01:18.440 INFO:teuthology.orchestra.run.smithi102.stdout:1752 trunc from 0x63404ae to 0xdd1ea98 2024-09-21T22:01:18.445 INFO:teuthology.orchestra.run.smithi102.stdout:1753 read 0xbbe7207 thru 0xbbf16fe (0xa4f8 bytes) 2024-09-21T22:01:18.445 INFO:teuthology.orchestra.run.smithi102.stdout:1755 read 0x8fe43cb thru 0x8ff2e1a (0xea50 bytes) 2024-09-21T22:01:18.445 INFO:teuthology.orchestra.run.smithi102.stdout:1756 write 0x9886645 thru 0x98943d0 (0xdd8c bytes) 2024-09-21T22:01:18.449 INFO:teuthology.orchestra.run.smithi102.stdout:1757 write 0x8b42e33 thru 0x8b4ebdf (0xbdad bytes) 2024-09-21T22:01:18.452 INFO:teuthology.orchestra.run.smithi102.stdout:1758 read 0xc1faf3b thru 0xc204478 (0x953e bytes) 2024-09-21T22:01:18.452 INFO:teuthology.orchestra.run.smithi102.stdout:1759 write 0x9ea44d0 thru 0x9eabd5e (0x788f bytes) 2024-09-21T22:01:18.455 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.455 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.455 INFO:teuthology.orchestra.run.smithi102.stdout:1762 write 0x2a2c398 thru 0x2a2ff7d (0x3be6 bytes) 2024-09-21T22:01:18.458 INFO:teuthology.orchestra.run.smithi102.stdout:1763 writesame 0x91e7aac thru 0x91f17fd data_size 0xd(0x9d52 bytes) 2024-09-21T22:01:18.460 INFO:teuthology.orchestra.run.smithi102.stdout:1764 write 0x59cde53 thru 0x59d8b75 (0xad23 bytes) 2024-09-21T22:01:18.463 INFO:teuthology.orchestra.run.smithi102.stdout:1765 write 0x66d663b thru 0x66d98db (0x32a1 bytes) 2024-09-21T22:01:18.465 INFO:teuthology.orchestra.run.smithi102.stdout:1766 read 0x58aa1e8 thru 0x58b9c63 (0xfa7c bytes) 2024-09-21T22:01:18.466 INFO:teuthology.orchestra.run.smithi102.stdout:1767 writesame 0x4b9889 thru 0x4c4942 data_size 0x1(0xb0ba bytes) 2024-09-21T22:01:18.491 INFO:teuthology.orchestra.run.smithi102.stdout:1768 trunc from 0xdd1ea98 to 0x656094f 2024-09-21T22:01:18.505 INFO:teuthology.orchestra.run.smithi102.stdout:1770 punch from 0x487877c to 0x487bd3d, (0x35c1 bytes) 2024-09-21T22:01:18.505 INFO:teuthology.orchestra.run.smithi102.stdout:1771 read 0x6284c42 thru 0x628f59b (0xa95a bytes) 2024-09-21T22:01:18.505 INFO:teuthology.orchestra.run.smithi102.stdout:1772 read 0x38951de thru 0x3898e0b (0x3c2e bytes) 2024-09-21T22:01:18.506 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.510 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:18.508+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:18.514 INFO:teuthology.orchestra.run.smithi102.stdout:1774 trunc from 0x656094f to 0xd579fe2 2024-09-21T22:01:18.519 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.519 INFO:teuthology.orchestra.run.smithi102.stdout:1776 write 0xd5439fc thru 0xd54df5b (0xa560 bytes) 2024-09-21T22:01:18.523 INFO:teuthology.orchestra.run.smithi102.stdout:1778 read 0xb02f107 thru 0xb031a25 (0x291f bytes) 2024-09-21T22:01:18.523 INFO:teuthology.orchestra.run.smithi102.stdout:1779 read 0xc8e2777 thru 0xc8edc1e (0xb4a8 bytes) 2024-09-21T22:01:18.523 INFO:teuthology.orchestra.run.smithi102.stdout:1782 punch from 0xaa637eb to 0xaa6487d, (0x1092 bytes) 2024-09-21T22:01:18.523 INFO:teuthology.orchestra.run.smithi102.stdout:1784 read 0x4b614e9 thru 0x4b618e6 (0x3fe bytes) 2024-09-21T22:01:18.523 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.523 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.523 INFO:teuthology.orchestra.run.smithi102.stdout:1788 punch from 0x441a5d7 to 0x44270fe, (0xcb27 bytes) 2024-09-21T22:01:18.523 INFO:teuthology.orchestra.run.smithi102.stdout:1790 read 0xc49105 thru 0xc5425d (0xb159 bytes) 2024-09-21T22:01:18.523 INFO:teuthology.orchestra.run.smithi102.stdout:1792 write 0x6dfb2a7 thru 0x6e04c77 (0x99d1 bytes) 2024-09-21T22:01:18.527 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:18.527 INFO:teuthology.orchestra.run.smithi102.stdout:1794 read 0x8fd1b83 thru 0x8fdbc95 (0xa113 bytes) 2024-09-21T22:01:18.527 INFO:teuthology.orchestra.run.smithi102.stdout:1795 clone 16 order 24 su 65536 sc 7 2024-09-21T22:01:18.528 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:18.529 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:18.529 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:18.529 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:18.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:18.611 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:18.610+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:18.680 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:18.680 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:18.680 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:18.680 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:18.680 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:18.689 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:18.711 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:18.710+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:18.780 INFO:teuthology.orchestra.run.smithi102.stderr:marked in osd.6. 2024-09-21T22:01:18.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:01:18.796 INFO:tasks.thrashosds.thrasher:Added osd 6 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31366 3.8 3:12d1962e:::rbd_header.1124528f4459:head [watch reconnect cookie 140678969648192 gen 7] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.83145997599999999, 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030645964000000001, 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.800 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31366 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966206+0000", 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4499999999999997e-07 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966208+0000", 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966214+0000", 2024-09-21T22:01:18.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966219+0000", 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6929999999999998e-06 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.990079+0000", 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023859706000000001 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.990148+0000", 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9617999999999997e-05 2024-09-21T22:01:18.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.996851+0000", 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067029969999999996 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31674 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3407872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81860691799999996, 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028037220000000002, 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.804 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31674 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:18.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979059+0000", 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979061+0000", 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.95e-06 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979066+0000", 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.711e-06 2024-09-21T22:01:18.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979071+0000", 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.006972+0000", 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027900748 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007034+0000", 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2069999999999994e-05 2024-09-21T22:01:18.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007096+0000", 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1691000000000003e-05 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31675 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3248128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81858853899999995, 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028176435999999999, 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.808 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31675 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5299999999999999e-07 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979080+0000", 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.898e-06 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979086+0000", 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:01:18.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979091+0000", 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6720000000000003e-06 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007123+0000", 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028032267 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007183+0000", 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9979999999999998e-05 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007253+0000", 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0184000000000004e-05 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31676 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3448832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81856869899999996, 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028418516000000001, 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.812 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31676 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979106+0000", 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.969e-06 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979112+0000", 2024-09-21T22:01:18.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2210000000000002e-06 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979117+0000", 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6290000000000001e-06 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007349+0000", 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028232548 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007430+0000", 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0894000000000002e-05 2024-09-21T22:01:18.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007515+0000", 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4875000000000003e-05 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31677 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3289088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81854211099999996, 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028585294000000001, 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.816 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31677 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979124+0000", 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979125+0000", 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.756e-06 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979131+0000", 2024-09-21T22:01:18.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9839999999999998e-06 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979136+0000", 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007548+0000", 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0284119 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007628+0000", 2024-09-21T22:01:18.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9921999999999998e-05 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007709+0000", 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0840000000000005e-05 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31678 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3489792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81852366899999995, 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028748336999999999, 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.820 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31678 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:18.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979144+0000", 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.849e-06 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979150+0000", 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6710000000000004e-06 2024-09-21T22:01:18.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979154+0000", 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007740+0000", 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028585880000000001 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007810+0000", 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9883999999999997e-05 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007890+0000", 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0203000000000004e-05 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31679 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3330048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81850538900000003, 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028877613999999999, 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.824 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31679 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2300000000000002e-07 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979162+0000", 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9190000000000002e-06 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979168+0000", 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:01:18.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979173+0000", 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5600000000000004e-06 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007934+0000", 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028761627000000001 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007996+0000", 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1571999999999999e-05 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008038+0000", 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1718000000000003e-05 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31680 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3530752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81848688599999997, 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029001378000000001, 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.828 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31680 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979179+0000", 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000002e-07 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979181+0000", 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.787e-06 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979188+0000", 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1199999999999996e-06 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979193+0000", 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8919999999999999e-06 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008069+0000", 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028875872 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008115+0000", 2024-09-21T22:01:18.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6069999999999998e-05 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008180+0000", 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5290000000000007e-05 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31681 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3371008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81846690700000002, 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029168017000000001, 2024-09-21T22:01:18.832 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31681 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979199+0000", 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979205+0000", 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9970000000000004e-06 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979211+0000", 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4919999999999998e-06 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979216+0000", 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8749999999999999e-06 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008223+0000", 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029006451999999999 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008295+0000", 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2248000000000004e-05 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008366+0000", 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1581999999999993e-05 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31682 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81844295, 2024-09-21T22:01:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029288165000000001, 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31682 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979223+0000", 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979225+0000", 2024-09-21T22:01:18.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8980000000000001e-06 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979231+0000", 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.981e-06 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979236+0000", 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008404+0000", 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029168296 2024-09-21T22:01:18.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008453+0000", 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8729000000000001e-05 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008511+0000", 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8048999999999999e-05 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.840 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31683 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3411968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81842410099999996, 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029408805, 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31683 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979242+0000", 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979243+0000", 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.838e-06 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979249+0000", 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9259999999999997e-06 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979254+0000", 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7899999999999999e-06 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008535+0000", 2024-09-21T22:01:18.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029281042 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008592+0000", 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6369000000000002e-05 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008650+0000", 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8457e-05 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31684 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3612672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81838671100000004, 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029486117999999999, 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31684 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3200000000000005e-07 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979281+0000", 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0679999999999999e-06 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979288+0000", 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7510000000000002e-06 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979293+0000", 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008667+0000", 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029373574 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008702+0000", 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5827000000000001e-05 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008765+0000", 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2378999999999993e-05 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31685 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3452928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81836615099999999, 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029661091000000001, 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31685 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979300+0000", 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979301+0000", 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7910000000000001e-06 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979307+0000", 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9440000000000002e-06 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979312+0000", 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008813+0000", 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029500623 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008889+0000", 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6219999999999999e-05 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008960+0000", 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1378999999999995e-05 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31686 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3653632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.818347559, 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029843732000000001, 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31686 2024-09-21T22:01:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979326+0000", 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3889999999999999e-06 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979332+0000", 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4339999999999997e-06 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979337+0000", 2024-09-21T22:01:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009017+0000", 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029680213 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009093+0000", 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6039999999999997e-05 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009162+0000", 2024-09-21T22:01:18.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8554999999999997e-05 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31687 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3493888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81832208900000003, 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030002866, 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.857 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31687 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979344+0000", 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979346+0000", 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8670000000000001e-06 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979352+0000", 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0090000000000004e-06 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979356+0000", 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5719999999999996e-06 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009203+0000", 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029847041000000001 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009274+0000", 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0722000000000005e-05 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009346+0000", 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2266000000000002e-05 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31689 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3534848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81830363399999995, 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030169466999999998, 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.861 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31689 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979364+0000", 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7799999999999999e-06 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979370+0000", 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6999999999999996e-06 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979374+0000", 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7199999999999997e-06 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009378+0000", 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030003795999999999 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009453+0000", 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4801000000000004e-05 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009531+0000", 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8342000000000003e-05 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31690 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3575808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.865 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81828511199999998, 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030330343999999999, 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31690 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979381+0000", 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.15e-07 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979382+0000", 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.821e-06 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979388+0000", 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0229999999999998e-06 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979393+0000", 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5480000000000003e-06 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009561+0000", 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030168107999999999 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009633+0000", 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2402000000000002e-05 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009711+0000", 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7126999999999995e-05 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.869 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31692 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3616768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81826650999999995, 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030488531999999999, 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.870 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31692 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979401+0000", 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.767e-06 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979407+0000", 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9390000000000002e-06 2024-09-21T22:01:18.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979412+0000", 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009789+0000", 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030377662999999999 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009845+0000", 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5890000000000002e-05 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009887+0000", 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2231999999999998e-05 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31694 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3657728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.81824716099999995, 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030552935999999999, 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31694 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979419+0000", 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2799999999999996e-07 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979421+0000", 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.832e-06 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979426+0000", 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8930000000000002e-06 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979431+0000", 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7360000000000001e-06 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009906+0000", 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030474378 2024-09-21T22:01:18.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009940+0000", 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4183000000000001e-05 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009971+0000", 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1386000000000001e-05 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:32214 3.8 3:1692a8f0:::rbd_data.1124528f4459.0000000000000017:head [stat,delete] snapc 11=[11] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.80352693900000005, 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027931175999999999, 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 32214 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994139+0000", 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994144+0000", 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7319999999999998e-06 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994155+0000", 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1164e-05 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994163+0000", 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6190000000000002e-06 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.016856+0000", 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.022692985999999998 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.016924+0000", 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8299000000000005e-05 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.017307+0000", 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00038259200000000001 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.020069+0000", 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027618180000000001 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.021976+0000", 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019070580000000001 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.022030+0000", 2024-09-21T22:01:18.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4265000000000003e-05 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.022070+0000", 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9700000000000003e-05 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:18.884 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:18.886 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:18.886 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:18.884+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:18.986 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:18.986+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:18.988 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:18.989 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:18.989 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:18.989 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:18.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:19.088 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:19.086+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:19.141 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:19.141 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:19.150 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:19.194 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:19.193+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:19.254 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.040493889, 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.255 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:01:19.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:19.258 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:01:19.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15469 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0191329939999996, 2024-09-21T22:01:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015141767, 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15469 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233118+0000", 2024-09-21T22:01:19.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233126+0000", 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8720000000000002e-06 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233139+0000", 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3059e-05 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248059+0000", 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.014920022999999999 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248146+0000", 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7787000000000005e-05 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248257+0000", 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011013799999999999 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.264 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15470 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5963776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0191024320000004, 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015332264, 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.265 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15470 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233146+0000", 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233148+0000", 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1409999999999999e-06 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233155+0000", 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5329999999999997e-06 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233160+0000", 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3560000000000003e-06 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248307+0000", 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015147396 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248400+0000", 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2592999999999999e-05 2024-09-21T22:01:19.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248478+0000", 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7789999999999999e-05 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15471 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0190748569999997, 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015441796000000001, 2024-09-21T22:01:19.269 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15471 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233175+0000", 2024-09-21T22:01:19.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1459999999999999e-06 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233183+0000", 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4170000000000003e-06 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233188+0000", 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8459999999999999e-06 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248509+0000", 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015321461 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248556+0000", 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6417e-05 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248615+0000", 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9148999999999999e-05 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15736 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0138190060000003, 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01497829, 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15736 2024-09-21T22:01:19.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238431+0000", 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238437+0000", 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8300000000000001e-06 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238441+0000", 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4349999999999999e-06 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253306+0000", 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01486497 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253351+0000", 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4394000000000002e-05 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253407+0000", 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6218999999999998e-05 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15737 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0138005689999998, 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015163012999999999, 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.278 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15737 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.279 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238448+0000", 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238449+0000", 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.922e-06 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238456+0000", 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6649999999999997e-06 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238460+0000", 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3100000000000002e-06 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253442+0000", 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.014981563 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253520+0000", 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8242000000000001e-05 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253610+0000", 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9936000000000001e-05 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15738 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0137816940000004, 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015268319000000001, 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15738 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238467+0000", 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9599999999999999e-07 2024-09-21T22:01:19.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238468+0000", 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.832e-06 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238474+0000", 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1880000000000001e-06 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238478+0000", 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2529999999999998e-06 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253637+0000", 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015159540000000001 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253680+0000", 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2904000000000001e-05 2024-09-21T22:01:19.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253734+0000", 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4106e-05 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15739 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0137650200000001, 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015455638000000001, 2024-09-21T22:01:19.287 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15739 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1300000000000001e-07 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238485+0000", 2024-09-21T22:01:19.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.773e-06 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238490+0000", 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.558e-06 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238495+0000", 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3089999999999997e-06 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253769+0000", 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015274601 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253852+0000", 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3022000000000006e-05 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253938+0000", 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6062000000000004e-05 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.291 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15740 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3080192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0137477090000004, 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015561972, 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15740 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238501+0000", 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.89e-07 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238508+0000", 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3509999999999996e-06 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238514+0000", 2024-09-21T22:01:19.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238519+0000", 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6890000000000003e-06 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253965+0000", 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015445739999999999 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254008+0000", 2024-09-21T22:01:19.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3096000000000002e-05 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254062+0000", 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4153999999999997e-05 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15741 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3538944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0137225990000003, 2024-09-21T22:01:19.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015737879, 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15741 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:19.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238526+0000", 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238527+0000", 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.79e-06 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238533+0000", 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238543+0000", 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8430000000000005e-06 2024-09-21T22:01:19.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254096+0000", 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015553301 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254175+0000", 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8708999999999995e-05 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254263+0000", 2024-09-21T22:01:19.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7886000000000005e-05 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15742 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0136989400000003, 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015842728, 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.301 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15742 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238552+0000", 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3769999999999999e-06 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238557+0000", 2024-09-21T22:01:19.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7420000000000003e-06 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238562+0000", 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000003e-06 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254295+0000", 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015733080999999999 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254338+0000", 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2967999999999999e-05 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254392+0000", 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3956999999999999e-05 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15743 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:19.305 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0136803780000001, 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016024549999999999, 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15743 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238568+0000", 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238570+0000", 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238575+0000", 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6559999999999997e-06 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238580+0000", 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4309999999999996e-06 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254427+0000", 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015847070000000001 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254504+0000", 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7230000000000004e-05 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254592+0000", 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7902e-05 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.309 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15744 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 4653056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0136623719999998, 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016131405000000001, 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.310 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15744 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238586+0000", 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1100000000000002e-07 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238587+0000", 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238593+0000", 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9669999999999998e-06 2024-09-21T22:01:19.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238603+0000", 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4020000000000008e-06 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254619+0000", 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01601619 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254663+0000", 2024-09-21T22:01:19.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3532000000000003e-05 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254717+0000", 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4197000000000003e-05 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15745 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5111808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:19.314 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0136389599999998, 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016324899, 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15745 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238615+0000", 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0329999999999997e-06 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238621+0000", 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1680000000000001e-06 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238626+0000", 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7060000000000003e-06 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254751+0000", 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016125409 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254834+0000", 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2945e-05 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254934+0000", 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9259999999999995e-05 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15746 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0136155010000003, 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016492038000000001, 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15746 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.319 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238633+0000", 2024-09-21T22:01:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.53e-07 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238635+0000", 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0449999999999999e-06 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238646+0000", 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1357e-05 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238651+0000", 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1370000000000001e-06 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254971+0000", 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016319966000000002 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255050+0000", 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8827999999999998e-05 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255124+0000", 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4351999999999996e-05 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15747 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0135884690000001, 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016613851999999998, 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.323 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15747 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238660+0000", 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.82e-07 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238666+0000", 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5050000000000004e-06 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238673+0000", 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4060000000000002e-06 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238677+0000", 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5839999999999996e-06 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255157+0000", 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016480113000000001 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255213+0000", 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5251999999999999e-05 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255273+0000", 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0409999999999999e-05 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15748 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.013563961, 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016710974, 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15748 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7999999999999996e-07 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238686+0000", 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-06 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238692+0000", 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4330000000000003e-06 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238696+0000", 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2440000000000004e-06 2024-09-21T22:01:19.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255306+0000", 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016609749 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255346+0000", 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0052000000000002e-05 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255395+0000", 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8976e-05 2024-09-21T22:01:19.331 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15749 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6684672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0135462740000003, 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016816903000000001, 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.332 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15749 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238702+0000", 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6399999999999998e-07 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238704+0000", 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.046e-06 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238709+0000", 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:01:19.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238714+0000", 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3209999999999998e-06 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255419+0000", 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016704734999999998 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255466+0000", 2024-09-21T22:01:19.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7179999999999999e-05 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255518+0000", 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2676999999999997e-05 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15750 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0135282989999999, 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016896227999999999, 2024-09-21T22:01:19.336 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15750 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238720+0000", 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238722+0000", 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0059999999999999e-06 2024-09-21T22:01:19.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238728+0000", 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8150000000000002e-06 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238732+0000", 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255531+0000", 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016798678000000001 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255568+0000", 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7316e-05 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255616+0000", 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7515000000000002e-05 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.340 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15751 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0135099429999999, 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.017028596, 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15751 2024-09-21T22:01:19.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:19.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:01:19.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238740+0000", 2024-09-21T22:01:19.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9240000000000001e-06 2024-09-21T22:01:19.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238746+0000", 2024-09-21T22:01:19.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:01:19.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238750+0000", 2024-09-21T22:01:19.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2440000000000004e-06 2024-09-21T22:01:19.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255635+0000", 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016884356999999999 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255679+0000", 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3974000000000003e-05 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255766+0000", 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.389 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.390 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.390 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.390 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.390 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:19.391 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:19.392 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:19.390+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:19.492 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:19.490+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:19.536 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:19.536 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:19.545 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:19.592 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:19.591+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:19.647 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:19.647 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:19.647 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:19.647 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:19.647 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:19.655 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:19.696 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:19.695+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:19.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:19.792 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:01:19.793 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:19.791+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:19.804 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:19.804 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:19.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:19.804 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:19.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.804 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:01:19.804 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 15.749450844, 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29925 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 2961408~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.872810785, 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028025164000000002, 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.810 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29925 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928533+0000", 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-06 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928538+0000", 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1599999999999997e-06 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928543+0000", 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4410000000000003e-06 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956398+0000", 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027855386999999999 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956472+0000", 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3448000000000006e-05 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956553+0000", 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1730000000000005e-05 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29926 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3567616~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8727895829999999, 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028146526000000002, 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29926 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928550+0000", 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928552+0000", 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928558+0000", 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6690000000000003e-06 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928562+0000", 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2910000000000001e-06 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956591+0000", 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028029011999999999 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956646+0000", 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5016999999999999e-05 2024-09-21T22:01:19.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956696+0000", 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9920999999999999e-05 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29927 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3002368~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8727713540000002, 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028301160999999998, 2024-09-21T22:01:19.818 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29927 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928569+0000", 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.395e-06 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928573+0000", 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.225e-06 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928575+0000", 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956723+0000", 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028148237 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956768+0000", 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4749999999999997e-05 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956869+0000", 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010078599999999999 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29928 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3043328~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8727526540000001, 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028496923, 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29928 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928587+0000", 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4699999999999998e-07 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928588+0000", 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.313e-06 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928591+0000", 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1999999999999999e-06 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928598+0000", 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0890000000000002e-06 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956939+0000", 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028341261 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957006+0000", 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6704000000000004e-05 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957083+0000", 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7108999999999996e-05 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.826 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.87273635, 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.827 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:01:19.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:19.831 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8727263999999999, 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:01:19.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:01:19.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.835 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.872712997, 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:01:19.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:01:19.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.839 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8727033259999999, 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:19.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:01:19.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.843 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29937 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3248128~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8709256839999999, 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028121855000000001, 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.844 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29937 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930414+0000", 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930416+0000", 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-06 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930422+0000", 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:19.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930435+0000", 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2404e-05 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958382+0000", 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027947339000000002 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958450+0000", 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7611e-05 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958535+0000", 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5680999999999995e-05 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29939 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3289088~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.870870955, 2024-09-21T22:01:19.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028207189000000001, 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29939 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:19.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930471+0000", 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930476+0000", 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4410000000000001e-06 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930480+0000", 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.391e-06 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958565+0000", 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028084392999999999 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958617+0000", 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1706999999999998e-05 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958675+0000", 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8715999999999998e-05 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.852 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29941 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3330048~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.870833653, 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028386958, 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.853 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29941 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930506+0000", 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930508+0000", 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.782e-06 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930514+0000", 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930518+0000", 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0949999999999998e-06 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958712+0000", 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028194745 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958788+0000", 2024-09-21T22:01:19.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5556000000000006e-05 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958892+0000", 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000104304 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29943 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.870790317, 2024-09-21T22:01:19.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028512368999999999, 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29943 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-07 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930551+0000", 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:01:19.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930557+0000", 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6799999999999998e-06 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930561+0000", 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5399999999999997e-06 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958929+0000", 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028367277999999999 2024-09-21T22:01:19.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958988+0000", 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8928000000000002e-05 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959061+0000", 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3460000000000005e-05 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29945 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3411968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.861 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8707519179999998, 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028678985000000001, 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29945 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.862 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930588+0000", 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930589+0000", 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.939e-06 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930595+0000", 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8810000000000001e-06 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930600+0000", 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5539999999999999e-06 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959097+0000", 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028497248999999999 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959184+0000", 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7170999999999996e-05 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959266+0000", 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1769999999999998e-05 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.865 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8707074889999999, 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:01:19.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:01:19.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.869 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8706612329999999, 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:01:19.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:19.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8706238979999998, 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.874 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:01:19.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:01:19.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.878 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8705897170000001, 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.879 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.880 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:01:19.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.883 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.870549845, 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.884 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.886 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.887 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.8705045600000001, 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:19.888 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:01:19.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:19.891 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:19.892 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:19.892 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:01:19.892 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:01:19.892 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.892 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.892 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.892 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:19.892 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:19.892 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:19.893 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone15 from 0xd579fe2 (overlap 0x18490e5) to 0x0 2024-09-21T22:01:19.894 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:19.895 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:19.894+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:19.924 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:19.924 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:19.939 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-21T22:01:19.943 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:19.947 INFO:teuthology.orchestra.run.smithi102.stdout:1796 punch from 0x74ea763 to 0x74ed793, (0x3030 bytes) 2024-09-21T22:01:19.950 INFO:teuthology.orchestra.run.smithi102.stdout:1798 write 0x587fd54 thru 0x5886844 (0x6af1 bytes) 2024-09-21T22:01:19.967 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:19.967 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:19.984 INFO:teuthology.orchestra.run.smithi102.stdout:1800 trunc from 0xd579fe2 to 0xac4a6db 2024-09-21T22:01:19.987 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:19.987 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:19.996 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:19.994+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:20.008 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:20.008 INFO:teuthology.orchestra.run.smithi102.stdout:1804 write 0x2dfc498 thru 0x2dfccd4 (0x83d bytes) 2024-09-21T22:01:20.015 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:20.021 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:20.021 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:20.021 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:20.021 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:20.026 INFO:teuthology.orchestra.run.smithi102.stdout:1805 punch from 0x7b6dcc8 to 0x7b6ecd9, (0x1011 bytes) 2024-09-21T22:01:20.026 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:20.026 INFO:teuthology.orchestra.run.smithi102.stdout:1807 trunc from 0xac4a6db to 0xa0694f0 2024-09-21T22:01:20.030 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:20.033 INFO:teuthology.orchestra.run.smithi102.stdout:1808 read 0x7d5d569 thru 0x7d5f140 (0x1bd8 bytes) 2024-09-21T22:01:20.033 INFO:teuthology.orchestra.run.smithi102.stdout:1809 read 0x99d2072 thru 0x99dee7c (0xce0b bytes) 2024-09-21T22:01:20.034 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:20.034 INFO:teuthology.orchestra.run.smithi102.stdout:1810 write 0x400ab99 thru 0x40155ea (0xaa52 bytes) 2024-09-21T22:01:20.053 INFO:teuthology.orchestra.run.smithi102.stdout:1811 writesame 0x931d4f4 thru 0x931f32d data_size 0x35(0x1e3a bytes) 2024-09-21T22:01:20.054 INFO:teuthology.orchestra.run.smithi102.stdout:1812 read 0xbb905e thru 0xbbaba9 (0x1b4c bytes) 2024-09-21T22:01:20.055 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:20.056 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:20.056 INFO:teuthology.orchestra.run.smithi102.stdout:1814 read 0x52d5380 thru 0x52d87b8 (0x3439 bytes) 2024-09-21T22:01:20.060 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:20.060 INFO:teuthology.orchestra.run.smithi102.stdout:1816 read 0x14e9d17 thru 0x14edd49 (0x4033 bytes) 2024-09-21T22:01:20.067 INFO:teuthology.orchestra.run.smithi102.stdout:1817 trunc from 0xa0694f0 to 0x64aa277 2024-09-21T22:01:20.077 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:20.096 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:20.096+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:20.119 INFO:teuthology.orchestra.run.smithi102.stdout:1818 write 0x95537b0 thru 0x9555981 (0x21d2 bytes) 2024-09-21T22:01:20.122 INFO:teuthology.orchestra.run.smithi102.stdout:1819 write 0x26ee935 thru 0x26fcce7 (0xe3b3 bytes) 2024-09-21T22:01:20.124 INFO:teuthology.orchestra.run.smithi102.stdout:1820 read 0x197b516 thru 0x1980e6a (0x5955 bytes) 2024-09-21T22:01:20.124 INFO:teuthology.orchestra.run.smithi102.stdout:1821 read 0x6f51f79 thru 0x6f5837f (0x6407 bytes) 2024-09-21T22:01:20.124 INFO:teuthology.orchestra.run.smithi102.stdout:1822 writesame 0xf58c0b thru 0xf67d4a data_size 0x50(0xf140 bytes) 2024-09-21T22:01:20.126 INFO:teuthology.orchestra.run.smithi102.stdout:1823 write 0x6757da4 thru 0x67671e9 (0xf446 bytes) 2024-09-21T22:01:20.128 INFO:teuthology.orchestra.run.smithi102.stdout:1824 read 0x714ac5 thru 0x71dd40 (0x927c bytes) 2024-09-21T22:01:20.129 INFO:teuthology.orchestra.run.smithi102.stdout:1825 write 0x124034a thru 0x1242ea5 (0x2b5c bytes) 2024-09-21T22:01:20.130 INFO:teuthology.orchestra.run.smithi102.stdout:1826 read 0x39dd95f thru 0x39ec1cd (0xe86f bytes) 2024-09-21T22:01:20.130 INFO:teuthology.orchestra.run.smithi102.stdout:1827 punch from 0x24f0f68 to 0x24f3120, (0x21b8 bytes) 2024-09-21T22:01:20.133 INFO:teuthology.orchestra.run.smithi102.stdout:1828 trunc from 0x9555982 to 0xb913931 2024-09-21T22:01:20.138 INFO:teuthology.orchestra.run.smithi102.stdout:1829 punch from 0x69a4097 to 0x69aeb66, (0xaacf bytes) 2024-09-21T22:01:20.138 INFO:teuthology.orchestra.run.smithi102.stdout:1831 write 0x41f8e33 thru 0x420014a (0x7318 bytes) 2024-09-21T22:01:20.139 INFO:teuthology.orchestra.run.smithi102.stdout:1833 write 0x1270a7a thru 0x1270bfe (0x185 bytes) 2024-09-21T22:01:20.141 INFO:teuthology.orchestra.run.smithi102.stdout:1835 write 0x324321b thru 0x324e2ae (0xb094 bytes) 2024-09-21T22:01:20.142 INFO:teuthology.orchestra.run.smithi102.stdout:1836 read 0x823a4b5 thru 0x823d460 (0x2fac bytes) 2024-09-21T22:01:20.151 INFO:teuthology.orchestra.run.smithi102.stdout:1838 writesame 0xeaed677 thru 0xeaf2e06 data_size 0x4(0x5790 bytes) 2024-09-21T22:01:20.151 INFO:teuthology.orchestra.run.smithi102.stdout:1839 write 0x35a55ed thru 0x35b369d (0xe0b1 bytes) 2024-09-21T22:01:20.153 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:20.154 INFO:teuthology.orchestra.run.smithi102.stdout:1847 read 0xcc3a5f7 thru 0xcc3f195 (0x4b9f bytes) 2024-09-21T22:01:20.154 INFO:teuthology.orchestra.run.smithi102.stdout:1848 read 0x5a51ed thru 0x5ac62e (0x7442 bytes) 2024-09-21T22:01:20.155 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:20.155 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:20.156 INFO:teuthology.orchestra.run.smithi102.stdout:1849 punch from 0x2d00738 to 0x2d03897, (0x315f bytes) 2024-09-21T22:01:20.156 INFO:teuthology.orchestra.run.smithi102.stdout:1850 punch from 0x3c9a3a9 to 0x3ca7af8, (0xd74f bytes) 2024-09-21T22:01:20.164 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:20.169 INFO:teuthology.orchestra.run.smithi102.stdout:1851 trunc from 0xeaf2e07 to 0x2c5ccb6 2024-09-21T22:01:20.181 INFO:teuthology.orchestra.run.smithi102.stdout:1853 read 0xf978a6 thru 0xf98fdf (0x173a bytes) 2024-09-21T22:01:20.186 INFO:teuthology.orchestra.run.smithi102.stdout:1854 write 0x310c3dc thru 0x31198a3 (0xd4c8 bytes) 2024-09-21T22:01:20.188 INFO:teuthology.orchestra.run.smithi102.stdout:1855 writesame 0x280cf94 thru 0x280d972 data_size 0x7(0x9df bytes) 2024-09-21T22:01:20.189 INFO:teuthology.orchestra.run.smithi102.stdout:1856 writesame 0xc116da thru 0xc16934 data_size 0x1(0x525b bytes) 2024-09-21T22:01:20.197 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:20.196+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:20.199 INFO:teuthology.orchestra.run.smithi102.stdout:1858 write 0x1023115 thru 0x102e9e7 (0xb8d3 bytes) 2024-09-21T22:01:20.217 INFO:teuthology.orchestra.run.smithi102.stdout:1859 writesame 0xc671236 thru 0xc6780df data_size 0x5(0x6eaa bytes) 2024-09-21T22:01:20.217 INFO:teuthology.orchestra.run.smithi102.stdout:1860 writesame 0x55d02e2 thru 0x55d32e7 data_size 0x9(0x3006 bytes) 2024-09-21T22:01:20.219 INFO:teuthology.orchestra.run.smithi102.stdout:1861 writesame 0xb3aeac8 thru 0xb3b8bad data_size 0xf(0xa0e6 bytes) 2024-09-21T22:01:20.223 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:20.223 INFO:teuthology.orchestra.run.smithi102.stdout:1864 write 0x8d04c5d thru 0x8d0eb53 (0x9ef7 bytes) 2024-09-21T22:01:20.226 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:20.227 INFO:teuthology.orchestra.run.smithi102.stdout:1866 write 0x704cae3 thru 0x7054cc6 (0x81e4 bytes) 2024-09-21T22:01:20.228 INFO:teuthology.orchestra.run.smithi102.stdout:1867 writesame 0x4a87bb thru 0x4aec45 data_size 0x1(0x648b bytes) 2024-09-21T22:01:20.242 INFO:teuthology.orchestra.run.smithi102.stdout:1868 trunc from 0xc6780e0 to 0xa74143a 2024-09-21T22:01:20.254 INFO:teuthology.orchestra.run.smithi102.stdout:1870 write 0xb680616 thru 0xb68493b (0x4326 bytes) 2024-09-21T22:01:20.257 INFO:teuthology.orchestra.run.smithi102.stdout:1871 punch from 0xb67817c to 0xb6802e0, (0x8164 bytes) 2024-09-21T22:01:20.263 INFO:teuthology.orchestra.run.smithi102.stdout:1872 writesame 0xc60f7c9 thru 0xc61926b data_size 0x1(0x9aa3 bytes) 2024-09-21T22:01:20.264 INFO:teuthology.orchestra.run.smithi102.stdout:1874 read 0xa9d41e9 thru 0xa9e1fc1 (0xddd9 bytes) 2024-09-21T22:01:20.265 INFO:teuthology.orchestra.run.smithi102.stdout:1875 punch from 0x1891cf8 to 0x1892c93, (0xf9b bytes) 2024-09-21T22:01:20.265 INFO:teuthology.orchestra.run.smithi102.stdout:1876 read 0x7595583 thru 0x759cd7f (0x77fd bytes) 2024-09-21T22:01:20.265 INFO:teuthology.orchestra.run.smithi102.stdout:1877 read 0xa682477 thru 0xa684d25 (0x28af bytes) 2024-09-21T22:01:20.266 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:20.266 INFO:teuthology.orchestra.run.smithi102.stdout:1882 punch from 0x6423b to 0x7043b, (0xc200 bytes) 2024-09-21T22:01:20.266 INFO:teuthology.orchestra.run.smithi102.stdout:1884 write 0xbbd7f9a thru 0xbbe1b16 (0x9b7d bytes) 2024-09-21T22:01:20.268 INFO:teuthology.orchestra.run.smithi102.stdout:1885 write 0x72cf4c4 thru 0x72d585c (0x6399 bytes) 2024-09-21T22:01:20.274 INFO:teuthology.orchestra.run.smithi102.stdout:1886 read 0x25c4e46 thru 0x25c672d (0x18e8 bytes) 2024-09-21T22:01:20.274 INFO:teuthology.orchestra.run.smithi102.stdout:1888 clone 17 order 24 su 524288 sc 5 2024-09-21T22:01:20.298 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:20.298+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:20.312 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:20.312 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:20.321 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:20.405 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:20.404+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:20.464 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:20.464 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:20.472 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:20.500 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:20.499+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:20.601 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:20.600+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:20.615 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:20.616 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:20.624 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:20.702 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:20.701+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:20.768 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:20.768 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:20.777 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:20.803 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:20.802+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:20.881 INFO:teuthology.orchestra.run.smithi102.stdout:flattening image image_client.0-clone16 2024-09-21T22:01:20.900 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:20.900 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:20.905 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:20.904+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:20.911 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:21.005 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:21.005+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:21.018 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-21T22:01:21.025 INFO:teuthology.orchestra.run.smithi102.stdout:1889 write 0x278f7fd thru 0x279a470 (0xac74 bytes) 2024-09-21T22:01:21.051 INFO:teuthology.orchestra.run.smithi102.stdout:1890 read 0x5762ee3 thru 0x5769cd2 (0x6df0 bytes) 2024-09-21T22:01:21.053 INFO:teuthology.orchestra.run.smithi102.stdout:1892 read 0x829cfc6 thru 0x82acc59 (0xfc94 bytes) 2024-09-21T22:01:21.059 INFO:teuthology.orchestra.run.smithi102.stdout:1893 read 0x99e7951 thru 0x99ee14f (0x67ff bytes) 2024-09-21T22:01:21.072 INFO:teuthology.orchestra.run.smithi102.stdout:1895 trunc from 0xc61926c to 0xe7ec989 2024-09-21T22:01:21.077 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:21.077 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:21.086 INFO:teuthology.orchestra.run.smithi102.stdout:1896 trunc from 0xe7ec989 to 0x9e3b33b 2024-09-21T22:01:21.090 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:21.106 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:21.105+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:21.107 INFO:teuthology.orchestra.run.smithi102.stdout:1897 write 0xae147f5 thru 0xae14a03 (0x20f bytes) 2024-09-21T22:01:21.118 INFO:teuthology.orchestra.run.smithi102.stdout:1898 writesame 0xda180ed thru 0xda2109d data_size 0x7(0x8fb1 bytes) 2024-09-21T22:01:21.118 INFO:teuthology.orchestra.run.smithi102.stdout:1901 read 0x95ec06f thru 0x95ee477 (0x2409 bytes) 2024-09-21T22:01:21.119 INFO:teuthology.orchestra.run.smithi102.stdout:1902 read 0xc59925d thru 0xc59df65 (0x4d09 bytes) 2024-09-21T22:01:21.119 INFO:teuthology.orchestra.run.smithi102.stdout:1903 read 0xbf3d3c1 thru 0xbf46a5d (0x969d bytes) 2024-09-21T22:01:21.119 INFO:teuthology.orchestra.run.smithi102.stdout:1905 read 0xa9f5db1 thru 0xa9f5eac (0xfc bytes) 2024-09-21T22:01:21.127 INFO:teuthology.orchestra.run.smithi102.stdout:1907 trunc from 0xda2109e to 0x5f9e960 2024-09-21T22:01:21.149 INFO:teuthology.orchestra.run.smithi102.stdout:1908 writesame 0x593c683 thru 0x594499f data_size 0x31(0x831d bytes) 2024-09-21T22:01:21.158 INFO:teuthology.orchestra.run.smithi102.stdout:1910 writesame 0x7d844bb thru 0x7d8cb2f data_size 0x1(0x8675 bytes) 2024-09-21T22:01:21.159 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.159 INFO:teuthology.orchestra.run.smithi102.stdout:1912 read 0x25c0e06 thru 0x25c9cba (0x8eb5 bytes) 2024-09-21T22:01:21.161 INFO:teuthology.orchestra.run.smithi102.stdout:1914 write 0x28da5c2 thru 0x28ea32d (0xfd6c bytes) 2024-09-21T22:01:21.204 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.207 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:21.206+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:21.207 INFO:teuthology.orchestra.run.smithi102.stdout:1918 trunc from 0x7d8cb30 to 0x5c90a61 2024-09-21T22:01:21.209 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:21.210 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:21.220 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:21.226 INFO:teuthology.orchestra.run.smithi102.stdout:1919 write 0xb41fafe thru 0xb424869 (0x4d6c bytes) 2024-09-21T22:01:21.229 INFO:teuthology.orchestra.run.smithi102.stdout:1920 write 0x29f4ce4 thru 0x29f9a29 (0x4d46 bytes) 2024-09-21T22:01:21.256 INFO:teuthology.orchestra.run.smithi102.stdout:1921 read 0x7f2f847 thru 0x7f3315b (0x3915 bytes) 2024-09-21T22:01:21.257 INFO:teuthology.orchestra.run.smithi102.stdout:1922 write 0x9d5956c thru 0x9d65f27 (0xc9bc bytes) 2024-09-21T22:01:21.258 INFO:teuthology.orchestra.run.smithi102.stdout:1923 write 0x25719ac thru 0x2571f37 (0x58c bytes) 2024-09-21T22:01:21.260 INFO:teuthology.orchestra.run.smithi102.stdout:1924 punch from 0x80044 to 0x89ad5, (0x9a91 bytes) 2024-09-21T22:01:21.260 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.260 INFO:teuthology.orchestra.run.smithi102.stdout:1928 trunc from 0xb42486a to 0xac79639 2024-09-21T22:01:21.266 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.266 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.266 INFO:teuthology.orchestra.run.smithi102.stdout:1931 writesame 0x7250768 thru 0x725216f data_size 0x8(0x1a08 bytes) 2024-09-21T22:01:21.268 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.268 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.268 INFO:teuthology.orchestra.run.smithi102.stdout:1935 punch from 0x7ab429f to 0x7abf1ee, (0xaf4f bytes) 2024-09-21T22:01:21.268 INFO:teuthology.orchestra.run.smithi102.stdout:1936 write 0x5711774 thru 0x57201ae (0xea3b bytes) 2024-09-21T22:01:21.270 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.270 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.270 INFO:teuthology.orchestra.run.smithi102.stdout:1940 write 0x432b38e thru 0x4339798 (0xe40b bytes) 2024-09-21T22:01:21.271 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.273 INFO:teuthology.orchestra.run.smithi102.stdout:1944 trunc from 0xac79639 to 0x99e2136 2024-09-21T22:01:21.283 INFO:teuthology.orchestra.run.smithi102.stdout:1946 read 0x9488596 thru 0x948dd51 (0x57bc bytes) 2024-09-21T22:01:21.293 INFO:teuthology.orchestra.run.smithi102.stdout:1947 writesame 0xcfd3aa5 thru 0xcfd4261 data_size 0x1(0x7bd bytes) 2024-09-21T22:01:21.299 INFO:teuthology.orchestra.run.smithi102.stdout:1948 trunc from 0xcfd4262 to 0x8894228 2024-09-21T22:01:21.306 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.306 INFO:teuthology.orchestra.run.smithi102.stdout:1951 read 0x85ce791 thru 0x85dcbbc (0xe42c bytes) 2024-09-21T22:01:21.307 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:21.306+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:21.307 INFO:teuthology.orchestra.run.smithi102.stdout:1952 flatten 2024-09-21T22:01:21.339 INFO:teuthology.orchestra.run.smithi102.stdout:1953 punch from 0x314dad6 to 0x315d2af, (0xf7d9 bytes) 2024-09-21T22:01:21.347 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:21.347 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:21.348 INFO:teuthology.orchestra.run.smithi102.stdout:1955 writesame 0xb2786c4 thru 0xb284367 data_size 0x2(0xbca4 bytes) 2024-09-21T22:01:21.348 INFO:teuthology.orchestra.run.smithi102.stdout:1956 punch from 0xafc595d to 0xafd299c, (0xd03f bytes) 2024-09-21T22:01:21.348 INFO:teuthology.orchestra.run.smithi102.stdout:1957 punch from 0x5b5b3ef to 0x5b60140, (0x4d51 bytes) 2024-09-21T22:01:21.348 INFO:teuthology.orchestra.run.smithi102.stdout:1958 read 0x670ded3 thru 0x6711ea3 (0x3fd1 bytes) 2024-09-21T22:01:21.348 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.349 INFO:teuthology.orchestra.run.smithi102.stdout:1960 read 0x769072e thru 0x769bed1 (0xb7a4 bytes) 2024-09-21T22:01:21.351 INFO:teuthology.orchestra.run.smithi102.stdout:1961 trunc from 0xb284368 to 0x93bfe0d 2024-09-21T22:01:21.358 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:21.361 INFO:teuthology.orchestra.run.smithi102.stdout:1962 write 0x590724b thru 0x590b732 (0x44e8 bytes) 2024-09-21T22:01:21.363 INFO:teuthology.orchestra.run.smithi102.stdout:1963 write 0x3c04166 thru 0x3c0497a (0x815 bytes) 2024-09-21T22:01:21.363 INFO:teuthology.orchestra.run.smithi102.stdout:1964 read 0x4b15644 thru 0x4b246af (0xf06c bytes) 2024-09-21T22:01:21.364 INFO:teuthology.orchestra.run.smithi102.stdout:1965 read 0x325ce67 thru 0x3268dce (0xbf68 bytes) 2024-09-21T22:01:21.364 INFO:teuthology.orchestra.run.smithi102.stdout:1966 punch from 0x398e28a to 0x399d9ac, (0xf722 bytes) 2024-09-21T22:01:21.364 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.364 INFO:teuthology.orchestra.run.smithi102.stdout:1968 punch from 0x781f3f2 to 0x782a372, (0xaf80 bytes) 2024-09-21T22:01:21.364 INFO:teuthology.orchestra.run.smithi102.stdout:1969 write 0x850ce thru 0x90069 (0xaf9c bytes) 2024-09-21T22:01:21.366 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.366 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.367 INFO:teuthology.orchestra.run.smithi102.stdout:1974 trunc from 0x93bfe0d to 0xa7d7952 2024-09-21T22:01:21.373 INFO:teuthology.orchestra.run.smithi102.stdout:1975 write 0x597d2ca thru 0x5988c2f (0xb966 bytes) 2024-09-21T22:01:21.377 INFO:teuthology.orchestra.run.smithi102.stdout:1976 write 0x76326ac thru 0x763624a (0x3b9f bytes) 2024-09-21T22:01:21.379 INFO:teuthology.orchestra.run.smithi102.stdout:1977 read 0x7aea9a6 thru 0x7afa892 (0xfeed bytes) 2024-09-21T22:01:21.391 INFO:teuthology.orchestra.run.smithi102.stdout:1978 trunc from 0xa7d7952 to 0x5accf0 2024-09-21T22:01:21.407 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:21.407+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:21.424 INFO:teuthology.orchestra.run.smithi102.stdout:1979 write 0xd525589 thru 0xd528ac0 (0x3538 bytes) 2024-09-21T22:01:21.427 INFO:teuthology.orchestra.run.smithi102.stdout:1980 read 0x39c04c0 thru 0x39c65f9 (0x613a bytes) 2024-09-21T22:01:21.428 INFO:teuthology.orchestra.run.smithi102.stdout:1982 read 0x8aa702e thru 0x8aaa529 (0x34fc bytes) 2024-09-21T22:01:21.428 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.428 INFO:teuthology.orchestra.run.smithi102.stdout:1984 punch from 0x9a7981c to 0x9a7ec02, (0x53e6 bytes) 2024-09-21T22:01:21.434 INFO:teuthology.orchestra.run.smithi102.stdout:1985 writesame 0xdc5689c thru 0xdc63f8d data_size 0x1b(0xd6f2 bytes) 2024-09-21T22:01:21.434 INFO:teuthology.orchestra.run.smithi102.stdout:1986 write 0x653e0e5 thru 0x6544985 (0x68a1 bytes) 2024-09-21T22:01:21.437 INFO:teuthology.orchestra.run.smithi102.stdout:1987 read 0xaecfcbd thru 0xaed7b73 (0x7eb7 bytes) 2024-09-21T22:01:21.437 INFO:teuthology.orchestra.run.smithi102.stdout:1988 writesame 0xbf94a2c thru 0xbf9c07f data_size 0x2(0x7654 bytes) 2024-09-21T22:01:21.447 INFO:teuthology.orchestra.run.smithi102.stdout:1989 write 0xd9221 thru 0xdcecf (0x3caf bytes) 2024-09-21T22:01:21.448 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.448 INFO:teuthology.orchestra.run.smithi102.stdout:1992 read 0xb752edb thru 0xb756c40 (0x3d66 bytes) 2024-09-21T22:01:21.449 INFO:teuthology.orchestra.run.smithi102.stdout:1993 read 0xa529b2d thru 0xa52bdb9 (0x228d bytes) 2024-09-21T22:01:21.449 INFO:teuthology.orchestra.run.smithi102.stdout:1996 write 0xb820840 thru 0xb8283ed (0x7bae bytes) 2024-09-21T22:01:21.450 INFO:teuthology.orchestra.run.smithi102.stdout:1998 read 0xa951e73 thru 0xa95d04c (0xb1da bytes) 2024-09-21T22:01:21.451 INFO:teuthology.orchestra.run.smithi102.stdout:1999 writesame 0xd29e3f6 thru 0xd2abbf8 data_size 0x1(0xd803 bytes) 2024-09-21T22:01:21.474 INFO:teuthology.orchestra.run.smithi102.stdout:2002 read 0x7c7d530 thru 0x7c82b58 (0x5629 bytes) 2024-09-21T22:01:21.474 INFO:teuthology.orchestra.run.smithi102.stdout:2003 read 0x36b1e32 thru 0x36b5195 (0x3364 bytes) 2024-09-21T22:01:21.474 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.475 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:21.475 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:21.486 INFO:teuthology.orchestra.run.smithi102.stdout:2006 trunc from 0xdc63f8e to 0x356a791 2024-09-21T22:01:21.489 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:21.497 INFO:teuthology.orchestra.run.smithi102.stdout:2007 write 0x3533feb thru 0x353cb88 (0x8b9e bytes) 2024-09-21T22:01:21.499 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.499 INFO:teuthology.orchestra.run.smithi102.stdout:2009 punch from 0x2ca1787 to 0x2ca2b56, (0x13cf bytes) 2024-09-21T22:01:21.499 INFO:teuthology.orchestra.run.smithi102.stdout:2010 write 0x5e2b82 thru 0x5ea639 (0x7ab8 bytes) 2024-09-21T22:01:21.500 INFO:teuthology.orchestra.run.smithi102.stdout:2012 write 0x7ffe67 thru 0x8082e5 (0x847f bytes) 2024-09-21T22:01:21.501 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.502 INFO:teuthology.orchestra.run.smithi102.stdout:2014 read 0x2849777 thru 0x2854ddf (0xb669 bytes) 2024-09-21T22:01:21.502 INFO:teuthology.orchestra.run.smithi102.stdout:2015 writesame 0x1915e1a thru 0x19215e3 data_size 0x19(0xb7ca bytes) 2024-09-21T22:01:21.504 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.504 INFO:teuthology.orchestra.run.smithi102.stdout:2017 write 0x1fb50a9 thru 0x1fb5f73 (0xecb bytes) 2024-09-21T22:01:21.505 INFO:teuthology.orchestra.run.smithi102.stdout:2018 read 0x1652303 thru 0x165f1c6 (0xcec4 bytes) 2024-09-21T22:01:21.505 INFO:teuthology.orchestra.run.smithi102.stdout:2019 read 0x26c7955 thru 0x26cbaa9 (0x4155 bytes) 2024-09-21T22:01:21.507 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:21.506+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:21.522 INFO:teuthology.orchestra.run.smithi102.stdout:2020 write 0xbd765fb thru 0xbd8501d (0xea23 bytes) 2024-09-21T22:01:21.537 INFO:teuthology.orchestra.run.smithi102.stdout:2022 trunc from 0xbd8501e to 0x2b8cd4b 2024-09-21T22:01:21.550 INFO:teuthology.orchestra.run.smithi102.stdout:2023 read 0x23ca71 thru 0x240f45 (0x44d5 bytes) 2024-09-21T22:01:21.551 INFO:teuthology.orchestra.run.smithi102.stdout:2024 write 0xf4de9e thru 0xf5d9c4 (0xfb27 bytes) 2024-09-21T22:01:21.552 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.561 INFO:teuthology.orchestra.run.smithi102.stdout:2027 write 0x622b945 thru 0x622e856 (0x2f12 bytes) 2024-09-21T22:01:21.563 INFO:teuthology.orchestra.run.smithi102.stdout:2029 write 0x5507d32 thru 0x550fe9a (0x8169 bytes) 2024-09-21T22:01:21.566 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.575 INFO:teuthology.orchestra.run.smithi102.stdout:2032 trunc from 0x622e857 to 0xd14a3ff 2024-09-21T22:01:21.581 INFO:teuthology.orchestra.run.smithi102.stdout:2033 read 0xa419e39 thru 0xa426e5a (0xd022 bytes) 2024-09-21T22:01:21.581 INFO:teuthology.orchestra.run.smithi102.stdout:2034 write 0x89e3598 thru 0x89e422a (0xc93 bytes) 2024-09-21T22:01:21.583 INFO:teuthology.orchestra.run.smithi102.stdout:2035 read 0x4e10b60 thru 0x4e1198d (0xe2e bytes) 2024-09-21T22:01:21.583 INFO:teuthology.orchestra.run.smithi102.stdout:2037 read 0x78a66f0 thru 0x78aca9f (0x63b0 bytes) 2024-09-21T22:01:21.583 INFO:teuthology.orchestra.run.smithi102.stdout:2038 punch from 0x8de300a to 0x8df0946, (0xd93c bytes) 2024-09-21T22:01:21.583 INFO:teuthology.orchestra.run.smithi102.stdout:2039 read 0xccc74a7 thru 0xcccbcc2 (0x481c bytes) 2024-09-21T22:01:21.584 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.584 INFO:teuthology.orchestra.run.smithi102.stdout:2042 write 0x51aa236 thru 0x51b78e1 (0xd6ac bytes) 2024-09-21T22:01:21.588 INFO:teuthology.orchestra.run.smithi102.stdout:2043 read 0xb8fb7fb thru 0xb901a99 (0x629f bytes) 2024-09-21T22:01:21.588 INFO:teuthology.orchestra.run.smithi102.stdout:2047 read 0x8be4c35 thru 0x8bf1566 (0xc932 bytes) 2024-09-21T22:01:21.588 INFO:teuthology.orchestra.run.smithi102.stdout:2049 write 0xc01cb36 thru 0xc025f4b (0x9416 bytes) 2024-09-21T22:01:21.600 INFO:teuthology.orchestra.run.smithi102.stdout:2050 trunc from 0xd14a3ff to 0x6aadb8e 2024-09-21T22:01:21.608 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:21.607+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:21.611 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:21.612 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:21.613 INFO:teuthology.orchestra.run.smithi102.stdout:2051 trunc from 0x6aadb8e to 0x5e7a067 2024-09-21T22:01:21.619 INFO:teuthology.orchestra.run.smithi102.stdout:2052 read 0x5ace6bc thru 0x5ad3f56 (0x589b bytes) 2024-09-21T22:01:21.622 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:21.631 INFO:teuthology.orchestra.run.smithi102.stdout:2053 writesame 0xa24c5a9 thru 0xa25a31b data_size 0x3(0xdd73 bytes) 2024-09-21T22:01:21.638 INFO:teuthology.orchestra.run.smithi102.stdout:2056 writesame 0xbb5eda5 thru 0xbb675c5 data_size 0x1(0x8821 bytes) 2024-09-21T22:01:21.638 INFO:teuthology.orchestra.run.smithi102.stdout:2057 read 0x11a149 thru 0x12418e (0xa046 bytes) 2024-09-21T22:01:21.638 INFO:teuthology.orchestra.run.smithi102.stdout:2058 read 0x5e12f7 thru 0x5ea907 (0x9611 bytes) 2024-09-21T22:01:21.639 INFO:teuthology.orchestra.run.smithi102.stdout:2059 read 0x6a8303e thru 0x6a8a4fb (0x74be bytes) 2024-09-21T22:01:21.650 INFO:teuthology.orchestra.run.smithi102.stdout:2060 trunc from 0xbb675c6 to 0x37b800d 2024-09-21T22:01:21.661 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.676 INFO:teuthology.orchestra.run.smithi102.stdout:2063 write 0xab47c51 thru 0xab4e8ce (0x6c7e bytes) 2024-09-21T22:01:21.679 INFO:teuthology.orchestra.run.smithi102.stdout:2064 write 0x1e4c9ee thru 0x1e58f77 (0xc58a bytes) 2024-09-21T22:01:21.680 INFO:teuthology.orchestra.run.smithi102.stdout:2065 write 0xa53d906 thru 0xa543bb4 (0x62af bytes) 2024-09-21T22:01:21.683 INFO:teuthology.orchestra.run.smithi102.stdout:2067 read 0x57abde4 thru 0x57ad5a8 (0x17c5 bytes) 2024-09-21T22:01:21.693 INFO:teuthology.orchestra.run.smithi102.stdout:2068 trunc from 0xab4e8cf to 0x210aa71 2024-09-21T22:01:21.705 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:21.705 INFO:teuthology.orchestra.run.smithi102.stdout:2070 punch from 0x11b3022 to 0x11b7060, (0x403e bytes) 2024-09-21T22:01:21.708 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:21.707+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:21.711 INFO:teuthology.orchestra.run.smithi102.stdout:2071 writesame 0x31dae19 thru 0x31e84a3 data_size 0x1(0xd68b bytes) 2024-09-21T22:01:21.712 INFO:teuthology.orchestra.run.smithi102.stdout:2072 read 0xbdd453 thru 0xbe3c5e (0x680c bytes) 2024-09-21T22:01:21.712 INFO:teuthology.orchestra.run.smithi102.stdout:2073 clone 18 order 25 su 4194304 sc 10 2024-09-21T22:01:21.748 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:21.749 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:21.757 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:21.841 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:21.840+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:21.894 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:01:21.897 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-21T22:01:21.910 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:21.909+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:21.912 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:21.912 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:21.925 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:22.011 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:22.010+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:22.093 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:22.094 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:22.094 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:22.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:22.145 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:22.144+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:22.154 INFO:teuthology.orchestra.run.smithi102.stdout:2074 writesame 0xe0beb30 thru 0xe0ce100 data_size 0x1(0xf5d1 bytes) 2024-09-21T22:01:22.158 INFO:teuthology.orchestra.run.smithi102.stdout:2076 flatten 2024-09-21T22:01:22.183 INFO:teuthology.orchestra.run.smithi102.stdout:2079 punch from 0xbd38d1b to 0xbd3da41, (0x4d26 bytes) 2024-09-21T22:01:22.183 INFO:teuthology.orchestra.run.smithi102.stdout:2080 read 0x45fd500 thru 0x460ad8c (0xd88d bytes) 2024-09-21T22:01:22.183 INFO:teuthology.orchestra.run.smithi102.stdout:2081 writesame 0x4ecd4f thru 0x4f0f91 data_size 0x1(0x4243 bytes) 2024-09-21T22:01:22.192 INFO:teuthology.orchestra.run.smithi102.stdout:2082 write 0x4a47bc thru 0x4b21f2 (0xda37 bytes) 2024-09-21T22:01:22.193 INFO:teuthology.orchestra.run.smithi102.stdout:2083 read 0xbdc751e thru 0xbdd5e06 (0xe8e9 bytes) 2024-09-21T22:01:22.194 INFO:teuthology.orchestra.run.smithi102.stdout:2084 punch from 0xd8d33ca to 0xd8db54b, (0x8181 bytes) 2024-09-21T22:01:22.194 INFO:teuthology.orchestra.run.smithi102.stdout:2085 write 0xc1624c0 thru 0xc168fd5 (0x6b16 bytes) 2024-09-21T22:01:22.197 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.197 INFO:teuthology.orchestra.run.smithi102.stdout:2087 writesame 0xdbfc320 thru 0xdc02c6f data_size 0x28(0x6950 bytes) 2024-09-21T22:01:22.202 INFO:teuthology.orchestra.run.smithi102.stdout:2088 punch from 0xac6604c to 0xac6f278, (0x922c bytes) 2024-09-21T22:01:22.203 INFO:teuthology.orchestra.run.smithi102.stdout:2089 read 0x76addd9 thru 0x76bc643 (0xe86b bytes) 2024-09-21T22:01:22.203 INFO:teuthology.orchestra.run.smithi102.stdout:2090 read 0x8516680 thru 0x8524edf (0xe860 bytes) 2024-09-21T22:01:22.203 INFO:teuthology.orchestra.run.smithi102.stdout:2091 trunc from 0xe0ce101 to 0xe08e7ad 2024-09-21T22:01:22.210 INFO:teuthology.orchestra.run.smithi102.stdout:2092 write 0x390526d thru 0x3910011 (0xada5 bytes) 2024-09-21T22:01:22.212 INFO:teuthology.orchestra.run.smithi102.stdout:2093 read 0xab4ab8e thru 0xab4d5e7 (0x2a5a bytes) 2024-09-21T22:01:22.213 INFO:teuthology.orchestra.run.smithi102.stdout:2094 read 0x36de38a thru 0x36de6fd (0x374 bytes) 2024-09-21T22:01:22.213 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:22.212+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:22.213 INFO:teuthology.orchestra.run.smithi102.stdout:2095 read 0x2a27891 thru 0x2a2c803 (0x4f73 bytes) 2024-09-21T22:01:22.213 INFO:teuthology.orchestra.run.smithi102.stdout:2096 write 0x6e3ece thru 0x6efea1 (0xbfd4 bytes) 2024-09-21T22:01:22.215 INFO:teuthology.orchestra.run.smithi102.stdout:2097 write 0x8d97d21 thru 0x8d9e876 (0x6b56 bytes) 2024-09-21T22:01:22.222 INFO:teuthology.orchestra.run.smithi102.stdout:2098 trunc from 0xe08e7ad to 0x9b816c0 2024-09-21T22:01:22.232 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:22.232 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:22.241 INFO:teuthology.orchestra.run.smithi102.stdout:2099 write 0xd3e3863 thru 0xd3e6cd0 (0x346e bytes) 2024-09-21T22:01:22.242 INFO:teuthology.orchestra.run.smithi102.stdout:2100 punch from 0xc38f4b1 to 0xc39141b, (0x1f6a bytes) 2024-09-21T22:01:22.242 INFO:teuthology.orchestra.run.smithi102.stdout:2101 writesame 0xb87e470 thru 0xb880d62 data_size 0x1(0x28f3 bytes) 2024-09-21T22:01:22.251 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:22.252 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:22.255 INFO:teuthology.orchestra.run.smithi102.stdout:2103 write 0xe2bfc0b thru 0xe2c8bc7 (0x8fbd bytes) 2024-09-21T22:01:22.257 INFO:teuthology.orchestra.run.smithi102.stdout:2106 read 0x503059b thru 0x503c781 (0xc1e7 bytes) 2024-09-21T22:01:22.257 INFO:teuthology.orchestra.run.smithi102.stdout:2108 write 0x711ac93 thru 0x711c2e4 (0x1652 bytes) 2024-09-21T22:01:22.259 INFO:teuthology.orchestra.run.smithi102.stdout:2110 write 0xa53b504 thru 0xa541b9e (0x669b bytes) 2024-09-21T22:01:22.260 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.260 INFO:teuthology.orchestra.run.smithi102.stdout:2113 read 0x1b8311a thru 0x1b8d6df (0xa5c6 bytes) 2024-09-21T22:01:22.261 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.261 INFO:teuthology.orchestra.run.smithi102.stdout:2115 punch from 0xd849734 to 0xd85699b, (0xd267 bytes) 2024-09-21T22:01:22.261 INFO:teuthology.orchestra.run.smithi102.stdout:2116 punch from 0x8cb8393 to 0x8cbcc8d, (0x48fa bytes) 2024-09-21T22:01:22.261 INFO:teuthology.orchestra.run.smithi102.stdout:2119 writesame 0xb30cc0d thru 0xb30e768 data_size 0x11(0x1b5c bytes) 2024-09-21T22:01:22.262 INFO:teuthology.orchestra.run.smithi102.stdout:2122 writesame 0xc6a1cee thru 0xc6aa179 data_size 0x22(0x848c bytes) 2024-09-21T22:01:22.265 INFO:teuthology.orchestra.run.smithi102.stdout:2123 writesame 0xc7e0fc6 thru 0xc7e18af data_size 0x7(0x8ea bytes) 2024-09-21T22:01:22.266 INFO:teuthology.orchestra.run.smithi102.stdout:2124 read 0x1b8aed0 thru 0x1b9051b (0x564c bytes) 2024-09-21T22:01:22.267 INFO:teuthology.orchestra.run.smithi102.stdout:2127 read 0xdbda1c8 thru 0xdbda73d (0x576 bytes) 2024-09-21T22:01:22.267 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.267 INFO:teuthology.orchestra.run.smithi102.stdout:2129 write 0x6f6016c thru 0x6f69bf5 (0x9a8a bytes) 2024-09-21T22:01:22.269 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:22.269 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:22.269 INFO:teuthology.orchestra.run.smithi102.stdout:2130 write 0x5da002 thru 0x5e74dc (0xd4db bytes) 2024-09-21T22:01:22.270 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:22.270 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:22.271 INFO:teuthology.orchestra.run.smithi102.stdout:2131 writesame 0x9429621 thru 0x9434478 data_size 0x1c(0xae58 bytes) 2024-09-21T22:01:22.273 INFO:teuthology.orchestra.run.smithi102.stdout:2132 writesame 0x1321478 thru 0x13282b6 data_size 0xd(0x6e3f bytes) 2024-09-21T22:01:22.275 INFO:teuthology.orchestra.run.smithi102.stdout:2133 punch from 0x241b7d2 to 0x2422a8b, (0x72b9 bytes) 2024-09-21T22:01:22.279 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:22.289 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:22.289 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:22.291 INFO:teuthology.orchestra.run.smithi102.stdout:2134 trunc from 0xe2c8bc8 to 0x131acaa 2024-09-21T22:01:22.307 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:22.308 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:22.308 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.308 INFO:teuthology.orchestra.run.smithi102.stdout:2136 read 0x1a2474 thru 0x1a2f30 (0xabd bytes) 2024-09-21T22:01:22.313 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:22.312+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:22.318 INFO:teuthology.orchestra.run.smithi102.stdout:2137 writesame 0x4c75d0a thru 0x4c76fc5 data_size 0x4(0x12bc bytes) 2024-09-21T22:01:22.318 INFO:teuthology.orchestra.run.smithi102.stdout:2139 read 0x411000b thru 0x411a628 (0xa61e bytes) 2024-09-21T22:01:22.326 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:22.326 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:22.330 INFO:teuthology.orchestra.run.smithi102.stdout:2141 writesame 0x9cfe15f thru 0x9d03511 data_size 0x1(0x53b3 bytes) 2024-09-21T22:01:22.330 INFO:teuthology.orchestra.run.smithi102.stdout:2142 read 0x6256a4e thru 0x62582bf (0x1872 bytes) 2024-09-21T22:01:22.335 INFO:teuthology.orchestra.run.smithi102.stdout:2143 trunc from 0x9d03512 to 0x5f2e57f 2024-09-21T22:01:22.344 INFO:teuthology.orchestra.run.smithi102.stdout:2144 trunc from 0x5f2e57f to 0x7b872fb 2024-09-21T22:01:22.345 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:22.345 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:22.349 INFO:teuthology.orchestra.run.smithi102.stdout:2146 write 0x25941b0 thru 0x259715c (0x2fad bytes) 2024-09-21T22:01:22.352 INFO:teuthology.orchestra.run.smithi102.stdout:2147 punch from 0x5a1644b to 0x5a23070, (0xcc25 bytes) 2024-09-21T22:01:22.352 INFO:teuthology.orchestra.run.smithi102.stdout:2149 write 0xe5bd26 thru 0xe63c32 (0x7f0d bytes) 2024-09-21T22:01:22.353 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.353 INFO:teuthology.orchestra.run.smithi102.stdout:2152 read 0x4fcd0d8 thru 0x4fd5b14 (0x8a3d bytes) 2024-09-21T22:01:22.354 INFO:teuthology.orchestra.run.smithi102.stdout:2153 writesame 0x25b3695 thru 0x25bb02f data_size 0x9(0x799b bytes) 2024-09-21T22:01:22.362 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:22.362 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:22.368 INFO:teuthology.orchestra.run.smithi102.stdout:2154 writesame 0xd73e222 thru 0xd74ded7 data_size 0x7(0xfcb6 bytes) 2024-09-21T22:01:22.369 INFO:teuthology.orchestra.run.smithi102.stdout:2156 read 0xda1a44 thru 0xdb0489 (0xea46 bytes) 2024-09-21T22:01:22.370 INFO:teuthology.orchestra.run.smithi102.stdout:2157 write 0xbe735a9 thru 0xbe7df94 (0xa9ec bytes) 2024-09-21T22:01:22.373 INFO:teuthology.orchestra.run.smithi102.stdout:2158 write 0x1134aab thru 0x1136bb8 (0x210e bytes) 2024-09-21T22:01:22.375 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.375 INFO:teuthology.orchestra.run.smithi102.stdout:2160 punch from 0x54743e1 to 0x547c006, (0x7c25 bytes) 2024-09-21T22:01:22.375 INFO:teuthology.orchestra.run.smithi102.stdout:2163 writesame 0xc31f900 thru 0xc32bcab data_size 0xe(0xc3ac bytes) 2024-09-21T22:01:22.379 INFO:teuthology.orchestra.run.smithi102.stdout:2164 punch from 0x2674647 to 0x267e2b1, (0x9c6a bytes) 2024-09-21T22:01:22.384 INFO:teuthology.orchestra.run.smithi102.stdout:2165 writesame 0xdcacec5 thru 0xdcb01e3 data_size 0x1(0x331f bytes) 2024-09-21T22:01:22.384 INFO:teuthology.orchestra.run.smithi102.stdout:2166 writesame 0x65d37e7 thru 0x65d558d data_size 0x1(0x1da7 bytes) 2024-09-21T22:01:22.389 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.389 INFO:teuthology.orchestra.run.smithi102.stdout:2168 write 0x93fe09 thru 0x944313 (0x450b bytes) 2024-09-21T22:01:22.391 INFO:teuthology.orchestra.run.smithi102.stdout:2169 writesame 0x6c98a93 thru 0x6c9f0aa data_size 0xc(0x6618 bytes) 2024-09-21T22:01:22.393 INFO:teuthology.orchestra.run.smithi102.stdout:2171 punch from 0xab76da3 to 0xab857f6, (0xea53 bytes) 2024-09-21T22:01:22.401 INFO:teuthology.orchestra.run.smithi102.stdout:2172 trunc from 0xdcb01e4 to 0x740b82f 2024-09-21T22:01:22.405 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:22.405 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:22.407 INFO:teuthology.orchestra.run.smithi102.stdout:2173 write 0x2d22156 thru 0x2d2c41e (0xa2c9 bytes) 2024-09-21T22:01:22.409 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.409 INFO:teuthology.orchestra.run.smithi102.stdout:2176 read 0xfc3fcd thru 0xfca72b (0x675f bytes) 2024-09-21T22:01:22.409 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.409 INFO:teuthology.orchestra.run.smithi102.stdout:2178 write 0x1c7b9c0 thru 0x1c8abca (0xf20b bytes) 2024-09-21T22:01:22.410 INFO:teuthology.orchestra.run.smithi102.stdout:2179 writesame 0x21585e0 thru 0x21677a3 data_size 0x2(0xf1c4 bytes) 2024-09-21T22:01:22.414 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:22.413+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:22.414 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:22.425 INFO:teuthology.orchestra.run.smithi102.stdout:2180 read 0x31a019b thru 0x31a2f4c (0x2db2 bytes) 2024-09-21T22:01:22.425 INFO:teuthology.orchestra.run.smithi102.stdout:2181 writesame 0x2a627b2 thru 0x2a71d49 data_size 0x74(0xf598 bytes) 2024-09-21T22:01:22.428 INFO:teuthology.orchestra.run.smithi102.stdout:2182 trunc from 0x740b82f to 0x62439ee 2024-09-21T22:01:22.434 INFO:teuthology.orchestra.run.smithi102.stdout:2183 read 0x24aa6a2 thru 0x24b3a7c (0x93db bytes) 2024-09-21T22:01:22.434 INFO:teuthology.orchestra.run.smithi102.stdout:2184 write 0x237273e thru 0x2372ef3 (0x7b6 bytes) 2024-09-21T22:01:22.452 INFO:teuthology.orchestra.run.smithi102.stdout:2185 writesame 0xee30ffa thru 0xee33777 data_size 0xf(0x277e bytes) 2024-09-21T22:01:22.468 INFO:teuthology.orchestra.run.smithi102.stdout:2187 trunc from 0xee33778 to 0x26b498f 2024-09-21T22:01:22.475 INFO:teuthology.orchestra.run.smithi102.stdout:2188 read 0xe72e66 thru 0xe78fb5 (0x6150 bytes) 2024-09-21T22:01:22.487 INFO:teuthology.orchestra.run.smithi102.stdout:2189 trunc from 0x26b498f to 0xc4bf2ff 2024-09-21T22:01:22.492 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.492 INFO:teuthology.orchestra.run.smithi102.stdout:2191 write 0x152dcdd thru 0x152f4db (0x17ff bytes) 2024-09-21T22:01:22.507 INFO:teuthology.orchestra.run.smithi102.stdout:2192 trunc from 0xc4bf2ff to 0x751fb4 2024-09-21T22:01:22.514 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:22.513+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:22.530 INFO:teuthology.orchestra.run.smithi102.stdout:2193 read 0x650bb2 thru 0x65785f (0x6cae bytes) 2024-09-21T22:01:22.543 INFO:teuthology.orchestra.run.smithi102.stdout:2194 writesame 0x66b5b36 thru 0x66c5990 data_size 0xf(0xfe5b bytes) 2024-09-21T22:01:22.543 INFO:teuthology.orchestra.run.smithi102.stdout:2195 punch from 0x2f6f31c to 0x2f75c99, (0x697d bytes) 2024-09-21T22:01:22.545 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31366 3.8 3:12d1962e:::rbd_header.1124528f4459:head [watch reconnect cookie 140678969648192 gen 7] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5772299250000001, 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030645964000000001, 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31366 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966206+0000", 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4499999999999997e-07 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966208+0000", 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966214+0000", 2024-09-21T22:01:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966219+0000", 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6929999999999998e-06 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.990079+0000", 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023859706000000001 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.990148+0000", 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9617999999999997e-05 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.996851+0000", 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067029969999999996 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31674 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3407872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.564376867, 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028037220000000002, 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31674 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979059+0000", 2024-09-21T22:01:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979061+0000", 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.95e-06 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979066+0000", 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.711e-06 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979071+0000", 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.006972+0000", 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027900748 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007034+0000", 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2069999999999994e-05 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007096+0000", 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1691000000000003e-05 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31675 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3248128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5643584879999999, 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028176435999999999, 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31675 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5299999999999999e-07 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979080+0000", 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.898e-06 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979086+0000", 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979091+0000", 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6720000000000003e-06 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007123+0000", 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028032267 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007183+0000", 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9979999999999998e-05 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007253+0000", 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0184000000000004e-05 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31676 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3448832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5643386479999997, 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028418516000000001, 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31676 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979106+0000", 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.969e-06 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979112+0000", 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2210000000000002e-06 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979117+0000", 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6290000000000001e-06 2024-09-21T22:01:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007349+0000", 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028232548 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007430+0000", 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0894000000000002e-05 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007515+0000", 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4875000000000003e-05 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31677 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3289088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5643120599999998, 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028585294000000001, 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31677 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979124+0000", 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979125+0000", 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.756e-06 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979131+0000", 2024-09-21T22:01:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9839999999999998e-06 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979136+0000", 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007548+0000", 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0284119 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007628+0000", 2024-09-21T22:01:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9921999999999998e-05 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007709+0000", 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0840000000000005e-05 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31678 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3489792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5642936179999998, 2024-09-21T22:01:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028748336999999999, 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31678 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979144+0000", 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.849e-06 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979150+0000", 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6710000000000004e-06 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979154+0000", 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007740+0000", 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028585880000000001 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007810+0000", 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9883999999999997e-05 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007890+0000", 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0203000000000004e-05 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31679 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3330048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5642753379999998, 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028877613999999999, 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31679 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2300000000000002e-07 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979162+0000", 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9190000000000002e-06 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979168+0000", 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979173+0000", 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5600000000000004e-06 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007934+0000", 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028761627000000001 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007996+0000", 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1571999999999999e-05 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008038+0000", 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1718000000000003e-05 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31680 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3530752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5642568350000001, 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029001378000000001, 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31680 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979179+0000", 2024-09-21T22:01:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000002e-07 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979181+0000", 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.787e-06 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979188+0000", 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1199999999999996e-06 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979193+0000", 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8919999999999999e-06 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008069+0000", 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028875872 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008115+0000", 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6069999999999998e-05 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008180+0000", 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5290000000000007e-05 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31681 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3371008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.564236856, 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029168017000000001, 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31681 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979199+0000", 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979205+0000", 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9970000000000004e-06 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979211+0000", 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4919999999999998e-06 2024-09-21T22:01:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979216+0000", 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8749999999999999e-06 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008223+0000", 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029006451999999999 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008295+0000", 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2248000000000004e-05 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008366+0000", 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1581999999999993e-05 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31682 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5642128990000002, 2024-09-21T22:01:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029288165000000001, 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31682 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979223+0000", 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979225+0000", 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8980000000000001e-06 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979231+0000", 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.981e-06 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979236+0000", 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008404+0000", 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029168296 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008453+0000", 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8729000000000001e-05 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008511+0000", 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8048999999999999e-05 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31683 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3411968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5641940500000002, 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029408805, 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31683 2024-09-21T22:01:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979242+0000", 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979243+0000", 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.838e-06 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979249+0000", 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9259999999999997e-06 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979254+0000", 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7899999999999999e-06 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008535+0000", 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029281042 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008592+0000", 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6369000000000002e-05 2024-09-21T22:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008650+0000", 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8457e-05 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31684 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3612672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5641566600000001, 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029486117999999999, 2024-09-21T22:01:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31684 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3200000000000005e-07 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979281+0000", 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0679999999999999e-06 2024-09-21T22:01:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979288+0000", 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7510000000000002e-06 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979293+0000", 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008667+0000", 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029373574 2024-09-21T22:01:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008702+0000", 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5827000000000001e-05 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008765+0000", 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2378999999999993e-05 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31685 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3452928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5641360999999998, 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029661091000000001, 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31685 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979300+0000", 2024-09-21T22:01:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979301+0000", 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7910000000000001e-06 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979307+0000", 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9440000000000002e-06 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979312+0000", 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008813+0000", 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029500623 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008889+0000", 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6219999999999999e-05 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008960+0000", 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1378999999999995e-05 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31686 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3653632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5641175079999998, 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029843732000000001, 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31686 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979326+0000", 2024-09-21T22:01:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3889999999999999e-06 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979332+0000", 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4339999999999997e-06 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979337+0000", 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009017+0000", 2024-09-21T22:01:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029680213 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009093+0000", 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6039999999999997e-05 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009162+0000", 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8554999999999997e-05 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31687 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3493888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5640920380000001, 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030002866, 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31687 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979344+0000", 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:01:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979346+0000", 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8670000000000001e-06 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979352+0000", 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0090000000000004e-06 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979356+0000", 2024-09-21T22:01:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5719999999999996e-06 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009203+0000", 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029847041000000001 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009274+0000", 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0722000000000005e-05 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009346+0000", 2024-09-21T22:01:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2266000000000002e-05 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31689 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3534848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5640735829999999, 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030169466999999998, 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31689 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979364+0000", 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7799999999999999e-06 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979370+0000", 2024-09-21T22:01:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6999999999999996e-06 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979374+0000", 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7199999999999997e-06 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009378+0000", 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030003795999999999 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009453+0000", 2024-09-21T22:01:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4801000000000004e-05 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009531+0000", 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8342000000000003e-05 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31690 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3575808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5640550610000004, 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030330343999999999, 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31690 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979381+0000", 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.15e-07 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979382+0000", 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.821e-06 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979388+0000", 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0229999999999998e-06 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979393+0000", 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5480000000000003e-06 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009561+0000", 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030168107999999999 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009633+0000", 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2402000000000002e-05 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009711+0000", 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7126999999999995e-05 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31692 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3616768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5640364590000004, 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030488531999999999, 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31692 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979401+0000", 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.767e-06 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979407+0000", 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9390000000000002e-06 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979412+0000", 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009789+0000", 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030377662999999999 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009845+0000", 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5890000000000002e-05 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009887+0000", 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2231999999999998e-05 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31694 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3657728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.56401711, 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030552935999999999, 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31694 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979419+0000", 2024-09-21T22:01:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2799999999999996e-07 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979421+0000", 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.832e-06 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979426+0000", 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8930000000000002e-06 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979431+0000", 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7360000000000001e-06 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009906+0000", 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030474378 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009940+0000", 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4183000000000001e-05 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009971+0000", 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1386000000000001e-05 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:32214 3.8 3:1692a8f0:::rbd_data.1124528f4459.0000000000000017:head [stat,delete] snapc 11=[11] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5492968879999998, 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027931175999999999, 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 32214 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994139+0000", 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994144+0000", 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7319999999999998e-06 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994155+0000", 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1164e-05 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994163+0000", 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6190000000000002e-06 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.016856+0000", 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.022692985999999998 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.016924+0000", 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8299000000000005e-05 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.017307+0000", 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00038259200000000001 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.020069+0000", 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027618180000000001 2024-09-21T22:01:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.021976+0000", 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019070580000000001 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.022030+0000", 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4265000000000003e-05 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.022070+0000", 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9700000000000003e-05 2024-09-21T22:01:22.634 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.635 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.635 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.635 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:22.635 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:22.635 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:22.635 INFO:teuthology.orchestra.run.smithi102.stdout:2196 write 0xbf19bf9 thru 0xbf26c70 (0xd078 bytes) 2024-09-21T22:01:22.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:22.637 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:22.637 INFO:teuthology.orchestra.run.smithi102.stdout:2201 trunc from 0xbf26c71 to 0x8501b7b 2024-09-21T22:01:22.637 INFO:teuthology.orchestra.run.smithi102.stdout:2202 write 0x5d25dd7 thru 0x5d3316a (0xd394 bytes) 2024-09-21T22:01:22.638 INFO:teuthology.orchestra.run.smithi102.stdout:2204 trunc from 0x8501b7b to 0x2ad6868 2024-09-21T22:01:22.638 INFO:teuthology.orchestra.run.smithi102.stdout:2205 read 0x28955f thru 0x292ac4 (0x9566 bytes) 2024-09-21T22:01:22.638 INFO:teuthology.orchestra.run.smithi102.stdout:2206 read 0x1123592 thru 0x112c59b (0x900a bytes) 2024-09-21T22:01:22.638 INFO:teuthology.orchestra.run.smithi102.stdout:2207 clone 19 order 24 su 2097152 sc 15 2024-09-21T22:01:22.638 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:22.635+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:22.736 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:22.735+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:22.740 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:22.740 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:22.740 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:22.740 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:22.749 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:22.800 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:01:22.837 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:22.836+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:22.897 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-21T22:01:22.900 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:22.900 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:22.900 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:22.900 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:22.900 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:22.909 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:22.954 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:22.953+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:22.979 INFO:teuthology.orchestra.run.smithi102.stdout:2209 writesame 0x77a7a2d thru 0x77a81f4 data_size 0xc(0x7c8 bytes) 2024-09-21T22:01:22.983 INFO:teuthology.orchestra.run.smithi102.stdout:2210 read 0x63ff4b4 thru 0x640c8bd (0xd40a bytes) 2024-09-21T22:01:22.983 INFO:teuthology.orchestra.run.smithi102.stdout:2211 punch from 0x31f3481 to 0x320304a, (0xfbc9 bytes) 2024-09-21T22:01:22.983 INFO:teuthology.orchestra.run.smithi102.stdout:2213 punch from 0x2405a2b to 0x240e434, (0x8a09 bytes) 2024-09-21T22:01:22.994 INFO:teuthology.orchestra.run.smithi102.stdout:2214 writesame 0xc2e7e49 thru 0xc2f19fe data_size 0x13(0x9bb6 bytes) 2024-09-21T22:01:22.997 INFO:teuthology.orchestra.run.smithi102.stdout:2215 read 0x37d190f thru 0x37dc216 (0xa908 bytes) 2024-09-21T22:01:22.998 INFO:teuthology.orchestra.run.smithi102.stdout:2216 writesame 0x1c3c802 thru 0x1c4806d data_size 0x3a(0xb86c bytes) 2024-09-21T22:01:22.999 INFO:teuthology.orchestra.run.smithi102.stdout:2217 read 0x475f405 thru 0x4763c64 (0x4860 bytes) 2024-09-21T22:01:22.999 INFO:teuthology.orchestra.run.smithi102.stdout:2218 write 0x9465c5a thru 0x946f831 (0x9bd8 bytes) 2024-09-21T22:01:23.001 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:23.001 INFO:teuthology.orchestra.run.smithi102.stdout:2220 read 0x9a48aed thru 0x9a4dd9f (0x52b3 bytes) 2024-09-21T22:01:23.001 INFO:teuthology.orchestra.run.smithi102.stdout:2221 write 0x4b1d930 thru 0x4b1ece6 (0x13b7 bytes) 2024-09-21T22:01:23.002 INFO:teuthology.orchestra.run.smithi102.stdout:2222 writesame 0x82345c2 thru 0x823c9d1 data_size 0x8(0x8410 bytes) 2024-09-21T22:01:23.006 INFO:teuthology.orchestra.run.smithi102.stdout:2223 write 0xbd24895 thru 0xbd28ad1 (0x423d bytes) 2024-09-21T22:01:23.010 INFO:teuthology.orchestra.run.smithi102.stdout:2224 write 0x80bcbee thru 0x80cac42 (0xe055 bytes) 2024-09-21T22:01:23.012 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:23.012 INFO:teuthology.orchestra.run.smithi102.stdout:2227 punch from 0x7975fe5 to 0x798378d, (0xd7a8 bytes) 2024-09-21T22:01:23.018 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:23.018 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:23.018 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.804627164999999, 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:01:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:01:23.020 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:01:23.021 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.022 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:01:23.023 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15469 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7832662700000004, 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015141767, 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.024 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15469 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.025 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233118+0000", 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233126+0000", 2024-09-21T22:01:23.026 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8720000000000002e-06 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233139+0000", 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3059e-05 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248059+0000", 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.014920022999999999 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248146+0000", 2024-09-21T22:01:23.027 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7787000000000005e-05 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248257+0000", 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011013799999999999 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15470 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5963776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7832357080000003, 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015332264, 2024-09-21T22:01:23.028 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15470 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:23.029 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233146+0000", 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.030 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233148+0000", 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1409999999999999e-06 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233155+0000", 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5329999999999997e-06 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233160+0000", 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3560000000000003e-06 2024-09-21T22:01:23.031 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248307+0000", 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015147396 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248400+0000", 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2592999999999999e-05 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248478+0000", 2024-09-21T22:01:23.032 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7789999999999999e-05 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15471 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7832081330000005, 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015441796000000001, 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.033 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15471 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.034 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233175+0000", 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1459999999999999e-06 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233183+0000", 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4170000000000003e-06 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233188+0000", 2024-09-21T22:01:23.035 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8459999999999999e-06 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248509+0000", 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015321461 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248556+0000", 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6417e-05 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248615+0000", 2024-09-21T22:01:23.036 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9148999999999999e-05 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15736 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7779522820000002, 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01497829, 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.037 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15736 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.038 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238431+0000", 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238437+0000", 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8300000000000001e-06 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.039 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238441+0000", 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4349999999999999e-06 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253306+0000", 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01486497 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253351+0000", 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4394000000000002e-05 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.040 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253407+0000", 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6218999999999998e-05 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15737 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7779338449999997, 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015163012999999999, 2024-09-21T22:01:23.041 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15737 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.042 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238448+0000", 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238449+0000", 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.922e-06 2024-09-21T22:01:23.043 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238456+0000", 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6649999999999997e-06 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238460+0000", 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3100000000000002e-06 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253442+0000", 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.014981563 2024-09-21T22:01:23.044 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253520+0000", 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8242000000000001e-05 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253610+0000", 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9936000000000001e-05 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.045 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15738 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7779149700000003, 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015268319000000001, 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15738 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.046 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238467+0000", 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9599999999999999e-07 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.047 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238468+0000", 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.832e-06 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238474+0000", 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1880000000000001e-06 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238478+0000", 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2529999999999998e-06 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.048 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253637+0000", 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015159540000000001 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253680+0000", 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2904000000000001e-05 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253734+0000", 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4106e-05 2024-09-21T22:01:23.049 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15739 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.777898296, 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015455638000000001, 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.050 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15739 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.051 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1300000000000001e-07 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238485+0000", 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.773e-06 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238490+0000", 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.558e-06 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.052 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238495+0000", 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3089999999999997e-06 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253769+0000", 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015274601 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253852+0000", 2024-09-21T22:01:23.053 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3022000000000006e-05 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253938+0000", 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6062000000000004e-05 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15740 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3080192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7778809850000004, 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015561972, 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15740 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.055 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238501+0000", 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.89e-07 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.056 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238508+0000", 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3509999999999996e-06 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238514+0000", 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238519+0000", 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6890000000000003e-06 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.057 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253965+0000", 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015445739999999999 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254008+0000", 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3096000000000002e-05 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254062+0000", 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4153999999999997e-05 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15741 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3538944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7778558750000002, 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015737879, 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.059 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15741 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:23.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238526+0000", 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238527+0000", 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.79e-06 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.061 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238533+0000", 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238543+0000", 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8430000000000005e-06 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254096+0000", 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015553301 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.062 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254175+0000", 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8708999999999995e-05 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254263+0000", 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7886000000000005e-05 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15742 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:23.063 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7778322160000002, 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015842728, 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15742 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.064 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238552+0000", 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3769999999999999e-06 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238557+0000", 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7420000000000003e-06 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238562+0000", 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000003e-06 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.066 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254295+0000", 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015733080999999999 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254338+0000", 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2967999999999999e-05 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254392+0000", 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3956999999999999e-05 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.067 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15743 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.777813654, 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016024549999999999, 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15743 2024-09-21T22:01:23.068 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238568+0000", 2024-09-21T22:01:23.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238570+0000", 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238575+0000", 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6559999999999997e-06 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238580+0000", 2024-09-21T22:01:23.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4309999999999996e-06 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254427+0000", 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015847070000000001 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254504+0000", 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7230000000000004e-05 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254592+0000", 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7902e-05 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15744 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 4653056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7777956479999997, 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016131405000000001, 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.072 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15744 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238586+0000", 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1100000000000002e-07 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238587+0000", 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238593+0000", 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9669999999999998e-06 2024-09-21T22:01:23.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238603+0000", 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4020000000000008e-06 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254619+0000", 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01601619 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254663+0000", 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3532000000000003e-05 2024-09-21T22:01:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254717+0000", 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4197000000000003e-05 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15745 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5111808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7777722359999997, 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016324899, 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.076 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15745 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238615+0000", 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0329999999999997e-06 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238621+0000", 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1680000000000001e-06 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238626+0000", 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7060000000000003e-06 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254751+0000", 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016125409 2024-09-21T22:01:23.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254834+0000", 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2945e-05 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254934+0000", 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9259999999999995e-05 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15746 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7777487770000002, 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016492038000000001, 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15746 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.081 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238633+0000", 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.53e-07 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238635+0000", 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0449999999999999e-06 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238646+0000", 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1357e-05 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238651+0000", 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1370000000000001e-06 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254971+0000", 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016319966000000002 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255050+0000", 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8827999999999998e-05 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255124+0000", 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4351999999999996e-05 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15747 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.777721745, 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016613851999999998, 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.085 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15747 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238660+0000", 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.82e-07 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238666+0000", 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5050000000000004e-06 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238673+0000", 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4060000000000002e-06 2024-09-21T22:01:23.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238677+0000", 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5839999999999996e-06 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255157+0000", 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016480113000000001 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255213+0000", 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5251999999999999e-05 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255273+0000", 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0409999999999999e-05 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15748 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:23.089 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7776972369999999, 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016710974, 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15748 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:23.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7999999999999996e-07 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238686+0000", 2024-09-21T22:01:23.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-06 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238692+0000", 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4330000000000003e-06 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238696+0000", 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2440000000000004e-06 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255306+0000", 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016609749 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255346+0000", 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0052000000000002e-05 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255395+0000", 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8976e-05 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.093 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15749 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6684672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7776795500000002, 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016816903000000001, 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.094 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15749 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238702+0000", 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6399999999999998e-07 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238704+0000", 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.046e-06 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238709+0000", 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:01:23.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238714+0000", 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3209999999999998e-06 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255419+0000", 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016704734999999998 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255466+0000", 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7179999999999999e-05 2024-09-21T22:01:23.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255518+0000", 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2676999999999997e-05 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15750 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7776615749999998, 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016896227999999999, 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.098 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15750 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238720+0000", 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238722+0000", 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0059999999999999e-06 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238728+0000", 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8150000000000002e-06 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238732+0000", 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255531+0000", 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016798678000000001 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255568+0000", 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7316e-05 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255616+0000", 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7515000000000002e-05 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.102 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15751 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7776432189999998, 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.017028596, 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15751 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238740+0000", 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9240000000000001e-06 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238746+0000", 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238750+0000", 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2440000000000004e-06 2024-09-21T22:01:23.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255635+0000", 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016884356999999999 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255679+0000", 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3974000000000003e-05 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255766+0000", 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:01:23.106 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.107 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.107 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.107 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.107 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.107 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:23.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:23.109 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:23.107+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:23.110 INFO:teuthology.orchestra.run.smithi102.stdout:2228 trunc from 0xc2f19ff to 0x14c6b25 2024-09-21T22:01:23.110 INFO:teuthology.orchestra.run.smithi102.stdout:2230 punch from 0xc67ea6 to 0xc6c80c, (0x4966 bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2231 read 0x1270a78 thru 0x1275ee8 (0x5471 bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2232 read 0xf218bc thru 0xf3117a (0xf8bf bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2233 writesame 0x4af5001 thru 0x4af6d83 data_size 0x1(0x1d83 bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2236 trunc from 0x4af6d84 to 0xb1e626e 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2237 write 0x637b378 thru 0x6381f6c (0x6bf5 bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2240 punch from 0xa49dfa7 to 0xa49fc7f, (0x1cd8 bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2241 write 0x3d4741e thru 0x3d4f201 (0x7de4 bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2244 writesame 0xdb25ff9 thru 0xdb35d34 data_size 0x26(0xfd3c bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2245 punch from 0x3241812 to 0x32438f8, (0x20e6 bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2246 write 0x6f00f7b thru 0x6f0e255 (0xd2db bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2247 write 0x2917b89 thru 0x29180bb (0x533 bytes) 2024-09-21T22:01:23.111 INFO:teuthology.orchestra.run.smithi102.stdout:2249 read 0x7346d34 thru 0x7350955 (0x9c22 bytes) 2024-09-21T22:01:23.112 INFO:teuthology.orchestra.run.smithi102.stdout:2254 write 0x857bd37 thru 0x857fe97 (0x4161 bytes) 2024-09-21T22:01:23.112 INFO:teuthology.orchestra.run.smithi102.stdout:2255 write 0xce7075b thru 0xce75b91 (0x5437 bytes) 2024-09-21T22:01:23.112 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:23.112 INFO:teuthology.orchestra.run.smithi102.stdout:2258 clone 20 order 23 su 4194304 sc 8 2024-09-21T22:01:23.208 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:23.208+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:23.252 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:23.252 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:23.252 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:23.252 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:23.261 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:23.345 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:23.344+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:23.405 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:23.405 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:23.405 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:23.405 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:23.405 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:23.411 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:23.409+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:23.414 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:23.511 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:23.510+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 19.505823774, 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.560 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.561 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:01:23.562 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:01:23.563 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:01:23.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:01:23.565 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29925 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 2961408~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6291837149999999, 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028025164000000002, 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.566 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29925 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.567 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928533+0000", 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-06 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928538+0000", 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1599999999999997e-06 2024-09-21T22:01:23.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928543+0000", 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4410000000000003e-06 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956398+0000", 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027855386999999999 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956472+0000", 2024-09-21T22:01:23.569 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3448000000000006e-05 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956553+0000", 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1730000000000005e-05 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29926 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3567616~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6291625129999998, 2024-09-21T22:01:23.570 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028146526000000002, 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29926 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928550+0000", 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928552+0000", 2024-09-21T22:01:23.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928558+0000", 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6690000000000003e-06 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928562+0000", 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2910000000000001e-06 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956591+0000", 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028029011999999999 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956646+0000", 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5016999999999999e-05 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956696+0000", 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9920999999999999e-05 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.574 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29927 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3002368~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6291442839999997, 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028301160999999998, 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.575 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29927 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928569+0000", 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.395e-06 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928573+0000", 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.225e-06 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928575+0000", 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956723+0000", 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028148237 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956768+0000", 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4749999999999997e-05 2024-09-21T22:01:23.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956869+0000", 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010078599999999999 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29928 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3043328~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6291255839999996, 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028496923, 2024-09-21T22:01:23.579 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29928 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928587+0000", 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4699999999999998e-07 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928588+0000", 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.313e-06 2024-09-21T22:01:23.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928591+0000", 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1999999999999999e-06 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928598+0000", 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0890000000000002e-06 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956939+0000", 2024-09-21T22:01:23.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028341261 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957006+0000", 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6704000000000004e-05 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957083+0000", 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7108999999999996e-05 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.583 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6291092799999998, 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.584 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:01:23.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6290993299999998, 2024-09-21T22:01:23.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:01:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6290859270000002, 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.593 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:01:23.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6290762560000003, 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:01:23.597 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:01:23.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.601 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29937 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3248128~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6272986139999999, 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028121855000000001, 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29937 2024-09-21T22:01:23.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930414+0000", 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930416+0000", 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-06 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930422+0000", 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930435+0000", 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2404e-05 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958382+0000", 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027947339000000002 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958450+0000", 2024-09-21T22:01:23.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7611e-05 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958535+0000", 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5680999999999995e-05 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29939 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3289088~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:23.606 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6272438850000004, 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028207189000000001, 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29939 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930471+0000", 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930476+0000", 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4410000000000001e-06 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930480+0000", 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.391e-06 2024-09-21T22:01:23.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958565+0000", 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028084392999999999 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958617+0000", 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1706999999999998e-05 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958675+0000", 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8715999999999998e-05 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29941 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3330048~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6272065829999995, 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028386958, 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.611 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29941 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930506+0000", 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930508+0000", 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.782e-06 2024-09-21T22:01:23.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930514+0000", 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930518+0000", 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0949999999999998e-06 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958712+0000", 2024-09-21T22:01:23.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028194745 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958788+0000", 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5556000000000006e-05 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958892+0000", 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000104304 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29943 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6271632470000004, 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028512368999999999, 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29943 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-07 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930551+0000", 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930557+0000", 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6799999999999998e-06 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930561+0000", 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5399999999999997e-06 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958929+0000", 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028367277999999999 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958988+0000", 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8928000000000002e-05 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959061+0000", 2024-09-21T22:01:23.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3460000000000005e-05 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29945 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3411968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6271248480000002, 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028678985000000001, 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.620 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29945 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930588+0000", 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930589+0000", 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.939e-06 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930595+0000", 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8810000000000001e-06 2024-09-21T22:01:23.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930600+0000", 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5539999999999999e-06 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959097+0000", 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028497248999999999 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959184+0000", 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7170999999999996e-05 2024-09-21T22:01:23.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959266+0000", 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1769999999999998e-05 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6270804190000003, 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.624 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:23.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.628 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6270341630000003, 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:01:23.632 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6269968280000002, 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.633 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.626962647, 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.637 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:01:23.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.6269227749999997, 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.642 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:01:23.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:01:23.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:01:23.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.62687749, 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:23.646 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:01:23.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:01:23.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:23.650 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:23.652 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:23.652 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:23.651+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:23.752 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:23.751+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:23.796 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:01:23.797 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:01:23.797 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:01:23.797 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:23.797 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:23.798 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:23.806 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:23.865 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone19 from 0xdb35d35 (overlap 0x14c6b25) to 0xc7737c 2024-09-21T22:01:23.890 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:23.889+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:23.933 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-21T22:01:23.953 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:23.952+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:23.956 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:23.956 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:23.956 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:23.957 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:23.957 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:23.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:23.991 INFO:teuthology.orchestra.run.smithi102.stdout:2259 write 0x653fd19 thru 0x654a207 (0xa4ef bytes) 2024-09-21T22:01:23.998 INFO:teuthology.orchestra.run.smithi102.stdout:2260 writesame 0x9bba08c thru 0x9bc1a93 data_size 0x37(0x7a08 bytes) 2024-09-21T22:01:24.001 INFO:teuthology.orchestra.run.smithi102.stdout:2262 read 0x662ae9e thru 0x6632e7c (0x7fdf bytes) 2024-09-21T22:01:24.002 INFO:teuthology.orchestra.run.smithi102.stdout:2263 write 0x26ce0c2 thru 0x26ce762 (0x6a1 bytes) 2024-09-21T22:01:24.013 INFO:teuthology.orchestra.run.smithi102.stdout:2264 trunc from 0xdb35d35 to 0xcaf2252 2024-09-21T22:01:24.022 INFO:teuthology.orchestra.run.smithi102.stdout:2265 write 0x7334fbe thru 0x733c326 (0x7369 bytes) 2024-09-21T22:01:24.025 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:24.026 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:24.039 INFO:teuthology.orchestra.run.smithi102.stdout:2270 trunc from 0xcaf2252 to 0x1011e2f 2024-09-21T22:01:24.054 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:24.054+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:24.085 INFO:teuthology.orchestra.run.smithi102.stdout:2272 write 0xb6628a3 thru 0xb66b79b (0x8ef9 bytes) 2024-09-21T22:01:24.088 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:24.088 INFO:teuthology.orchestra.run.smithi102.stdout:2276 write 0x957e354 thru 0x958b4b0 (0xd15d bytes) 2024-09-21T22:01:24.089 INFO:teuthology.orchestra.run.smithi102.stdout:2277 write 0x3c5ff76 thru 0x3c6d591 (0xd61c bytes) 2024-09-21T22:01:24.092 INFO:teuthology.orchestra.run.smithi102.stdout:2280 write 0x25de7dd thru 0x25df893 (0x10b7 bytes) 2024-09-21T22:01:24.095 INFO:teuthology.orchestra.run.smithi102.stdout:2281 read 0xa6a97de thru 0xa6aa182 (0x9a5 bytes) 2024-09-21T22:01:24.095 INFO:teuthology.orchestra.run.smithi102.stdout:2282 write 0xa9b2d24 thru 0xa9c2340 (0xf61d bytes) 2024-09-21T22:01:24.098 INFO:teuthology.orchestra.run.smithi102.stdout:2283 write 0x97f8bef thru 0x98036cc (0xaade bytes) 2024-09-21T22:01:24.111 INFO:teuthology.orchestra.run.smithi102.stdout:2284 trunc from 0xb66b79c to 0x444b45c 2024-09-21T22:01:24.120 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:01:24.120 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:01:24.121 INFO:teuthology.orchestra.run.smithi102.stdout:2285 write 0x3d892ac thru 0x3d8ecd7 (0x5a2c bytes) 2024-09-21T22:01:24.122 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:24.122 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:24.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:24.122 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:24.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.2746577859999997, 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:01:24.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:01:24.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:24.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.2757462730000002, 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:24.129 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:01:24.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:01:24.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1672895160000003, 2024-09-21T22:01:24.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:24.140 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1672802229999997, 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1672564769999996, 2024-09-21T22:01:24.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:01:24.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1672459240000004, 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:01:24.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:01:24.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:01:24.153 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.153 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.153 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.153 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.153 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:24.153 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1672365210000004, 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:01:24.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1672257310000003, 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.159 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:01:24.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1671924579999997, 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.163 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:01:24.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1671817860000004, 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.169 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.163052295, 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:01:24.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:01:24.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:01:24.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:01:24.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33412 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2490368~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955500+0000", 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.162685658, 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096339219999999996, 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33412 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955500+0000", 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955500+0000", 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955501+0000", 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5600000000000005e-07 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955504+0000", 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5580000000000001e-06 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955514+0000", 2024-09-21T22:01:24.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4199999999999996e-06 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955523+0000", 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964852+0000", 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0093289670000000005 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964916+0000", 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4133000000000004e-05 2024-09-21T22:01:24.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965134+0000", 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00021769899999999999 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1626531570000003, 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.180 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:24.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:01:24.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1616985660000001, 2024-09-21T22:01:24.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1616753129999999, 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.190 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.192 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1603826430000002, 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:01:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:01:24.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:01:24.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1603635299999997, 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.197 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.202 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.202 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:24.202 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1603443999999996, 2024-09-21T22:01:24.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:01:24.202 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.202 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.202 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.202 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.202 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.202 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:01:24.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1603260620000002, 2024-09-21T22:01:24.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:01:24.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:01:24.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.1603076630000002, 2024-09-21T22:01:24.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:24.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:24.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:01:24.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.216 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.217 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:24.217 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:24.217 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:24.217 INFO:teuthology.orchestra.run.smithi102.stdout:2286 trunc from 0x444b45c to 0xb61a535 2024-09-21T22:01:24.218 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-21T22:01:23.803853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":993316154,"num_objects":614,"num_object_clones":180,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":181,"num_read":50128,"num_read_kb":206885,"num_write":5619,"num_write_kb":123154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":10041998,"num_keys_recovered":31,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4621,"ondisk_log_size":4621,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":277936,"kb_used_data":23988,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754696784,"statfs":{"total":773094113280,"available":772809506816,"internally_reserved":0,"allocated":24563712,"data_stored":189047158,"data_compressed":5635530,"data_compressed_allocated":15794176,"data_compressed_original":184636137,"omap_allocated":12750,"internal_metadata":259575346},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":218248964,"num_objects":185,"num_object_clones":107,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":107,"num_read":11067,"num_read_kb":87351,"num_write":1006,"num_write_kb":73237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":10041998,"num_keys_recovered":21,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.014682"},"pg_stats":[{"pgid":"3.1f","version":"50'117","reported_seq":588,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.024729+0000","last_change":"2024-09-21T22:00:56.181293+0000","last_active":"2024-09-21T22:01:21.024729+0000","last_peered":"2024-09-21T22:01:21.024729+0000","last_clean":"2024-09-21T22:01:21.024729+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:01:21.024729+0000","last_undegraded":"2024-09-21T22:01:21.024729+0000","last_fullsized":"2024-09-21T22:01:21.024729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:52:25.821693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096701700000000003,"stat_sum":{"num_bytes":4957002,"num_objects":16,"num_object_clones":4,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":6,"num_read":1060,"num_read_kb":2009,"num_write":116,"num_write_kb":2344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"47'54","reported_seq":666,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.797739+0000","last_change":"2024-09-21T22:01:19.907997+0000","last_active":"2024-09-21T22:01:21.797739+0000","last_peered":"2024-09-21T22:01:21.797739+0000","last_clean":"2024-09-21T22:01:21.797739+0000","last_became_active":"2024-09-21T22:01:19.802102+0000","last_became_peered":"2024-09-21T22:01:19.802102+0000","last_unstale":"2024-09-21T22:01:21.797739+0000","last_undegraded":"2024-09-21T22:01:21.797739+0000","last_fullsized":"2024-09-21T22:01:21.797739+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:50:36.317361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064754199999999997,"stat_sum":{"num_bytes":34829051,"num_objects":19,"num_object_clones":4,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":5,"num_read":479,"num_read_kb":4975,"num_write":58,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":1101388,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"51'326","reported_seq":742,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.805774+0000","last_change":"2024-09-21T22:00:56.175600+0000","last_active":"2024-09-21T22:01:21.805774+0000","last_peered":"2024-09-21T22:01:21.805774+0000","last_clean":"2024-09-21T22:01:21.805774+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:01:21.805774+0000","last_undegraded":"2024-09-21T22:01:21.805774+0000","last_fullsized":"2024-09-21T22:01:21.805774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:07:13.463732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003077237,"stat_sum":{"num_bytes":20089412,"num_objects":18,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":6,"num_read":1618,"num_read_kb":8255,"num_write":505,"num_write_kb":6649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"51'145","reported_seq":3435,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.822794+0000","last_change":"2024-09-21T22:00:56.175356+0000","last_active":"2024-09-21T22:01:21.822794+0000","last_peered":"2024-09-21T22:01:21.822794+0000","last_clean":"2024-09-21T22:01:21.822794+0000","last_became_active":"2024-09-21T22:00:54.161171+0000","last_became_peered":"2024-09-21T22:00:54.161171+0000","last_unstale":"2024-09-21T22:01:21.822794+0000","last_undegraded":"2024-09-21T22:01:21.822794+0000","last_fullsized":"2024-09-21T22:01:21.822794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:54:17.611182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028551459999999998,"stat_sum":{"num_bytes":56608126,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":3316,"num_read_kb":16834,"num_write":160,"num_write_kb":4865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"49'209","reported_seq":920,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.036763+0000","last_change":"2024-09-21T22:00:56.180837+0000","last_active":"2024-09-21T22:01:21.036763+0000","last_peered":"2024-09-21T22:01:21.036763+0000","last_clean":"2024-09-21T22:01:21.036763+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:01:21.036763+0000","last_undegraded":"2024-09-21T22:01:21.036763+0000","last_fullsized":"2024-09-21T22:01:21.036763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:15.563220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000536288,"stat_sum":{"num_bytes":35190817,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":4,"num_read":1284,"num_read_kb":7480,"num_write":306,"num_write_kb":13339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"47'313","reported_seq":1446,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.887611+0000","last_change":"2024-09-21T22:00:56.166249+0000","last_active":"2024-09-21T22:01:21.887611+0000","last_peered":"2024-09-21T22:01:21.887611+0000","last_clean":"2024-09-21T22:01:21.887611+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:01:21.887611+0000","last_undegraded":"2024-09-21T22:01:21.887611+0000","last_fullsized":"2024-09-21T22:01:21.887611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:58.156548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085766300000000005,"stat_sum":{"num_bytes":12729927,"num_objects":17,"num_object_clones":5,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":5,"num_read":2339,"num_read_kb":5268,"num_write":477,"num_write_kb":1710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"49'159","reported_seq":3338,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.892072+0000","last_change":"2024-09-21T22:00:56.167992+0000","last_active":"2024-09-21T22:01:21.892072+0000","last_peered":"2024-09-21T22:01:21.892072+0000","last_clean":"2024-09-21T22:01:21.892072+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:01:21.892072+0000","last_undegraded":"2024-09-21T22:01:21.892072+0000","last_fullsized":"2024-09-21T22:01:21.892072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:54:28.858153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000312307,"stat_sum":{"num_bytes":30427543,"num_objects":18,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":5,"num_read":3842,"num_read_kb":11816,"num_write":206,"num_write_kb":2545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"47'105","reported_seq":658,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.797919+0000","last_change":"2024-09-21T22:00:56.158344+0000","last_active":"2024-09-21T22:01:21.797919+0000","last_peered":"2024-09-21T22:01:21.797919+0000","last_clean":"2024-09-21T22:01:21.797919+0000","last_became_active":"2024-09-21T22:00:54.155140+0000","last_became_peered":"2024-09-21T22:00:54.155140+0000","last_unstale":"2024-09-21T22:01:21.797919+0000","last_undegraded":"2024-09-21T22:01:21.797919+0000","last_fullsized":"2024-09-21T22:01:21.797919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:37.500390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037013200000000001,"stat_sum":{"num_bytes":39165330,"num_objects":20,"num_object_clones":6,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":5,"num_read":602,"num_read_kb":4900,"num_write":119,"num_write_kb":1819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":734,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.037169+0000","last_change":"2024-09-21T22:00:56.181482+0000","last_active":"2024-09-21T22:01:21.037169+0000","last_peered":"2024-09-21T22:01:21.037169+0000","last_clean":"2024-09-21T22:01:21.037169+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:01:21.037169+0000","last_undegraded":"2024-09-21T22:01:21.037169+0000","last_fullsized":"2024-09-21T22:01:21.037169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:28:57.496933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001057845,"stat_sum":{"num_bytes":11285443,"num_objects":22,"num_object_clones":5,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":7,"num_read":1516,"num_read_kb":3491,"num_write":135,"num_write_kb":5021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"51'119","reported_seq":3748,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.829392+0000","last_change":"2024-09-21T22:00:56.175667+0000","last_active":"2024-09-21T22:01:21.829392+0000","last_peered":"2024-09-21T22:01:21.829392+0000","last_clean":"2024-09-21T22:01:21.829392+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:01:21.829392+0000","last_undegraded":"2024-09-21T22:01:21.829392+0000","last_fullsized":"2024-09-21T22:01:21.829392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:22:49.788403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031184279999999999,"stat_sum":{"num_bytes":46570567,"num_objects":25,"num_object_clones":10,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":8,"num_read":3863,"num_read_kb":19460,"num_write":120,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"49'101","reported_seq":539,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.801080+0000","last_change":"2024-09-21T22:00:56.161375+0000","last_active":"2024-09-21T22:01:21.801080+0000","last_peered":"2024-09-21T22:01:21.801080+0000","last_clean":"2024-09-21T22:01:21.801080+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:01:21.801080+0000","last_undegraded":"2024-09-21T22:01:21.801080+0000","last_fullsized":"2024-09-21T22:01:21.801080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:43:30.403281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057728900000000004,"stat_sum":{"num_bytes":7166079,"num_objects":21,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":842,"num_read_kb":4558,"num_write":112,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"47'105","reported_seq":725,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.806203+0000","last_change":"2024-09-21T22:00:56.165733+0000","last_active":"2024-09-21T22:01:21.806203+0000","last_peered":"2024-09-21T22:01:21.806203+0000","last_clean":"2024-09-21T22:01:21.806203+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:01:21.806203+0000","last_undegraded":"2024-09-21T22:01:21.806203+0000","last_fullsized":"2024-09-21T22:01:21.806203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:16:47.628004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039301800000000002,"stat_sum":{"num_bytes":34521193,"num_objects":19,"num_object_clones":5,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":4,"num_read":603,"num_read_kb":3508,"num_write":101,"num_write_kb":1573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.838538+0000","last_change":"2024-09-21T22:01:19.842410+0000","last_active":"2024-09-21T22:01:21.838538+0000","last_peered":"2024-09-21T22:01:21.838538+0000","last_clean":"2024-09-21T22:01:21.838538+0000","last_became_active":"2024-09-21T22:01:19.842092+0000","last_became_peered":"2024-09-21T22:01:19.842092+0000","last_unstale":"2024-09-21T22:01:21.838538+0000","last_undegraded":"2024-09-21T22:01:21.838538+0000","last_fullsized":"2024-09-21T22:01:21.838538+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:37:47.690324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"50'88","reported_seq":572,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.028175+0000","last_change":"2024-09-21T22:00:56.180714+0000","last_active":"2024-09-21T22:01:21.028175+0000","last_peered":"2024-09-21T22:01:21.028175+0000","last_clean":"2024-09-21T22:01:21.028175+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:01:21.028175+0000","last_undegraded":"2024-09-21T22:01:21.028175+0000","last_fullsized":"2024-09-21T22:01:21.028175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:33.050237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043178500000000001,"stat_sum":{"num_bytes":35685588,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":6,"num_read":484,"num_read_kb":3022,"num_write":84,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.838542+0000","last_change":"2024-09-21T22:01:19.795987+0000","last_active":"2024-09-21T22:01:21.838542+0000","last_peered":"2024-09-21T22:01:21.838542+0000","last_clean":"2024-09-21T22:01:21.838542+0000","last_became_active":"2024-09-21T22:01:19.795689+0000","last_became_peered":"2024-09-21T22:01:19.795689+0000","last_unstale":"2024-09-21T22:01:21.838542+0000","last_undegraded":"2024-09-21T22:01:21.838542+0000","last_fullsized":"2024-09-21T22:01:21.838542+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:33:05.003368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"49'143","reported_seq":1131,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.797785+0000","last_change":"2024-09-21T22:00:56.159977+0000","last_active":"2024-09-21T22:01:21.797785+0000","last_peered":"2024-09-21T22:01:21.797785+0000","last_clean":"2024-09-21T22:01:21.797785+0000","last_became_active":"2024-09-21T22:00:54.162377+0000","last_became_peered":"2024-09-21T22:00:54.162377+0000","last_unstale":"2024-09-21T22:01:21.797785+0000","last_undegraded":"2024-09-21T22:01:21.797785+0000","last_fullsized":"2024-09-21T22:01:21.797785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:10:43.054356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069122900000000002,"stat_sum":{"num_bytes":9045531,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":2005,"num_read_kb":9557,"num_write":136,"num_write_kb":6383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.801177+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:01:21.801177+0000","last_peered":"2024-09-21T22:01:21.801177+0000","last_clean":"2024-09-21T22:01:21.801177+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:01:21.801177+0000","last_undegraded":"2024-09-21T22:01:21.801177+0000","last_fullsized":"2024-09-21T22:01:21.801177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"51'171","reported_seq":3476,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.882639+0000","last_change":"2024-09-21T22:00:56.158198+0000","last_active":"2024-09-21T22:01:21.882639+0000","last_peered":"2024-09-21T22:01:21.882639+0000","last_clean":"2024-09-21T22:01:21.882639+0000","last_became_active":"2024-09-21T22:00:54.158128+0000","last_became_peered":"2024-09-21T22:00:54.158128+0000","last_unstale":"2024-09-21T22:01:21.882639+0000","last_undegraded":"2024-09-21T22:01:21.882639+0000","last_fullsized":"2024-09-21T22:01:21.882639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:21.636386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046529200000000002,"stat_sum":{"num_bytes":45856633,"num_objects":17,"num_object_clones":5,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":6,"num_read":4187,"num_read_kb":13675,"num_write":168,"num_write_kb":1943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-21T22:01:20.790836+0000","last_change":"2024-09-21T22:00:54.156721+0000","last_active":"2024-09-21T22:01:20.790836+0000","last_peered":"2024-09-21T22:01:20.790836+0000","last_clean":"2024-09-21T22:01:20.790836+0000","last_became_active":"2024-09-21T22:00:54.156336+0000","last_became_peered":"2024-09-21T22:00:54.156336+0000","last_unstale":"2024-09-21T22:01:20.790836+0000","last_undegraded":"2024-09-21T22:01:20.790836+0000","last_fullsized":"2024-09-21T22:01:20.790836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:54:12.268488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"50'92","reported_seq":616,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.803111+0000","last_change":"2024-09-21T22:00:56.175852+0000","last_active":"2024-09-21T22:01:21.803111+0000","last_peered":"2024-09-21T22:01:21.803111+0000","last_clean":"2024-09-21T22:01:21.803111+0000","last_became_active":"2024-09-21T22:00:54.156623+0000","last_became_peered":"2024-09-21T22:00:54.156623+0000","last_unstale":"2024-09-21T22:01:21.803111+0000","last_undegraded":"2024-09-21T22:01:21.803111+0000","last_fullsized":"2024-09-21T22:01:21.803111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:47.281995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031408949999999999,"stat_sum":{"num_bytes":39319055,"num_objects":17,"num_object_clones":5,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":4,"num_read":991,"num_read_kb":3799,"num_write":100,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"49'168","reported_seq":947,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.806176+0000","last_change":"2024-09-21T22:00:56.166325+0000","last_active":"2024-09-21T22:01:21.806176+0000","last_peered":"2024-09-21T22:01:21.806176+0000","last_clean":"2024-09-21T22:01:21.806176+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:01:21.806176+0000","last_undegraded":"2024-09-21T22:01:21.806176+0000","last_fullsized":"2024-09-21T22:01:21.806176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:57.668846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091363999999999996,"stat_sum":{"num_bytes":27107616,"num_objects":16,"num_object_clones":5,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":4,"num_read":1281,"num_read_kb":7853,"num_write":247,"num_write_kb":4163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":81,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.802911+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:01:21.802911+0000","last_peered":"2024-09-21T22:01:21.802911+0000","last_clean":"2024-09-21T22:01:21.802911+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:01:21.802911+0000","last_undegraded":"2024-09-21T22:01:21.802911+0000","last_fullsized":"2024-09-21T22:01:21.802911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"49'84","reported_seq":597,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.825840+0000","last_change":"2024-09-21T22:00:56.158370+0000","last_active":"2024-09-21T22:01:21.825840+0000","last_peered":"2024-09-21T22:01:21.825840+0000","last_clean":"2024-09-21T22:01:21.825840+0000","last_became_active":"2024-09-21T22:00:54.156923+0000","last_became_peered":"2024-09-21T22:00:54.156923+0000","last_unstale":"2024-09-21T22:01:21.825840+0000","last_undegraded":"2024-09-21T22:01:21.825840+0000","last_fullsized":"2024-09-21T22:01:21.825840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:33:20.426792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065359599999999999,"stat_sum":{"num_bytes":37140362,"num_objects":24,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":496,"num_read_kb":3724,"num_write":75,"num_write_kb":1932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.825767+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:01:21.825767+0000","last_peered":"2024-09-21T22:01:21.825767+0000","last_clean":"2024-09-21T22:01:21.825767+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:01:21.825767+0000","last_undegraded":"2024-09-21T22:01:21.825767+0000","last_fullsized":"2024-09-21T22:01:21.825767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"47'43","reported_seq":298,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-21T22:01:20.790843+0000","last_change":"2024-09-21T22:00:56.180594+0000","last_active":"2024-09-21T22:01:20.790843+0000","last_peered":"2024-09-21T22:01:20.790843+0000","last_clean":"2024-09-21T22:01:20.790843+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:01:20.790843+0000","last_undegraded":"2024-09-21T22:01:20.790843+0000","last_fullsized":"2024-09-21T22:01:20.790843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:03:30.624208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039822099999999998,"stat_sum":{"num_bytes":5689382,"num_objects":17,"num_object_clones":4,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":6,"num_read":195,"num_read_kb":2811,"num_write":33,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.800953+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:01:21.800953+0000","last_peered":"2024-09-21T22:01:21.800953+0000","last_clean":"2024-09-21T22:01:21.800953+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:01:21.800953+0000","last_undegraded":"2024-09-21T22:01:21.800953+0000","last_fullsized":"2024-09-21T22:01:21.800953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"47'98","reported_seq":427,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.797974+0000","last_change":"2024-09-21T22:00:56.159828+0000","last_active":"2024-09-21T22:01:21.797974+0000","last_peered":"2024-09-21T22:01:21.797974+0000","last_clean":"2024-09-21T22:01:21.797974+0000","last_became_active":"2024-09-21T22:00:54.157660+0000","last_became_peered":"2024-09-21T22:00:54.157660+0000","last_unstale":"2024-09-21T22:01:21.797974+0000","last_undegraded":"2024-09-21T22:01:21.797974+0000","last_fullsized":"2024-09-21T22:01:21.797974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:07.854267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065768700000000001,"stat_sum":{"num_bytes":42649223,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":6,"num_read":624,"num_read_kb":2378,"num_write":95,"num_write_kb":2345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":80,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.802909+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:01:21.802909+0000","last_peered":"2024-09-21T22:01:21.802909+0000","last_clean":"2024-09-21T22:01:21.802909+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:01:21.802909+0000","last_undegraded":"2024-09-21T22:01:21.802909+0000","last_fullsized":"2024-09-21T22:01:21.802909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":230,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.800963+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:01:21.800963+0000","last_peered":"2024-09-21T22:01:21.800963+0000","last_clean":"2024-09-21T22:01:21.800963+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:01:21.800963+0000","last_undegraded":"2024-09-21T22:01:21.800963+0000","last_fullsized":"2024-09-21T22:01:21.800963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"51'142","reported_seq":4042,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.878803+0000","last_change":"2024-09-21T22:00:56.159517+0000","last_active":"2024-09-21T22:01:21.878803+0000","last_peered":"2024-09-21T22:01:21.878803+0000","last_clean":"2024-09-21T22:01:21.878803+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:01:21.878803+0000","last_undegraded":"2024-09-21T22:01:21.878803+0000","last_fullsized":"2024-09-21T22:01:21.878803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:55:45.778467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053085999999999997,"stat_sum":{"num_bytes":58466118,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":4362,"num_read_kb":2839,"num_write":143,"num_write_kb":3995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'177","reported_seq":1065,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.806158+0000","last_change":"2024-09-21T22:00:56.166480+0000","last_active":"2024-09-21T22:01:21.806158+0000","last_peered":"2024-09-21T22:01:21.806158+0000","last_clean":"2024-09-21T22:01:21.806158+0000","last_became_active":"2024-09-21T22:00:54.160321+0000","last_became_peered":"2024-09-21T22:00:54.160321+0000","last_unstale":"2024-09-21T22:01:21.806158+0000","last_undegraded":"2024-09-21T22:01:21.806158+0000","last_fullsized":"2024-09-21T22:01:21.806158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:41:27.206647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010281190000000001,"stat_sum":{"num_bytes":14038748,"num_objects":13,"num_object_clones":3,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":2334,"num_read_kb":3698,"num_write":202,"num_write_kb":2136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"51'155","reported_seq":374,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.982694+0000","last_change":"2024-09-21T22:01:19.956999+0000","last_active":"2024-09-21T22:01:21.982694+0000","last_peered":"2024-09-21T22:01:21.982694+0000","last_clean":"2024-09-21T22:01:21.982694+0000","last_became_active":"2024-09-21T22:01:19.796198+0000","last_became_peered":"2024-09-21T22:01:19.796198+0000","last_unstale":"2024-09-21T22:01:21.982694+0000","last_undegraded":"2024-09-21T22:01:21.982694+0000","last_fullsized":"2024-09-21T22:01:21.982694+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:01:40.522191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090320500000000002,"stat_sum":{"num_bytes":48473806,"num_objects":26,"num_object_clones":7,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":9,"num_read":1457,"num_read_kb":1727,"num_write":163,"num_write_kb":1407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":989223,"num_keys_recovered":31,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"48'62","reported_seq":317,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.797636+0000","last_change":"2024-09-21T22:00:56.159527+0000","last_active":"2024-09-21T22:01:21.797636+0000","last_peered":"2024-09-21T22:01:21.797636+0000","last_clean":"2024-09-21T22:01:21.797636+0000","last_became_active":"2024-09-21T22:00:54.156515+0000","last_became_peered":"2024-09-21T22:00:54.156515+0000","last_unstale":"2024-09-21T22:01:21.797636+0000","last_undegraded":"2024-09-21T22:01:21.797636+0000","last_fullsized":"2024-09-21T22:01:21.797636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:51:13.262181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073161999999999999,"stat_sum":{"num_bytes":45364304,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":5,"num_read":225,"num_read_kb":6002,"num_write":63,"num_write_kb":4881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"50'162","reported_seq":762,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.803004+0000","last_change":"2024-09-21T22:00:56.175447+0000","last_active":"2024-09-21T22:01:21.803004+0000","last_peered":"2024-09-21T22:01:21.803004+0000","last_clean":"2024-09-21T22:01:21.803004+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:01:21.803004+0000","last_undegraded":"2024-09-21T22:01:21.803004+0000","last_fullsized":"2024-09-21T22:01:21.803004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:36:46.817695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029196539999999998,"stat_sum":{"num_bytes":10559451,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":5,"num_read":1308,"num_read_kb":5449,"num_write":191,"num_write_kb":1654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"50'87","reported_seq":2948,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.801239+0000","last_change":"2024-09-21T22:00:56.161329+0000","last_active":"2024-09-21T22:01:21.801239+0000","last_peered":"2024-09-21T22:01:21.801239+0000","last_clean":"2024-09-21T22:01:21.801239+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:01:21.801239+0000","last_undegraded":"2024-09-21T22:01:21.801239+0000","last_fullsized":"2024-09-21T22:01:21.801239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:29.726511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674853,"stat_sum":{"num_bytes":51333877,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":3,"num_read":2819,"num_read_kb":11050,"num_write":92,"num_write_kb":2574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"50'303","reported_seq":1021,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.945862+0000","last_change":"2024-09-21T22:00:56.160920+0000","last_active":"2024-09-21T22:01:21.945862+0000","last_peered":"2024-09-21T22:01:21.945862+0000","last_clean":"2024-09-21T22:01:21.945862+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:01:21.945862+0000","last_undegraded":"2024-09-21T22:01:21.945862+0000","last_fullsized":"2024-09-21T22:01:21.945862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:12.359922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035276399999999999,"stat_sum":{"num_bytes":26537769,"num_objects":14,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":2194,"num_read_kb":7833,"num_write":474,"num_write_kb":4043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"50'341","reported_seq":974,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.801134+0000","last_change":"2024-09-21T22:00:56.161162+0000","last_active":"2024-09-21T22:01:21.801134+0000","last_peered":"2024-09-21T22:01:21.801134+0000","last_clean":"2024-09-21T22:01:21.801134+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:01:21.801134+0000","last_undegraded":"2024-09-21T22:01:21.801134+0000","last_fullsized":"2024-09-21T22:01:21.801134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:19:10.222304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054637399999999997,"stat_sum":{"num_bytes":74156642,"num_objects":26,"num_object_clones":7,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":4,"num_read":1717,"num_read_kb":3292,"num_write":447,"num_write_kb":6533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"50'58","reported_seq":206,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.838599+0000","last_change":"2024-09-21T22:01:19.884035+0000","last_active":"2024-09-21T22:01:21.838599+0000","last_peered":"2024-09-21T22:01:21.838599+0000","last_clean":"2024-09-21T22:01:21.838599+0000","last_became_active":"2024-09-21T22:01:19.793619+0000","last_became_peered":"2024-09-21T22:01:19.793619+0000","last_unstale":"2024-09-21T22:01:21.838599+0000","last_undegraded":"2024-09-21T22:01:21.838599+0000","last_fullsized":"2024-09-21T22:01:21.838599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:42:11.307625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297588,"stat_sum":{"num_bytes":21861296,"num_objects":19,"num_object_clones":7,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":9,"num_read":330,"num_read_kb":10684,"num_write":76,"num_write_kb":11472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":7951387,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"50'121","reported_seq":921,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.801143+0000","last_change":"2024-09-21T22:00:56.160905+0000","last_active":"2024-09-21T22:01:21.801143+0000","last_peered":"2024-09-21T22:01:21.801143+0000","last_clean":"2024-09-21T22:01:21.801143+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:01:21.801143+0000","last_undegraded":"2024-09-21T22:01:21.801143+0000","last_fullsized":"2024-09-21T22:01:21.801143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:57.561792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042909099999999999,"stat_sum":{"num_bytes":30031209,"num_objects":20,"num_object_clones":7,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":7,"num_read":785,"num_read_kb":12045,"num_write":127,"num_write_kb":6721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"47'76","reported_seq":367,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-21T22:01:20.790857+0000","last_change":"2024-09-21T22:00:56.181344+0000","last_active":"2024-09-21T22:01:20.790857+0000","last_peered":"2024-09-21T22:01:20.790857+0000","last_clean":"2024-09-21T22:01:20.790857+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:01:20.790857+0000","last_undegraded":"2024-09-21T22:01:20.790857+0000","last_fullsized":"2024-09-21T22:01:20.790857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:33:26.317654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096881799999999998,"stat_sum":{"num_bytes":10301478,"num_objects":9,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":2,"num_read":335,"num_read_kb":819,"num_write":86,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"49'45","reported_seq":619,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T22:01:21.801181+0000","last_change":"2024-09-21T22:00:56.161104+0000","last_active":"2024-09-21T22:01:21.801181+0000","last_peered":"2024-09-21T22:01:21.801181+0000","last_clean":"2024-09-21T22:01:21.801181+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:01:21.801181+0000","last_undegraded":"2024-09-21T22:01:21.801181+0000","last_fullsized":"2024-09-21T22:01:21.801181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:29:17.015769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051462399999999998,"stat_sum":{"num_bytes":25567189,"num_objects":17,"num_object_clones":6,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":7,"num_read":519,"num_read_kb":1974,"num_write":41,"num_write_kb":1997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":992725767,"num_objects":610,"num_object_clones":180,"num_object_copies":1220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":610,"num_whiteouts":181,"num_read":50012,"num_read_kb":206785,"num_write":5458,"num_write_kb":120736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":10041998,"num_keys_recovered":31,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19791872,"data_stored":183352828,"data_compressed":5652765,"data_compressed_allocated":15593472,"data_compressed_original":180953998,"omap_allocated":0,"internal_metadata":0},"log_size":4501,"ondisk_log_size":4501,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39072,"kb_used_data":3604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332768,"statfs":{"total":96636764160,"available":96596754432,"internally_reserved":0,"allocated":3690496,"data_stored":27529978,"data_compressed":845183,"data_compressed_allocated":2424832,"data_compressed_original":26876028,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28784,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343056,"statfs":{"total":96636764160,"available":96607289344,"internally_reserved":0,"allocated":1638400,"data_stored":11080672,"data_compressed":313759,"data_compressed_allocated":868352,"data_compressed_original":10706944,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34360,"kb_used_data":3176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337480,"statfs":{"total":96636764160,"available":96601579520,"internally_reserved":0,"allocated":3252224,"data_stored":27606632,"data_compressed":712146,"data_compressed_allocated":2138112,"data_compressed_original":27073799,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40416,"kb_used_data":5072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331424,"statfs":{"total":96636764160,"available":96595378176,"internally_reserved":0,"allocated":5193728,"data_stored":45069774,"data_compressed":1229508,"data_compressed_allocated":3710976,"data_compressed_original":44315191,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34228,"kb_used_data":3032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337612,"statfs":{"total":96636764160,"available":96601714688,"internally_reserved":0,"allocated":3104768,"data_stored":22628096,"data_compressed":843798,"data_compressed_allocated":1916928,"data_compressed_original":22028288,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1368064,"data_stored":4243359,"data_compressed":362847,"data_compressed_allocated":544768,"data_compressed_original":3827183,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2224128,"data_stored":10315760,"data_compressed":644275,"data_compressed_allocated":1183744,"data_compressed_original":9788109,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35184,"kb_used_data":3996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336656,"statfs":{"total":96636764160,"available":96600735744,"internally_reserved":0,"allocated":4091904,"data_stored":40572887,"data_compressed":684014,"data_compressed_allocated":3006464,"data_compressed_original":40020595,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3477504,"data_stored":39740218,"data_compressed":679082,"data_compressed_allocated":2969600,"data_compressed_original":39447155,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1654784,"data_stored":10067312,"data_compressed":644275,"data_compressed_allocated":1183744,"data_compressed_original":9788109,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":786432,"data_stored":3988772,"data_compressed":362847,"data_compressed_allocated":544768,"data_compressed_original":3827183,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2568192,"data_stored":22838419,"data_compressed":844050,"data_compressed_allocated":1945600,"data_compressed_original":22487040,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4624384,"data_stored":44821330,"data_compressed":1229508,"data_compressed_allocated":3710976,"data_compressed_original":44315191,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2695168,"data_stored":27375681,"data_compressed":722340,"data_compressed_allocated":2146304,"data_compressed_original":27090183,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1069056,"data_stored":10832228,"data_compressed":313759,"data_compressed_allocated":868352,"data_compressed_original":10706944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2916352,"data_stored":23688868,"data_compressed":856904,"data_compressed_allocated":2224128,"data_compressed_original":23292193,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:01:24.219 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:24.219 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:24.217+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:24.222 INFO:teuthology.orchestra.run.smithi102.stdout:2287 trunc from 0xb61a535 to 0x7780834 2024-09-21T22:01:24.222 INFO:teuthology.orchestra.run.smithi102.stdout:2288 read 0x733d5a2 thru 0x7349e24 (0xc883 bytes) 2024-09-21T22:01:24.222 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:24.222 INFO:teuthology.orchestra.run.smithi102.stdout:2293 trunc from 0x7780834 to 0x73d10d 2024-09-21T22:01:24.222 INFO:teuthology.orchestra.run.smithi102.stdout:2294 read 0x537ca0 thru 0x53ad46 (0x30a7 bytes) 2024-09-21T22:01:24.223 INFO:teuthology.orchestra.run.smithi102.stdout:2295 write 0xb973720 thru 0xb9776df (0x3fc0 bytes) 2024-09-21T22:01:24.223 INFO:teuthology.orchestra.run.smithi102.stdout:2296 punch from 0x7ad4e3a to 0x7ad9390, (0x4556 bytes) 2024-09-21T22:01:24.223 INFO:teuthology.orchestra.run.smithi102.stdout:2297 punch from 0x3f7f27 to 0x3fc731, (0x480a bytes) 2024-09-21T22:01:24.223 INFO:teuthology.orchestra.run.smithi102.stdout:2298 read 0x848781d thru 0x8492b0c (0xb2f0 bytes) 2024-09-21T22:01:24.223 INFO:teuthology.orchestra.run.smithi102.stdout:2299 write 0x976a0f9 thru 0x976fb2c (0x5a34 bytes) 2024-09-21T22:01:24.223 INFO:teuthology.orchestra.run.smithi102.stdout:2300 write 0x2ce3cd1 thru 0x2ceeaf5 (0xae25 bytes) 2024-09-21T22:01:24.223 INFO:teuthology.orchestra.run.smithi102.stdout:2302 clone 21 order 24 su 262144 sc 7 2024-09-21T22:01:24.318 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:24.317+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:24.362 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:24.362 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:24.362 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:24.362 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:24.371 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:24.375 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:24.419 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:24.418+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:24.495 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:24.495 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:24.512 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:24.512 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:24.513 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:24.513 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:24.513 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:24.513 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:24.513 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:24.519 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:24.518+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:24.521 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:24.527 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:24.528 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:24.543 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:24.543 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:24.560 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:24.560 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:24.577 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:24.577 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:24.593 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:24.593 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:24.610 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:24.620 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:24.618+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:24.666 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:24.666 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:24.674 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:24.721 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:24.720+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:24.778 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:24.778 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:24.786 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:24.816 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:01:24.822 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:24.820+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:24.876 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone20 from 0xb9776e0 (overlap 0x73d10d) to 0x457d6e 2024-09-21T22:01:24.923 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:24.921+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:24.942 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:24.942 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:24.943 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-21T22:01:24.955 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:24.978 INFO:teuthology.orchestra.run.smithi102.stdout:2303 write 0xd3c9dcd thru 0xd3d654f (0xc783 bytes) 2024-09-21T22:01:24.983 INFO:teuthology.orchestra.run.smithi102.stdout:2304 punch from 0x4c80a7 to 0x4d2312, (0xa26b bytes) 2024-09-21T22:01:24.983 INFO:teuthology.orchestra.run.smithi102.stdout:2305 flatten 2024-09-21T22:01:25.008 INFO:teuthology.orchestra.run.smithi102.stdout:2306 read 0x8152625 thru 0x8155555 (0x2f31 bytes) 2024-09-21T22:01:25.009 INFO:teuthology.orchestra.run.smithi102.stdout:2307 trunc from 0xd3d6550 to 0xe6f8393 2024-09-21T22:01:25.016 INFO:teuthology.orchestra.run.smithi102.stdout:2308 read 0x255393a thru 0x25602e1 (0xc9a8 bytes) 2024-09-21T22:01:25.016 INFO:teuthology.orchestra.run.smithi102.stdout:2309 write 0xd4336bf thru 0xd43c33e (0x8c80 bytes) 2024-09-21T22:01:25.019 INFO:teuthology.orchestra.run.smithi102.stdout:2310 write 0xe02ae35 thru 0xe032b07 (0x7cd3 bytes) 2024-09-21T22:01:25.022 INFO:teuthology.orchestra.run.smithi102.stdout:2311 read 0xc067aa8 thru 0xc070ffc (0x9555 bytes) 2024-09-21T22:01:25.022 INFO:teuthology.orchestra.run.smithi102.stdout:2312 read 0x81142a7 thru 0x812187d (0xd5d7 bytes) 2024-09-21T22:01:25.022 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.022 INFO:teuthology.orchestra.run.smithi102.stdout:2314 writesame 0x8fa8589 thru 0x8faf45c data_size 0x52(0x6ed4 bytes) 2024-09-21T22:01:25.023 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:25.022+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:25.024 INFO:teuthology.orchestra.run.smithi102.stdout:2315 punch from 0x95cc701 to 0x95cff03, (0x3802 bytes) 2024-09-21T22:01:25.024 INFO:teuthology.orchestra.run.smithi102.stdout:2316 punch from 0x6b0c716 to 0x6b0f472, (0x2d5c bytes) 2024-09-21T22:01:25.024 INFO:teuthology.orchestra.run.smithi102.stdout:2317 read 0x215cfd5 thru 0x2169378 (0xc3a4 bytes) 2024-09-21T22:01:25.024 INFO:teuthology.orchestra.run.smithi102.stdout:2318 read 0xb633ff5 thru 0xb63422b (0x237 bytes) 2024-09-21T22:01:25.024 INFO:teuthology.orchestra.run.smithi102.stdout:2320 writesame 0xdb8a64f thru 0xdb8f510 data_size 0x11(0x4ec2 bytes) 2024-09-21T22:01:25.026 INFO:teuthology.orchestra.run.smithi102.stdout:2321 punch from 0x1a626b5 to 0x1a66645, (0x3f90 bytes) 2024-09-21T22:01:25.026 INFO:teuthology.orchestra.run.smithi102.stdout:2322 write 0x2e77120 thru 0x2e823b9 (0xb29a bytes) 2024-09-21T22:01:25.027 INFO:teuthology.orchestra.run.smithi102.stdout:2323 write 0xe3af623 thru 0xe3b88b6 (0x9294 bytes) 2024-09-21T22:01:25.040 INFO:teuthology.orchestra.run.smithi102.stdout:2324 trunc from 0xe6f8393 to 0x50eba95 2024-09-21T22:01:25.053 INFO:teuthology.orchestra.run.smithi102.stdout:2325 write 0xd7d4dd thru 0xd8c57b (0xf09f bytes) 2024-09-21T22:01:25.054 INFO:teuthology.orchestra.run.smithi102.stdout:2326 read 0x3d1605a thru 0x3d22add (0xca84 bytes) 2024-09-21T22:01:25.055 INFO:teuthology.orchestra.run.smithi102.stdout:2327 punch from 0x4988c53 to 0x4997437, (0xe7e4 bytes) 2024-09-21T22:01:25.055 INFO:teuthology.orchestra.run.smithi102.stdout:2329 write 0x3308ebb thru 0x33159cd (0xcb13 bytes) 2024-09-21T22:01:25.067 INFO:teuthology.orchestra.run.smithi102.stdout:2330 trunc from 0x50eba95 to 0xe0f4bd5 2024-09-21T22:01:25.088 INFO:teuthology.orchestra.run.smithi102.stdout:2331 trunc from 0xe0f4bd5 to 0x1c0b55a 2024-09-21T22:01:25.096 INFO:teuthology.orchestra.run.smithi102.stdout:2332 punch from 0x12cce88 to 0x12db5c7, (0xe73f bytes) 2024-09-21T22:01:25.096 INFO:teuthology.orchestra.run.smithi102.stdout:2333 read 0xbd868d thru 0xbda754 (0x20c8 bytes) 2024-09-21T22:01:25.104 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:25.104 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:25.106 INFO:teuthology.orchestra.run.smithi102.stdout:2334 trunc from 0x1c0b55a to 0xa2162b2 2024-09-21T22:01:25.112 INFO:teuthology.orchestra.run.smithi102.stdout:2335 punch from 0x6e3460d to 0x6e380a6, (0x3a99 bytes) 2024-09-21T22:01:25.112 INFO:teuthology.orchestra.run.smithi102.stdout:2337 punch from 0x191ba65 to 0x1927c76, (0xc211 bytes) 2024-09-21T22:01:25.112 INFO:teuthology.orchestra.run.smithi102.stdout:2339 read 0x170e0ad thru 0x170f453 (0x13a7 bytes) 2024-09-21T22:01:25.112 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.114 INFO:teuthology.orchestra.run.smithi102.stdout:2341 trunc from 0xa2162b2 to 0xbace1f5 2024-09-21T22:01:25.115 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:25.127 INFO:teuthology.orchestra.run.smithi102.stdout:2342 writesame 0xe639e7b thru 0xe6461f9 data_size 0x1(0xc37f bytes) 2024-09-21T22:01:25.127 INFO:teuthology.orchestra.run.smithi102.stdout:2343 write 0xa2bfda1 thru 0xa2ca438 (0xa698 bytes) 2024-09-21T22:01:25.127 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:25.126+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:25.130 INFO:teuthology.orchestra.run.smithi102.stdout:2344 trunc from 0xe6461fa to 0xe98b452 2024-09-21T22:01:25.135 INFO:teuthology.orchestra.run.smithi102.stdout:2345 write 0x9d4d7b7 thru 0x9d522b2 (0x4afc bytes) 2024-09-21T22:01:25.136 INFO:teuthology.orchestra.run.smithi102.stdout:2346 write 0x9205f02 thru 0x920ba9e (0x5b9d bytes) 2024-09-21T22:01:25.139 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.140 INFO:teuthology.orchestra.run.smithi102.stdout:2348 read 0xdbb5ee6 thru 0xdbc3ba2 (0xdcbd bytes) 2024-09-21T22:01:25.140 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.140 INFO:teuthology.orchestra.run.smithi102.stdout:2352 write 0x8209ddb thru 0x8213064 (0x928a bytes) 2024-09-21T22:01:25.143 INFO:teuthology.orchestra.run.smithi102.stdout:2354 write 0x8f04493 thru 0x8f113f1 (0xcf5f bytes) 2024-09-21T22:01:25.146 INFO:teuthology.orchestra.run.smithi102.stdout:2357 writesame 0x2d59b5a thru 0x2d5d7be data_size 0x1(0x3c65 bytes) 2024-09-21T22:01:25.152 INFO:teuthology.orchestra.run.smithi102.stdout:2359 read 0x16f4fbc thru 0x16f6623 (0x1668 bytes) 2024-09-21T22:01:25.152 INFO:teuthology.orchestra.run.smithi102.stdout:2360 read 0x5d3031d thru 0x5d3d7f5 (0xd4d9 bytes) 2024-09-21T22:01:25.153 INFO:teuthology.orchestra.run.smithi102.stdout:2361 read 0xbb55302 thru 0xbb63b1e (0xe81d bytes) 2024-09-21T22:01:25.153 INFO:teuthology.orchestra.run.smithi102.stdout:2362 writesame 0x7a869b9 thru 0x7a93a8b data_size 0x7(0xd0d3 bytes) 2024-09-21T22:01:25.157 INFO:teuthology.orchestra.run.smithi102.stdout:2363 read 0x832128b thru 0x8326adc (0x5852 bytes) 2024-09-21T22:01:25.157 INFO:teuthology.orchestra.run.smithi102.stdout:2364 read 0xd18e89b thru 0xd194566 (0x5ccc bytes) 2024-09-21T22:01:25.158 INFO:teuthology.orchestra.run.smithi102.stdout:2366 writesame 0x5572ada thru 0x5575011 data_size 0xc(0x2538 bytes) 2024-09-21T22:01:25.163 INFO:teuthology.orchestra.run.smithi102.stdout:2367 trunc from 0xe98b452 to 0xb2d2759 2024-09-21T22:01:25.170 INFO:teuthology.orchestra.run.smithi102.stdout:2369 writesame 0x66eb2e5 thru 0x66f2525 data_size 0x1(0x7241 bytes) 2024-09-21T22:01:25.183 INFO:teuthology.orchestra.run.smithi102.stdout:2370 read 0x38b95eb thru 0x38ba921 (0x1337 bytes) 2024-09-21T22:01:25.183 INFO:teuthology.orchestra.run.smithi102.stdout:2371 writesame 0xa5645e4 thru 0xa56f7f8 data_size 0x1(0xb215 bytes) 2024-09-21T22:01:25.204 INFO:teuthology.orchestra.run.smithi102.stdout:2372 write 0x8840dbe thru 0x8849b9e (0x8de1 bytes) 2024-09-21T22:01:25.206 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.206 INFO:teuthology.orchestra.run.smithi102.stdout:2377 punch from 0x755a4a3 to 0x755a7b2, (0x30f bytes) 2024-09-21T22:01:25.206 INFO:teuthology.orchestra.run.smithi102.stdout:2379 write 0xa576f19 thru 0xa580426 (0x950e bytes) 2024-09-21T22:01:25.210 INFO:teuthology.orchestra.run.smithi102.stdout:2381 trunc from 0xb2d2759 to 0xa83a688 2024-09-21T22:01:25.216 INFO:teuthology.orchestra.run.smithi102.stdout:2382 read 0x2608348 thru 0x260d3c9 (0x5082 bytes) 2024-09-21T22:01:25.216 INFO:teuthology.orchestra.run.smithi102.stdout:2384 read 0x49ba3e1 thru 0x49bf5b2 (0x51d2 bytes) 2024-09-21T22:01:25.216 INFO:teuthology.orchestra.run.smithi102.stdout:2385 write 0x8388b43 thru 0x838a174 (0x1632 bytes) 2024-09-21T22:01:25.225 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:25.224+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:25.226 INFO:teuthology.orchestra.run.smithi102.stdout:2387 write 0xbf21b36 thru 0xbf279db (0x5ea6 bytes) 2024-09-21T22:01:25.227 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.227 INFO:teuthology.orchestra.run.smithi102.stdout:2389 read 0x3bc1ee8 thru 0x3bc7506 (0x561f bytes) 2024-09-21T22:01:25.227 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.227 INFO:teuthology.orchestra.run.smithi102.stdout:2392 write 0x5cb44a5 thru 0x5cbbf9f (0x7afb bytes) 2024-09-21T22:01:25.228 INFO:teuthology.orchestra.run.smithi102.stdout:2393 writesame 0x715af61 thru 0x716adf2 data_size 0xbe(0xfe92 bytes) 2024-09-21T22:01:25.230 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.230 INFO:teuthology.orchestra.run.smithi102.stdout:2396 read 0x65e3e30 thru 0x65e782b (0x39fc bytes) 2024-09-21T22:01:25.233 INFO:teuthology.orchestra.run.smithi102.stdout:2398 trunc from 0xbf279dc to 0x98ea46c 2024-09-21T22:01:25.240 INFO:teuthology.orchestra.run.smithi102.stdout:2399 read 0x5f0f5ec thru 0x5f11aa1 (0x24b6 bytes) 2024-09-21T22:01:25.241 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:25.242 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:25.251 INFO:teuthology.orchestra.run.smithi102.stdout:2400 writesame 0xcec0961 thru 0xceccb4f data_size 0x43(0xc1ef bytes) 2024-09-21T22:01:25.252 INFO:teuthology.orchestra.run.smithi102.stdout:2403 punch from 0x936e040 to 0x93770a8, (0x9068 bytes) 2024-09-21T22:01:25.252 INFO:teuthology.orchestra.run.smithi102.stdout:2405 write 0x53941f5 thru 0x539571f (0x152b bytes) 2024-09-21T22:01:25.253 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:25.261 INFO:teuthology.orchestra.run.smithi102.stdout:2406 trunc from 0xceccb50 to 0x6837dea 2024-09-21T22:01:25.274 INFO:teuthology.orchestra.run.smithi102.stdout:2407 read 0x358ce5c thru 0x359c18f (0xf334 bytes) 2024-09-21T22:01:25.274 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.274 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.274 INFO:teuthology.orchestra.run.smithi102.stdout:2410 read 0x510fb8b thru 0x51109ff (0xe75 bytes) 2024-09-21T22:01:25.275 INFO:teuthology.orchestra.run.smithi102.stdout:2411 read 0x16bf676 thru 0x16c70cd (0x7a58 bytes) 2024-09-21T22:01:25.284 INFO:teuthology.orchestra.run.smithi102.stdout:2412 trunc from 0x6837dea to 0xe17cb4a 2024-09-21T22:01:25.289 INFO:teuthology.orchestra.run.smithi102.stdout:2413 write 0xcc0694e thru 0xcc0cc0b (0x62be bytes) 2024-09-21T22:01:25.298 INFO:teuthology.orchestra.run.smithi102.stdout:2414 writesame 0xe1b107f thru 0xe1b65dc data_size 0xe(0x555e bytes) 2024-09-21T22:01:25.298 INFO:teuthology.orchestra.run.smithi102.stdout:2416 punch from 0x8b46108 to 0x8b47618, (0x1510 bytes) 2024-09-21T22:01:25.298 INFO:teuthology.orchestra.run.smithi102.stdout:2417 write 0x9a50705 thru 0x9a58022 (0x791e bytes) 2024-09-21T22:01:25.300 INFO:teuthology.orchestra.run.smithi102.stdout:2418 writesame 0x4001a71 thru 0x4010854 data_size 0x14(0xede4 bytes) 2024-09-21T22:01:25.303 INFO:teuthology.orchestra.run.smithi102.stdout:2419 write 0xb7862a7 thru 0xb78f237 (0x8f91 bytes) 2024-09-21T22:01:25.305 INFO:teuthology.orchestra.run.smithi102.stdout:2420 read 0x8a84c86 thru 0x8a8ae7b (0x61f6 bytes) 2024-09-21T22:01:25.306 INFO:teuthology.orchestra.run.smithi102.stdout:2421 punch from 0x4c314b to 0x4cab02, (0x79b7 bytes) 2024-09-21T22:01:25.306 INFO:teuthology.orchestra.run.smithi102.stdout:2422 writesame 0xaa75350 thru 0xaa7ef1e data_size 0x1(0x9bcf bytes) 2024-09-21T22:01:25.326 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.326 INFO:teuthology.orchestra.run.smithi102.stdout:2425 read 0x1bee6aa thru 0x1bf6b32 (0x8489 bytes) 2024-09-21T22:01:25.326 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:25.324+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:25.326 INFO:teuthology.orchestra.run.smithi102.stdout:2427 write 0xd2c2163 thru 0xd2d0c59 (0xeaf7 bytes) 2024-09-21T22:01:25.329 INFO:teuthology.orchestra.run.smithi102.stdout:2429 read 0x8f42af1 thru 0x8f42f3f (0x44f bytes) 2024-09-21T22:01:25.335 INFO:teuthology.orchestra.run.smithi102.stdout:2430 write 0xe2041bd thru 0xe204ed3 (0xd17 bytes) 2024-09-21T22:01:25.338 INFO:teuthology.orchestra.run.smithi102.stdout:2431 write 0x134a9ca thru 0x13595e4 (0xec1b bytes) 2024-09-21T22:01:25.341 INFO:teuthology.orchestra.run.smithi102.stdout:2433 read 0x2a3d60b thru 0x2a3fb12 (0x2508 bytes) 2024-09-21T22:01:25.342 INFO:teuthology.orchestra.run.smithi102.stdout:2436 trunc from 0xe204ed4 to 0xdbec316 2024-09-21T22:01:25.352 INFO:teuthology.orchestra.run.smithi102.stdout:2437 write 0x9d4798e thru 0x9d53e80 (0xc4f3 bytes) 2024-09-21T22:01:25.353 INFO:teuthology.orchestra.run.smithi102.stdout:2438 write 0x5f8068a thru 0x5f8dd12 (0xd689 bytes) 2024-09-21T22:01:25.355 INFO:teuthology.orchestra.run.smithi102.stdout:2439 read 0xc572e3a thru 0xc5807ca (0xd991 bytes) 2024-09-21T22:01:25.355 INFO:teuthology.orchestra.run.smithi102.stdout:2440 punch from 0xc3c5674 to 0xc3c8efe, (0x388a bytes) 2024-09-21T22:01:25.356 INFO:teuthology.orchestra.run.smithi102.stdout:2441 punch from 0x501e181 to 0x5021459, (0x32d8 bytes) 2024-09-21T22:01:25.356 INFO:teuthology.orchestra.run.smithi102.stdout:2442 write 0x4b81e7 thru 0x4c26f4 (0xa50e bytes) 2024-09-21T22:01:25.357 INFO:teuthology.orchestra.run.smithi102.stdout:2444 writesame 0x463414a thru 0x4635093 data_size 0x1(0xf4a bytes) 2024-09-21T22:01:25.359 INFO:teuthology.orchestra.run.smithi102.stdout:2445 read 0xc913a91 thru 0xc91c3a3 (0x8913 bytes) 2024-09-21T22:01:25.360 INFO:teuthology.orchestra.run.smithi102.stdout:2446 writesame 0x37e7bb5 thru 0x37eb854 data_size 0xa(0x3ca0 bytes) 2024-09-21T22:01:25.362 INFO:teuthology.orchestra.run.smithi102.stdout:2447 write 0xb5b6608 thru 0xb5c191c (0xb315 bytes) 2024-09-21T22:01:25.365 INFO:teuthology.orchestra.run.smithi102.stdout:2448 write 0xce4eed3 thru 0xce4ffcc (0x10fa bytes) 2024-09-21T22:01:25.366 INFO:teuthology.orchestra.run.smithi102.stdout:2449 write 0xb132e82 thru 0xb13ab7c (0x7cfb bytes) 2024-09-21T22:01:25.367 INFO:teuthology.orchestra.run.smithi102.stdout:2450 read 0x63cb8dc thru 0x63d2d56 (0x747b bytes) 2024-09-21T22:01:25.367 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.368 INFO:teuthology.orchestra.run.smithi102.stdout:2452 read 0xb3050d6 thru 0xb30fa05 (0xa930 bytes) 2024-09-21T22:01:25.368 INFO:teuthology.orchestra.run.smithi102.stdout:2454 write 0xcd74790 thru 0xcd7b2af (0x6b20 bytes) 2024-09-21T22:01:25.373 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:25.373 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:25.375 INFO:teuthology.orchestra.run.smithi102.stdout:2458 write 0xe7a9c9f thru 0xe7ad27a (0x35dc bytes) 2024-09-21T22:01:25.378 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.379 INFO:teuthology.orchestra.run.smithi102.stdout:2462 read 0xaa3e4f6 thru 0xaa46577 (0x8082 bytes) 2024-09-21T22:01:25.379 INFO:teuthology.orchestra.run.smithi102.stdout:2463 write 0x9c4b1ba thru 0x9c4b91f (0x766 bytes) 2024-09-21T22:01:25.380 INFO:teuthology.orchestra.run.smithi102.stdout:2466 writesame 0x1c1fae2 thru 0x1c2187d data_size 0xa(0x1d9c bytes) 2024-09-21T22:01:25.382 INFO:teuthology.orchestra.run.smithi102.stdout:2467 writesame 0xbb25064 thru 0xbb27a2a data_size 0xf(0x29c7 bytes) 2024-09-21T22:01:25.383 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:25.383 INFO:teuthology.orchestra.run.smithi102.stdout:2468 writesame 0x862fa1a thru 0x8633031 data_size 0xc(0x3618 bytes) 2024-09-21T22:01:25.385 INFO:teuthology.orchestra.run.smithi102.stdout:2470 writesame 0x4880b3f thru 0x4887cbf data_size 0x7(0x7181 bytes) 2024-09-21T22:01:25.387 INFO:teuthology.orchestra.run.smithi102.stdout:2472 read 0x46737d7 thru 0x467aea8 (0x76d2 bytes) 2024-09-21T22:01:25.388 INFO:teuthology.orchestra.run.smithi102.stdout:2473 write 0x16405da thru 0x164ebb5 (0xe5dc bytes) 2024-09-21T22:01:25.389 INFO:teuthology.orchestra.run.smithi102.stdout:2475 writesame 0xe166b9e thru 0xe16f227 data_size 0x11(0x868a bytes) 2024-09-21T22:01:25.393 INFO:teuthology.orchestra.run.smithi102.stdout:2476 read 0x1401e99 thru 0x140db85 (0xbced bytes) 2024-09-21T22:01:25.393 INFO:teuthology.orchestra.run.smithi102.stdout:2477 read 0xc85e00f thru 0xc86713c (0x912e bytes) 2024-09-21T22:01:25.393 INFO:teuthology.orchestra.run.smithi102.stdout:2478 write 0xaaaf2a3 thru 0xaab7117 (0x7e75 bytes) 2024-09-21T22:01:25.395 INFO:teuthology.orchestra.run.smithi102.stdout:2479 write 0xab2f16f thru 0xab38691 (0x9523 bytes) 2024-09-21T22:01:25.397 INFO:teuthology.orchestra.run.smithi102.stdout:2481 read 0xe3e7fed thru 0xe3ecafd (0x4b11 bytes) 2024-09-21T22:01:25.397 INFO:teuthology.orchestra.run.smithi102.stdout:2482 punch from 0x418bc16 to 0x418e80c, (0x2bf6 bytes) 2024-09-21T22:01:25.397 INFO:teuthology.orchestra.run.smithi102.stdout:2483 write 0x63f1b0d thru 0x63f2894 (0xd88 bytes) 2024-09-21T22:01:25.415 INFO:teuthology.orchestra.run.smithi102.stdout:2485 trunc from 0xe7ad27b to 0x19f27c 2024-09-21T22:01:25.427 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:25.425+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:25.450 INFO:teuthology.orchestra.run.smithi102.stdout:2486 writesame 0xa6c40ea thru 0xa6d34a2 data_size 0x1(0xf3b9 bytes) 2024-09-21T22:01:25.450 INFO:teuthology.orchestra.run.smithi102.stdout:2487 write 0x35cd05 thru 0x36c3d9 (0xf6d5 bytes) 2024-09-21T22:01:25.452 INFO:teuthology.orchestra.run.smithi102.stdout:2488 punch from 0x48c6554 to 0x48c70a9, (0xb55 bytes) 2024-09-21T22:01:25.452 INFO:teuthology.orchestra.run.smithi102.stdout:2490 writesame 0x486f9c8 thru 0x487bf84 data_size 0x1(0xc5bd bytes) 2024-09-21T22:01:25.474 INFO:teuthology.orchestra.run.smithi102.stdout:2493 read 0x9840008 thru 0x9844a88 (0x4a81 bytes) 2024-09-21T22:01:25.474 INFO:teuthology.orchestra.run.smithi102.stdout:2494 punch from 0x4b4bdea to 0x4b5390c, (0x7b22 bytes) 2024-09-21T22:01:25.474 INFO:teuthology.orchestra.run.smithi102.stdout:2496 read 0x85c2ac0 thru 0x85d16ca (0xec0b bytes) 2024-09-21T22:01:25.474 INFO:teuthology.orchestra.run.smithi102.stdout:2498 punch from 0x2ba3f5 to 0x2bade3, (0x9ee bytes) 2024-09-21T22:01:25.474 INFO:teuthology.orchestra.run.smithi102.stdout:2500 write 0x8629587 thru 0x8637a0b (0xe485 bytes) 2024-09-21T22:01:25.482 INFO:teuthology.orchestra.run.smithi102.stdout:2502 trunc from 0xa6d34a3 to 0xe1b7caa 2024-09-21T22:01:25.488 INFO:teuthology.orchestra.run.smithi102.stdout:2503 write 0x391c293 thru 0x392421a (0x7f88 bytes) 2024-09-21T22:01:25.493 INFO:teuthology.orchestra.run.smithi102.stdout:2505 trunc from 0xe1b7caa to 0xbd9e7af 2024-09-21T22:01:25.499 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:25.499 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:25.499 INFO:teuthology.orchestra.run.smithi102.stdout:2506 write 0x8e4c8ee thru 0x8e58004 (0xb717 bytes) 2024-09-21T22:01:25.503 INFO:teuthology.orchestra.run.smithi102.stdout:2507 punch from 0x12581a8 to 0x1264455, (0xc2ad bytes) 2024-09-21T22:01:25.510 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:25.512 INFO:teuthology.orchestra.run.smithi102.stdout:2508 write 0xe11ba04 thru 0xe11dcd6 (0x22d3 bytes) 2024-09-21T22:01:25.515 INFO:teuthology.orchestra.run.smithi102.stdout:2510 read 0x63a04ff thru 0x63a95bd (0x90bf bytes) 2024-09-21T22:01:25.521 INFO:teuthology.orchestra.run.smithi102.stdout:2513 writesame 0xe89d915 thru 0xe8a8ee5 data_size 0x1d(0xb5d1 bytes) 2024-09-21T22:01:25.521 INFO:teuthology.orchestra.run.smithi102.stdout:2515 writesame 0x8a39a1 thru 0x8b1887 data_size 0x17(0xdee7 bytes) 2024-09-21T22:01:25.523 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.523 INFO:teuthology.orchestra.run.smithi102.stdout:2519 read 0x955ee5d thru 0x956d814 (0xe9b8 bytes) 2024-09-21T22:01:25.524 INFO:teuthology.orchestra.run.smithi102.stdout:2520 write 0x291145a thru 0x291d5a0 (0xc147 bytes) 2024-09-21T22:01:25.525 INFO:teuthology.orchestra.run.smithi102.stdout:2521 write 0xcead5ca thru 0xcebc20e (0xec45 bytes) 2024-09-21T22:01:25.528 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:25.526+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:25.528 INFO:teuthology.orchestra.run.smithi102.stdout:2523 writesame 0x113a46a thru 0x113d071 data_size 0x4(0x2c08 bytes) 2024-09-21T22:01:25.530 INFO:teuthology.orchestra.run.smithi102.stdout:2524 writesame 0x4dc84b8 thru 0x4dca825 data_size 0x5(0x236e bytes) 2024-09-21T22:01:25.532 INFO:teuthology.orchestra.run.smithi102.stdout:2525 write 0x398f363 thru 0x399bc0b (0xc8a9 bytes) 2024-09-21T22:01:25.533 INFO:teuthology.orchestra.run.smithi102.stdout:2526 writesame 0xb94b95e thru 0xb94fbf2 data_size 0x5(0x4295 bytes) 2024-09-21T22:01:25.551 INFO:teuthology.orchestra.run.smithi102.stdout:2527 trunc from 0xe8a8ee6 to 0x310870a 2024-09-21T22:01:25.562 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.562 INFO:teuthology.orchestra.run.smithi102.stdout:2529 punch from 0xce4e37 to 0xce7667, (0x2830 bytes) 2024-09-21T22:01:25.564 INFO:teuthology.orchestra.run.smithi102.stdout:2530 trunc from 0x310870a to 0x16bbc78 2024-09-21T22:01:25.588 INFO:teuthology.orchestra.run.smithi102.stdout:2531 write 0xae01866 thru 0xae04279 (0x2a14 bytes) 2024-09-21T22:01:25.593 INFO:teuthology.orchestra.run.smithi102.stdout:2532 trunc from 0xae0427a to 0x8a5d3f7 2024-09-21T22:01:25.599 INFO:teuthology.orchestra.run.smithi102.stdout:2533 read 0x22339a7 thru 0x223e6bc (0xad16 bytes) 2024-09-21T22:01:25.600 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.600 INFO:teuthology.orchestra.run.smithi102.stdout:2536 write 0x6f6c2f9 thru 0x6f73931 (0x7639 bytes) 2024-09-21T22:01:25.610 INFO:teuthology.orchestra.run.smithi102.stdout:2537 write 0xad114c0 thru 0xad20b67 (0xf6a8 bytes) 2024-09-21T22:01:25.614 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.614 INFO:teuthology.orchestra.run.smithi102.stdout:2540 punch from 0xaf9076 to 0xafcfbb, (0x3f45 bytes) 2024-09-21T22:01:25.614 INFO:teuthology.orchestra.run.smithi102.stdout:2541 punch from 0x7fa8396 to 0x7fb3424, (0xb08e bytes) 2024-09-21T22:01:25.614 INFO:teuthology.orchestra.run.smithi102.stdout:2544 read 0x95ea2db thru 0x95f2867 (0x858d bytes) 2024-09-21T22:01:25.614 INFO:teuthology.orchestra.run.smithi102.stdout:2545 read 0x410e341 thru 0x411a9bc (0xc67c bytes) 2024-09-21T22:01:25.621 INFO:teuthology.orchestra.run.smithi102.stdout:2546 trunc from 0xad20b68 to 0x4e59975 2024-09-21T22:01:25.628 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:25.627+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:25.629 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:25.629 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:25.634 INFO:teuthology.orchestra.run.smithi102.stdout:2548 clone 22 order 25 su 4194304 sc 12 2024-09-21T22:01:25.638 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:25.728 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:25.728+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:25.781 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:25.782 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:25.790 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:25.819 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:01:25.834 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:25.833+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:25.930 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:25.929+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:25.932 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:25.932 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:25.941 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:25.953 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-21T22:01:25.969 INFO:teuthology.orchestra.run.smithi102.stdout:2550 read 0x4c8e24f thru 0x4c93381 (0x5133 bytes) 2024-09-21T22:01:25.974 INFO:teuthology.orchestra.run.smithi102.stdout:2551 read 0x118d02a thru 0x1190ec3 (0x3e9a bytes) 2024-09-21T22:01:25.988 INFO:teuthology.orchestra.run.smithi102.stdout:2552 write 0x714ccaf thru 0x7150665 (0x39b7 bytes) 2024-09-21T22:01:25.989 INFO:teuthology.orchestra.run.smithi102.stdout:2553 punch from 0x5735464 to 0x573ce6c, (0x7a08 bytes) 2024-09-21T22:01:25.989 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:25.997 INFO:teuthology.orchestra.run.smithi102.stdout:2555 trunc from 0x7150666 to 0x1850bd 2024-09-21T22:01:26.016 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.028 INFO:teuthology.orchestra.run.smithi102.stdout:2558 write 0x5adb5ed thru 0x5ae5dbf (0xa7d3 bytes) 2024-09-21T22:01:26.031 INFO:teuthology.orchestra.run.smithi102.stdout:2559 read 0x7fb810 thru 0x8060e9 (0xa8da bytes) 2024-09-21T22:01:26.031 INFO:teuthology.orchestra.run.smithi102.stdout:2560 write 0x3a67b6a thru 0x3a76fb2 (0xf449 bytes) 2024-09-21T22:01:26.031 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:26.029+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:26.034 INFO:teuthology.orchestra.run.smithi102.stdout:2563 read 0x315b37e thru 0x3167d25 (0xc9a8 bytes) 2024-09-21T22:01:26.034 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.034 INFO:teuthology.orchestra.run.smithi102.stdout:2567 write 0x32a7a6f thru 0x32b1fe7 (0xa579 bytes) 2024-09-21T22:01:26.035 INFO:teuthology.orchestra.run.smithi102.stdout:2569 read 0x591ee8c thru 0x592e8a7 (0xfa1c bytes) 2024-09-21T22:01:26.036 INFO:teuthology.orchestra.run.smithi102.stdout:2570 write 0x140ef93 thru 0x140f55e (0x5cc bytes) 2024-09-21T22:01:26.039 INFO:teuthology.orchestra.run.smithi102.stdout:2573 punch from 0x225d538 to 0x226c07a, (0xeb42 bytes) 2024-09-21T22:01:26.039 INFO:teuthology.orchestra.run.smithi102.stdout:2574 write 0x3500da4 thru 0x3502404 (0x1661 bytes) 2024-09-21T22:01:26.048 INFO:teuthology.orchestra.run.smithi102.stdout:2576 trunc from 0x5ae5dc0 to 0xba179c1 2024-09-21T22:01:26.053 INFO:teuthology.orchestra.run.smithi102.stdout:2577 write 0x3430793 thru 0x343c969 (0xc1d7 bytes) 2024-09-21T22:01:26.055 INFO:teuthology.orchestra.run.smithi102.stdout:2579 write 0x90cf762 thru 0x90df2f1 (0xfb90 bytes) 2024-09-21T22:01:26.056 INFO:teuthology.orchestra.run.smithi102.stdout:2580 write 0x439126b thru 0x439869d (0x7433 bytes) 2024-09-21T22:01:26.059 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:26.059 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:26.066 INFO:teuthology.orchestra.run.smithi102.stdout:2582 writesame 0xc0fad15 thru 0xc10518b data_size 0x1(0xa477 bytes) 2024-09-21T22:01:26.068 INFO:teuthology.orchestra.run.smithi102.stdout:2583 punch from 0xb44cd53 to 0xb44f6c1, (0x296e bytes) 2024-09-21T22:01:26.068 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.068 INFO:teuthology.orchestra.run.smithi102.stdout:2585 read 0x85e8be0 thru 0x85f5629 (0xca4a bytes) 2024-09-21T22:01:26.068 INFO:teuthology.orchestra.run.smithi102.stdout:2586 write 0xba6cacb thru 0xba6d704 (0xc3a bytes) 2024-09-21T22:01:26.069 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:26.070 INFO:teuthology.orchestra.run.smithi102.stdout:2587 punch from 0x29b76cf to 0x29bc8a8, (0x51d9 bytes) 2024-09-21T22:01:26.070 INFO:teuthology.orchestra.run.smithi102.stdout:2588 write 0x1ab1e59 thru 0x1ab783c (0x59e4 bytes) 2024-09-21T22:01:26.072 INFO:teuthology.orchestra.run.smithi102.stdout:2590 read 0x15436af thru 0x15438fe (0x250 bytes) 2024-09-21T22:01:26.072 INFO:teuthology.orchestra.run.smithi102.stdout:2591 punch from 0x7caee44 to 0x7cbd2a5, (0xe461 bytes) 2024-09-21T22:01:26.073 INFO:teuthology.orchestra.run.smithi102.stdout:2592 read 0xb932b17 thru 0xb937f44 (0x542e bytes) 2024-09-21T22:01:26.073 INFO:teuthology.orchestra.run.smithi102.stdout:2595 read 0x912c4ff thru 0x9139c4d (0xd74f bytes) 2024-09-21T22:01:26.074 INFO:teuthology.orchestra.run.smithi102.stdout:2596 write 0x7bc716b thru 0x7bce01e (0x6eb4 bytes) 2024-09-21T22:01:26.074 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.074 INFO:teuthology.orchestra.run.smithi102.stdout:2600 writesame 0x33bd6de thru 0x33c2dc7 data_size 0x19(0x56ea bytes) 2024-09-21T22:01:26.090 INFO:teuthology.orchestra.run.smithi102.stdout:2601 trunc from 0xc10518c to 0x61fce7 2024-09-21T22:01:26.125 INFO:teuthology.orchestra.run.smithi102.stdout:2603 writesame 0x86283f6 thru 0x863084b data_size 0xd(0x8456 bytes) 2024-09-21T22:01:26.125 INFO:teuthology.orchestra.run.smithi102.stdout:2605 read 0x344ecda thru 0x3457a1c (0x8d43 bytes) 2024-09-21T22:01:26.125 INFO:teuthology.orchestra.run.smithi102.stdout:2606 read 0x12399fa thru 0x1247827 (0xde2e bytes) 2024-09-21T22:01:26.125 INFO:teuthology.orchestra.run.smithi102.stdout:2608 punch from 0x5c59ca0 to 0x5c60bc0, (0x6f20 bytes) 2024-09-21T22:01:26.125 INFO:teuthology.orchestra.run.smithi102.stdout:2610 read 0x7b48b6c thru 0x7b4acdc (0x2171 bytes) 2024-09-21T22:01:26.127 INFO:teuthology.orchestra.run.smithi102.stdout:2611 trunc from 0x863084c to 0x720dd89 2024-09-21T22:01:26.131 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.132 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:26.130+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:26.137 INFO:teuthology.orchestra.run.smithi102.stdout:2614 write 0x7a6146a thru 0x7a692c7 (0x7e5e bytes) 2024-09-21T22:01:26.139 INFO:teuthology.orchestra.run.smithi102.stdout:2615 write 0x43d9faa thru 0x43de480 (0x44d7 bytes) 2024-09-21T22:01:26.142 INFO:teuthology.orchestra.run.smithi102.stdout:2616 write 0x3bfd89d thru 0x3bffbdd (0x2341 bytes) 2024-09-21T22:01:26.145 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.157 INFO:teuthology.orchestra.run.smithi102.stdout:2618 write 0xd8b879c thru 0xd8bf4d8 (0x6d3d bytes) 2024-09-21T22:01:26.158 INFO:teuthology.orchestra.run.smithi102.stdout:2619 writesame 0xb542c78 thru 0xb550af9 data_size 0x13(0xde82 bytes) 2024-09-21T22:01:26.162 INFO:teuthology.orchestra.run.smithi102.stdout:2620 write 0x89ffbf7 thru 0x8a023fa (0x2804 bytes) 2024-09-21T22:01:26.164 INFO:teuthology.orchestra.run.smithi102.stdout:2621 writesame 0x14c9b1b thru 0x14cd370 data_size 0x1(0x3856 bytes) 2024-09-21T22:01:26.173 INFO:teuthology.orchestra.run.smithi102.stdout:2622 write 0x4670587 thru 0x4679b05 (0x957f bytes) 2024-09-21T22:01:26.181 INFO:teuthology.orchestra.run.smithi102.stdout:2623 write 0xea9e96f thru 0xeaa0282 (0x1914 bytes) 2024-09-21T22:01:26.182 INFO:teuthology.orchestra.run.smithi102.stdout:2624 writesame 0xb6eafed thru 0xb6f12b5 data_size 0x13(0x62c9 bytes) 2024-09-21T22:01:26.184 INFO:teuthology.orchestra.run.smithi102.stdout:2625 write 0x1507cfa thru 0x1513476 (0xb77d bytes) 2024-09-21T22:01:26.185 INFO:teuthology.orchestra.run.smithi102.stdout:2626 write 0x254e63e thru 0x2557f21 (0x98e4 bytes) 2024-09-21T22:01:26.187 INFO:teuthology.orchestra.run.smithi102.stdout:2628 write 0x19fec64 thru 0x1a0b4ce (0xc86b bytes) 2024-09-21T22:01:26.188 INFO:teuthology.orchestra.run.smithi102.stdout:2629 write 0xbcd40c3 thru 0xbcd44e4 (0x422 bytes) 2024-09-21T22:01:26.190 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:26.191 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:26.191 INFO:teuthology.orchestra.run.smithi102.stdout:2630 write 0x274c46b thru 0x2757c1d (0xb7b3 bytes) 2024-09-21T22:01:26.192 INFO:teuthology.orchestra.run.smithi102.stdout:2631 write 0x2501ee3 thru 0x2505911 (0x3a2f bytes) 2024-09-21T22:01:26.193 INFO:teuthology.orchestra.run.smithi102.stdout:2632 write 0xadf7c thru 0xb3189 (0x520e bytes) 2024-09-21T22:01:26.195 INFO:teuthology.orchestra.run.smithi102.stdout:2633 punch from 0x1cc3b29 to 0x1cc75ea, (0x3ac1 bytes) 2024-09-21T22:01:26.195 INFO:teuthology.orchestra.run.smithi102.stdout:2634 punch from 0xb166298 to 0xb16f295, (0x8ffd bytes) 2024-09-21T22:01:26.195 INFO:teuthology.orchestra.run.smithi102.stdout:2635 write 0x57ea234 thru 0x57ed6bf (0x348c bytes) 2024-09-21T22:01:26.197 INFO:teuthology.orchestra.run.smithi102.stdout:2636 writesame 0xa56b99e thru 0xa5706d9 data_size 0x2(0x4d3c bytes) 2024-09-21T22:01:26.200 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:26.202 INFO:teuthology.orchestra.run.smithi102.stdout:2639 write 0xb3e36aa thru 0xb3ea176 (0x6acd bytes) 2024-09-21T22:01:26.213 INFO:teuthology.orchestra.run.smithi102.stdout:2641 trunc from 0xeaa0283 to 0x7c72e20 2024-09-21T22:01:26.221 INFO:teuthology.orchestra.run.smithi102.stdout:2642 punch from 0x41e3099 to 0x41e33b7, (0x31e bytes) 2024-09-21T22:01:26.221 INFO:teuthology.orchestra.run.smithi102.stdout:2643 write 0x603e5ad thru 0x604aaf8 (0xc54c bytes) 2024-09-21T22:01:26.222 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.224 INFO:teuthology.orchestra.run.smithi102.stdout:2645 trunc from 0x7c72e20 to 0x97a0ca3 2024-09-21T22:01:26.229 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.231 INFO:teuthology.orchestra.run.smithi102.stdout:2647 trunc from 0x97a0ca3 to 0xb126b65 2024-09-21T22:01:26.232 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:26.231+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:26.236 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.236 INFO:teuthology.orchestra.run.smithi102.stdout:2650 write 0x62af62d thru 0x62b367f (0x4053 bytes) 2024-09-21T22:01:26.238 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.238 INFO:teuthology.orchestra.run.smithi102.stdout:2652 punch from 0x5ce14c to 0x5d4d27, (0x6bdb bytes) 2024-09-21T22:01:26.238 INFO:teuthology.orchestra.run.smithi102.stdout:2653 write 0xd9b79c thru 0xdaa89c (0xf101 bytes) 2024-09-21T22:01:26.241 INFO:teuthology.orchestra.run.smithi102.stdout:2655 read 0x713a036 thru 0x713e056 (0x4021 bytes) 2024-09-21T22:01:26.242 INFO:teuthology.orchestra.run.smithi102.stdout:2656 trunc from 0xb126b65 to 0xa367617 2024-09-21T22:01:26.249 INFO:teuthology.orchestra.run.smithi102.stdout:2657 writesame 0x4518223 thru 0x451a628 data_size 0x6(0x2406 bytes) 2024-09-21T22:01:26.251 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.251 INFO:teuthology.orchestra.run.smithi102.stdout:2659 write 0x3c1a46a thru 0x3c1ca6d (0x2604 bytes) 2024-09-21T22:01:26.263 INFO:teuthology.orchestra.run.smithi102.stdout:2661 write 0xec32f2e thru 0xec397f2 (0x68c5 bytes) 2024-09-21T22:01:26.265 INFO:teuthology.orchestra.run.smithi102.stdout:2662 write 0x7df05b2 thru 0x7df627c (0x5ccb bytes) 2024-09-21T22:01:26.268 INFO:teuthology.orchestra.run.smithi102.stdout:2663 write 0xb9a5599 thru 0xb9b20fa (0xcb62 bytes) 2024-09-21T22:01:26.272 INFO:teuthology.orchestra.run.smithi102.stdout:2664 trunc from 0xec397f3 to 0xc9a13f9 2024-09-21T22:01:26.279 INFO:teuthology.orchestra.run.smithi102.stdout:2665 read 0x1583da8 thru 0x158b2fc (0x7555 bytes) 2024-09-21T22:01:26.279 INFO:teuthology.orchestra.run.smithi102.stdout:2666 read 0x88b3065 thru 0x88b35aa (0x546 bytes) 2024-09-21T22:01:26.280 INFO:teuthology.orchestra.run.smithi102.stdout:2667 punch from 0x5b6854 to 0x5c2815, (0xbfc1 bytes) 2024-09-21T22:01:26.280 INFO:teuthology.orchestra.run.smithi102.stdout:2668 read 0x4321d97 thru 0x43223c1 (0x62b bytes) 2024-09-21T22:01:26.286 INFO:teuthology.orchestra.run.smithi102.stdout:2669 write 0xdb78342 thru 0xdb7e75a (0x6419 bytes) 2024-09-21T22:01:26.294 INFO:teuthology.orchestra.run.smithi102.stdout:2670 trunc from 0xdb7e75b to 0x8717bb7 2024-09-21T22:01:26.303 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.306 INFO:teuthology.orchestra.run.smithi102.stdout:2672 trunc from 0x8717bb7 to 0x5cdad5a 2024-09-21T22:01:26.323 INFO:teuthology.orchestra.run.smithi102.stdout:2674 write 0x95a9003 thru 0x95aa157 (0x1155 bytes) 2024-09-21T22:01:26.324 INFO:teuthology.orchestra.run.smithi102.stdout:2675 punch from 0x2a6bc52 to 0x2a72bdf, (0x6f8d bytes) 2024-09-21T22:01:26.324 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:26.325 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:26.325 INFO:teuthology.orchestra.run.smithi102.stdout:2679 flatten 2024-09-21T22:01:26.329 INFO:teuthology.orchestra.run.smithi102.stdout:2681 read 0x4bdea61 thru 0x4be422f (0x57cf bytes) 2024-09-21T22:01:26.330 INFO:teuthology.orchestra.run.smithi102.stdout:2682 read 0x7ccf012 thru 0x7cdc89f (0xd88e bytes) 2024-09-21T22:01:26.330 INFO:teuthology.orchestra.run.smithi102.stdout:2683 punch from 0x6e8a873 to 0x6e8c8e2, (0x206f bytes) 2024-09-21T22:01:26.330 INFO:teuthology.orchestra.run.smithi102.stdout:2684 read 0x342d266 thru 0x3432df8 (0x5b93 bytes) 2024-09-21T22:01:26.331 INFO:teuthology.orchestra.run.smithi102.stdout:2685 punch from 0x495a92 to 0x4a1da1, (0xc30f bytes) 2024-09-21T22:01:26.331 INFO:teuthology.orchestra.run.smithi102.stdout:2686 read 0x2ed33e3 thru 0x2ed9e59 (0x6a77 bytes) 2024-09-21T22:01:26.331 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.332 INFO:teuthology.orchestra.run.smithi102.stdout:2689 punch from 0x496c64a to 0x4979b9b, (0xd551 bytes) 2024-09-21T22:01:26.332 INFO:teuthology.orchestra.run.smithi102.stdout:2690 read 0x9148339 thru 0x914e17b (0x5e43 bytes) 2024-09-21T22:01:26.332 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.332 INFO:teuthology.orchestra.run.smithi102.stdout:2693 write 0xae57cc thru 0xaea7c1 (0x4ff6 bytes) 2024-09-21T22:01:26.332 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:26.332+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:26.333 INFO:teuthology.orchestra.run.smithi102.stdout:2695 write 0x48cab34 thru 0x48ce6f7 (0x3bc4 bytes) 2024-09-21T22:01:26.334 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:26.334 INFO:teuthology.orchestra.run.smithi102.stdout:2696 write 0x3331c3f thru 0x3340b18 (0xeeda bytes) 2024-09-21T22:01:26.347 INFO:teuthology.orchestra.run.smithi102.stdout:2697 trunc from 0x95aa158 to 0x7316e1 2024-09-21T22:01:26.383 INFO:teuthology.orchestra.run.smithi102.stdout:2699 write 0x1f44f2f thru 0x1f459be (0xa90 bytes) 2024-09-21T22:01:26.385 INFO:teuthology.orchestra.run.smithi102.stdout:2700 read 0x1de634e thru 0x1df47bd (0xe470 bytes) 2024-09-21T22:01:26.386 INFO:teuthology.orchestra.run.smithi102.stdout:2701 read 0x1736d46 thru 0x174687c (0xfb37 bytes) 2024-09-21T22:01:26.386 INFO:teuthology.orchestra.run.smithi102.stdout:2702 read 0x1b2b0ba thru 0x1b2e137 (0x307e bytes) 2024-09-21T22:01:26.386 INFO:teuthology.orchestra.run.smithi102.stdout:2704 punch from 0x1b67029 to 0x1b6cfda, (0x5fb1 bytes) 2024-09-21T22:01:26.386 INFO:teuthology.orchestra.run.smithi102.stdout:2705 read 0x897866 thru 0x89b7b3 (0x3f4e bytes) 2024-09-21T22:01:26.390 INFO:teuthology.orchestra.run.smithi102.stdout:2707 trunc from 0x1f459bf to 0x55745db 2024-09-21T22:01:26.395 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.400 INFO:teuthology.orchestra.run.smithi102.stdout:2709 writesame 0x5d2a916 thru 0x5d3243e data_size 0x1(0x7b29 bytes) 2024-09-21T22:01:26.408 INFO:teuthology.orchestra.run.smithi102.stdout:2714 write 0x717a7df thru 0x71888c5 (0xe0e7 bytes) 2024-09-21T22:01:26.411 INFO:teuthology.orchestra.run.smithi102.stdout:2715 punch from 0x55dd213 to 0x55ec8b0, (0xf69d bytes) 2024-09-21T22:01:26.412 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.412 INFO:teuthology.orchestra.run.smithi102.stdout:2717 punch from 0x43a429f to 0x43a73b6, (0x3117 bytes) 2024-09-21T22:01:26.412 INFO:teuthology.orchestra.run.smithi102.stdout:2718 writesame 0x55bb0ed thru 0x55bff22 data_size 0x5e(0x4e36 bytes) 2024-09-21T22:01:26.422 INFO:teuthology.orchestra.run.smithi102.stdout:2719 trunc from 0x71888c6 to 0x1fc17dc 2024-09-21T22:01:26.434 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:26.433+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:26.443 INFO:teuthology.orchestra.run.smithi102.stdout:2720 writesame 0x63c1100 thru 0x63ca886 data_size 0x1(0x9787 bytes) 2024-09-21T22:01:26.448 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:26.448 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:26.450 INFO:teuthology.orchestra.run.smithi102.stdout:2723 writesame 0x7664336 thru 0x766bb61 data_size 0x2(0x782c bytes) 2024-09-21T22:01:26.450 INFO:teuthology.orchestra.run.smithi102.stdout:2725 write 0x4377e45 thru 0x4382af2 (0xacae bytes) 2024-09-21T22:01:26.452 INFO:teuthology.orchestra.run.smithi102.stdout:2726 writesame 0x158d5d thru 0x15ded4 data_size 0x58(0x5178 bytes) 2024-09-21T22:01:26.453 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.453 INFO:teuthology.orchestra.run.smithi102.stdout:2728 punch from 0x6cf13fa to 0x6cfadac, (0x99b2 bytes) 2024-09-21T22:01:26.453 INFO:teuthology.orchestra.run.smithi102.stdout:2729 read 0x5e202ac thru 0x5e25991 (0x56e6 bytes) 2024-09-21T22:01:26.458 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:26.466 INFO:teuthology.orchestra.run.smithi102.stdout:2730 write 0xde77085 thru 0xde817a4 (0xa720 bytes) 2024-09-21T22:01:26.467 INFO:teuthology.orchestra.run.smithi102.stdout:2731 write 0x921e1e0 thru 0x9224335 (0x6156 bytes) 2024-09-21T22:01:26.468 INFO:teuthology.orchestra.run.smithi102.stdout:2733 write 0x67fe774 thru 0x68048ea (0x6177 bytes) 2024-09-21T22:01:26.471 INFO:teuthology.orchestra.run.smithi102.stdout:2734 punch from 0xcd6a13c to 0xcd6cb77, (0x2a3b bytes) 2024-09-21T22:01:26.471 INFO:teuthology.orchestra.run.smithi102.stdout:2735 read 0xdd81676 thru 0xdd87a49 (0x63d4 bytes) 2024-09-21T22:01:26.472 INFO:teuthology.orchestra.run.smithi102.stdout:2736 write 0xb83864f thru 0xb83e8da (0x628c bytes) 2024-09-21T22:01:26.474 INFO:teuthology.orchestra.run.smithi102.stdout:2737 write 0x4468c11 thru 0x4472f5a (0xa34a bytes) 2024-09-21T22:01:26.477 INFO:teuthology.orchestra.run.smithi102.stdout:2738 punch from 0x2ddaf45 to 0x2de621f, (0xb2da bytes) 2024-09-21T22:01:26.477 INFO:teuthology.orchestra.run.smithi102.stdout:2739 write 0x320d485 thru 0x3219054 (0xbbd0 bytes) 2024-09-21T22:01:26.479 INFO:teuthology.orchestra.run.smithi102.stdout:2740 punch from 0xbaec28f to 0xbafbb6a, (0xf8db bytes) 2024-09-21T22:01:26.482 INFO:teuthology.orchestra.run.smithi102.stdout:2741 trunc from 0xde817a5 to 0xa9b31e7 2024-09-21T22:01:26.489 INFO:teuthology.orchestra.run.smithi102.stdout:2742 punch from 0x2643119 to 0x2649b06, (0x69ed bytes) 2024-09-21T22:01:26.490 INFO:teuthology.orchestra.run.smithi102.stdout:2743 read 0xadad2e thru 0xadc962 (0x1c35 bytes) 2024-09-21T22:01:26.490 INFO:teuthology.orchestra.run.smithi102.stdout:2744 write 0x98ab624 thru 0x98b8ce5 (0xd6c2 bytes) 2024-09-21T22:01:26.501 INFO:teuthology.orchestra.run.smithi102.stdout:2745 trunc from 0xa9b31e7 to 0x210873d 2024-09-21T22:01:26.526 INFO:teuthology.orchestra.run.smithi102.stdout:2746 writesame 0x9bb6f41 thru 0x9bbd277 data_size 0x1(0x6337 bytes) 2024-09-21T22:01:26.527 INFO:teuthology.orchestra.run.smithi102.stdout:2748 write 0x3af49 thru 0x3dca1 (0x2d59 bytes) 2024-09-21T22:01:26.528 INFO:teuthology.orchestra.run.smithi102.stdout:2749 write 0x92b5237 thru 0x92bf983 (0xa74d bytes) 2024-09-21T22:01:26.535 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:26.534+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:26.535 INFO:teuthology.orchestra.run.smithi102.stdout:2750 trunc from 0x9bbd278 to 0x4d95d9b 2024-09-21T22:01:26.544 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.544 INFO:teuthology.orchestra.run.smithi102.stdout:2754 writesame 0x1edfdb6 thru 0x1ee38b9 data_size 0x6(0x3b04 bytes) 2024-09-21T22:01:26.550 INFO:teuthology.orchestra.run.smithi102.stdout:2755 write 0x4f76b6e thru 0x4f78c51 (0x20e4 bytes) 2024-09-21T22:01:26.558 INFO:teuthology.orchestra.run.smithi102.stdout:2757 write 0x6066ecc thru 0x6069602 (0x2737 bytes) 2024-09-21T22:01:26.559 INFO:teuthology.orchestra.run.smithi102.stdout:2758 writesame 0x3eb6ff thru 0x3f10cd data_size 0x1(0x59cf bytes) 2024-09-21T22:01:26.565 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:26.565 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:26.570 INFO:teuthology.orchestra.run.smithi102.stdout:2759 read 0x2f88e16 thru 0x2f953de (0xc5c9 bytes) 2024-09-21T22:01:26.570 INFO:teuthology.orchestra.run.smithi102.stdout:2760 punch from 0x3b175a1 to 0x3b21aa7, (0xa506 bytes) 2024-09-21T22:01:26.570 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:26.581 INFO:teuthology.orchestra.run.smithi102.stdout:2762 write 0xac1d9a1 thru 0xac2b1e0 (0xd840 bytes) 2024-09-21T22:01:26.582 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.582 INFO:teuthology.orchestra.run.smithi102.stdout:2764 writesame 0x9285f73 thru 0x92939ab data_size 0x1(0xda39 bytes) 2024-09-21T22:01:26.606 INFO:teuthology.orchestra.run.smithi102.stdout:2765 write 0x1345fdf thru 0x1353884 (0xd8a6 bytes) 2024-09-21T22:01:26.612 INFO:teuthology.orchestra.run.smithi102.stdout:2766 trunc from 0xac2b1e1 to 0xdee4170 2024-09-21T22:01:26.617 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.618 INFO:teuthology.orchestra.run.smithi102.stdout:2768 read 0xa0a5b6c thru 0xa0b4e38 (0xf2cd bytes) 2024-09-21T22:01:26.618 INFO:teuthology.orchestra.run.smithi102.stdout:2769 read 0xdd9bf1c thru 0xdd9c6ce (0x7b3 bytes) 2024-09-21T22:01:26.618 INFO:teuthology.orchestra.run.smithi102.stdout:2770 read 0x71f2cb6 thru 0x7201fc3 (0xf30e bytes) 2024-09-21T22:01:26.619 INFO:teuthology.orchestra.run.smithi102.stdout:2771 write 0xd7ca1c9 thru 0xd7d639a (0xc1d2 bytes) 2024-09-21T22:01:26.620 INFO:teuthology.orchestra.run.smithi102.stdout:2773 read 0x67d560e thru 0x67e0dac (0xb79f bytes) 2024-09-21T22:01:26.620 INFO:teuthology.orchestra.run.smithi102.stdout:2774 read 0x5c087e2 thru 0x5c0922a (0xa49 bytes) 2024-09-21T22:01:26.621 INFO:teuthology.orchestra.run.smithi102.stdout:2775 writesame 0x3b143 thru 0x3f57d data_size 0x1(0x443b bytes) 2024-09-21T22:01:26.621 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:26.629 INFO:teuthology.orchestra.run.smithi102.stdout:2777 punch from 0xbae22bf to 0xbaf1acc, (0xf80d bytes) 2024-09-21T22:01:26.630 INFO:teuthology.orchestra.run.smithi102.stdout:2779 write 0x4ac813e thru 0x4acb79c (0x365f bytes) 2024-09-21T22:01:26.636 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:26.635+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:26.639 INFO:teuthology.orchestra.run.smithi102.stdout:2781 write 0xe6d3a25 thru 0xe6db560 (0x7b3c bytes) 2024-09-21T22:01:26.641 INFO:teuthology.orchestra.run.smithi102.stdout:2782 read 0x9bf8bf0 thru 0x9c065c2 (0xd9d3 bytes) 2024-09-21T22:01:26.642 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.642 INFO:teuthology.orchestra.run.smithi102.stdout:2785 punch from 0x4f7db5f to 0x4f887ec, (0xac8d bytes) 2024-09-21T22:01:26.646 INFO:teuthology.orchestra.run.smithi102.stdout:2786 trunc from 0xe6db561 to 0xb37d8e5 2024-09-21T22:01:26.653 INFO:teuthology.orchestra.run.smithi102.stdout:2789 write 0x704bb7c thru 0x704cfca (0x144f bytes) 2024-09-21T22:01:26.654 INFO:teuthology.orchestra.run.smithi102.stdout:2790 writesame 0x67229b4 thru 0x672a780 data_size 0x5f(0x7dcd bytes) 2024-09-21T22:01:26.663 INFO:teuthology.orchestra.run.smithi102.stdout:2791 trunc from 0xb37d8e5 to 0x5417715 2024-09-21T22:01:26.679 INFO:teuthology.orchestra.run.smithi102.stdout:2792 write 0x84e3819 thru 0x84f0240 (0xca28 bytes) 2024-09-21T22:01:26.681 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:26.681 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:26.690 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:26.691 INFO:teuthology.orchestra.run.smithi102.stdout:2793 trunc from 0x84f0241 to 0xb79627 2024-09-21T22:01:26.705 INFO:teuthology.orchestra.run.smithi102.stdout:2795 read 0x550924 thru 0x55c081 (0xb75e bytes) 2024-09-21T22:01:26.721 INFO:teuthology.orchestra.run.smithi102.stdout:2796 write 0x8fcf8f1 thru 0x8fd16ad (0x1dbd bytes) 2024-09-21T22:01:26.724 INFO:teuthology.orchestra.run.smithi102.stdout:2798 punch from 0x483e0d8 to 0x4847208, (0x9130 bytes) 2024-09-21T22:01:26.724 INFO:teuthology.orchestra.run.smithi102.stdout:2799 write 0x44941a1 thru 0x44a2e65 (0xecc5 bytes) 2024-09-21T22:01:26.728 INFO:teuthology.orchestra.run.smithi102.stdout:2800 punch from 0x5ed0e57 to 0x5ed393c, (0x2ae5 bytes) 2024-09-21T22:01:26.728 INFO:teuthology.orchestra.run.smithi102.stdout:2802 read 0x2bc3f32 thru 0x2bcb144 (0x7213 bytes) 2024-09-21T22:01:26.728 INFO:teuthology.orchestra.run.smithi102.stdout:2804 read 0xc841e3 thru 0xc8946c (0x528a bytes) 2024-09-21T22:01:26.728 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.728 INFO:teuthology.orchestra.run.smithi102.stdout:2806 read 0x896fb16 thru 0x897c6d6 (0xcbc1 bytes) 2024-09-21T22:01:26.728 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.731 INFO:teuthology.orchestra.run.smithi102.stdout:2808 trunc from 0x8fd16ae to 0xbb2c726 2024-09-21T22:01:26.736 INFO:teuthology.orchestra.run.smithi102.stdout:2810 write 0x5fc4231 thru 0x5fcd717 (0x94e7 bytes) 2024-09-21T22:01:26.736 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:26.735+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:26.738 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.738 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.738 INFO:teuthology.orchestra.run.smithi102.stdout:2813 punch from 0x8d3bc8a to 0x8d3e334, (0x26aa bytes) 2024-09-21T22:01:26.738 INFO:teuthology.orchestra.run.smithi102.stdout:2814 writesame 0x9e458db thru 0x9e4fc4a data_size 0x28(0xa370 bytes) 2024-09-21T22:01:26.741 INFO:teuthology.orchestra.run.smithi102.stdout:2815 read 0x86a2d0c thru 0x86b0e63 (0xe158 bytes) 2024-09-21T22:01:26.741 INFO:teuthology.orchestra.run.smithi102.stdout:2816 read 0x3441522 thru 0x34431fc (0x1cdb bytes) 2024-09-21T22:01:26.743 INFO:teuthology.orchestra.run.smithi102.stdout:2817 trunc from 0xbb2c726 to 0xa1496dd 2024-09-21T22:01:26.750 INFO:teuthology.orchestra.run.smithi102.stdout:2818 read 0x1d83da2 thru 0x1d93517 (0xf776 bytes) 2024-09-21T22:01:26.750 INFO:teuthology.orchestra.run.smithi102.stdout:2820 writesame 0x97501fe thru 0x975e909 data_size 0xba(0xe70c bytes) 2024-09-21T22:01:26.752 INFO:teuthology.orchestra.run.smithi102.stdout:2822 trunc from 0xa1496dd to 0xac25cac 2024-09-21T22:01:26.758 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:26.758 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:26.763 INFO:teuthology.orchestra.run.smithi102.stdout:2823 write 0xb05a025 thru 0xb06276a (0x8746 bytes) 2024-09-21T22:01:26.766 INFO:teuthology.orchestra.run.smithi102.stdout:2826 writesame 0x332d25a thru 0x3339001 data_size 0x54(0xbda8 bytes) 2024-09-21T22:01:26.768 INFO:teuthology.orchestra.run.smithi102.stdout:2829 write 0x1863c7a thru 0x186edbb (0xb142 bytes) 2024-09-21T22:01:26.771 INFO:teuthology.orchestra.run.smithi102.stdout:2830 punch from 0x8bb304a to 0x8bbdcff, (0xacb5 bytes) 2024-09-21T22:01:26.771 INFO:teuthology.orchestra.run.smithi102.stdout:2831 read 0x5abc277 thru 0x5ac878b (0xc515 bytes) 2024-09-21T22:01:26.777 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:26.778 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:26.783 INFO:teuthology.orchestra.run.smithi102.stdout:2833 trunc from 0xb06276b to 0x18c96f2 2024-09-21T22:01:26.796 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:26.796 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:26.799 INFO:teuthology.orchestra.run.smithi102.stdout:2834 read 0x1271c21 thru 0x127bbf4 (0x9fd4 bytes) 2024-09-21T22:01:26.800 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:26.801 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:26.810 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:26.814 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:26.814 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:26.814 INFO:teuthology.orchestra.run.smithi102.stdout:2838 write 0x9628a42 thru 0x9637405 (0xe9c4 bytes) 2024-09-21T22:01:26.826 INFO:teuthology.orchestra.run.smithi102.stdout:2839 trunc from 0x9637406 to 0x263e117 2024-09-21T22:01:26.833 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.846 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:26.847 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:26.850 INFO:teuthology.orchestra.run.smithi102.stdout:2841 writesame 0xa387e36 thru 0xa38dd23 data_size 0x1d(0x5eee bytes) 2024-09-21T22:01:26.850 INFO:teuthology.orchestra.run.smithi102.stdout:2843 punch from 0x6766d3f to 0x6776b84, (0xfe45 bytes) 2024-09-21T22:01:26.853 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:26.851+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:26.857 INFO:teuthology.orchestra.run.smithi102.stdout:2844 writesame 0xc63fefe thru 0xc64ac99 data_size 0x52(0xad9c bytes) 2024-09-21T22:01:26.858 INFO:teuthology.orchestra.run.smithi102.stdout:2845 write 0x1ae0b53 thru 0x1ae0bdf (0x8d bytes) 2024-09-21T22:01:26.860 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.860 INFO:teuthology.orchestra.run.smithi102.stdout:2847 write 0x1a59439 thru 0x1a59c72 (0x83a bytes) 2024-09-21T22:01:26.861 INFO:teuthology.orchestra.run.smithi102.stdout:2848 write 0x965e94b thru 0x966b16e (0xc824 bytes) 2024-09-21T22:01:26.865 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:26.865 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:26.876 INFO:teuthology.orchestra.run.smithi102.stdout:2849 trunc from 0xc64ac9a to 0x23dfacf 2024-09-21T22:01:26.896 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:26.896 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:26.899 INFO:teuthology.orchestra.run.smithi102.stdout:2852 writesame 0x94effee thru 0x94ff5ff data_size 0x3(0xf612 bytes) 2024-09-21T22:01:26.900 INFO:teuthology.orchestra.run.smithi102.stdout:2853 read 0x7a88314 thru 0x7a93834 (0xb521 bytes) 2024-09-21T22:01:26.900 INFO:teuthology.orchestra.run.smithi102.stdout:2854 write 0x2671457 thru 0x267e02e (0xcbd8 bytes) 2024-09-21T22:01:26.905 INFO:teuthology.orchestra.run.smithi102.stdout:2856 write 0x742afc8 thru 0x742ee07 (0x3e40 bytes) 2024-09-21T22:01:26.912 INFO:teuthology.orchestra.run.smithi102.stdout:2859 writesame 0xa0ed1e0 thru 0xa0efacf data_size 0x28(0x28f0 bytes) 2024-09-21T22:01:26.915 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:26.916 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:26.918 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:26.918 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:26.918 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:26.918 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:26.918 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:26.922 INFO:teuthology.orchestra.run.smithi102.stdout:2860 writesame 0xe2cb34c thru 0xe2d55a3 data_size 0x14(0xa258 bytes) 2024-09-21T22:01:26.922 INFO:teuthology.orchestra.run.smithi102.stdout:2861 read 0x9978290 thru 0x997cce0 (0x4a51 bytes) 2024-09-21T22:01:26.922 INFO:teuthology.orchestra.run.smithi102.stdout:2862 punch from 0xd4f4428 to 0xd4fcc44, (0x881c bytes) 2024-09-21T22:01:26.922 INFO:teuthology.orchestra.run.smithi102.stdout:2865 punch from 0xe068d97 to 0xe074b1a, (0xbd83 bytes) 2024-09-21T22:01:26.922 INFO:teuthology.orchestra.run.smithi102.stdout:2867 writesame 0xecfbcd thru 0xed52b8 data_size 0x2(0x56ec bytes) 2024-09-21T22:01:26.927 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:26.928 INFO:teuthology.orchestra.run.smithi102.stdout:2868 write 0x453c720 thru 0x4546f21 (0xa802 bytes) 2024-09-21T22:01:26.929 INFO:teuthology.orchestra.run.smithi102.stdout:2869 write 0x5fe7231 thru 0x5ff0bb9 (0x9989 bytes) 2024-09-21T22:01:26.932 INFO:teuthology.orchestra.run.smithi102.stdout:2870 writesame 0xbc81e6e thru 0xbc85e3f data_size 0x15(0x3fd2 bytes) 2024-09-21T22:01:26.934 INFO:teuthology.orchestra.run.smithi102.stdout:2873 read 0xb283ccd thru 0xb288bb9 (0x4eed bytes) 2024-09-21T22:01:26.934 INFO:teuthology.orchestra.run.smithi102.stdout:2874 write 0x326b8e3 thru 0x326d35b (0x1a79 bytes) 2024-09-21T22:01:26.935 INFO:teuthology.orchestra.run.smithi102.stdout:2877 writesame 0x4208475 thru 0x4211003 data_size 0x1(0x8b8f bytes) 2024-09-21T22:01:26.938 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:26.937+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:26.950 INFO:teuthology.orchestra.run.smithi102.stdout:2878 read 0xdbdf8ae thru 0xdbe0b9a (0x12ed bytes) 2024-09-21T22:01:26.950 INFO:teuthology.orchestra.run.smithi102.stdout:2879 read 0x970bd72 thru 0x971b6b9 (0xf948 bytes) 2024-09-21T22:01:26.950 INFO:teuthology.orchestra.run.smithi102.stdout:2880 punch from 0xdadbabf to 0xdae3fe8, (0x8529 bytes) 2024-09-21T22:01:26.950 INFO:teuthology.orchestra.run.smithi102.stdout:2881 writesame 0x36a07e3 thru 0x36a31e3 data_size 0x1(0x2a01 bytes) 2024-09-21T22:01:26.955 INFO:teuthology.orchestra.run.smithi102.stdout:2882 read 0x966a4f7 thru 0x96782df (0xdde9 bytes) 2024-09-21T22:01:26.956 INFO:teuthology.orchestra.run.smithi102.stdout:2883 punch from 0x3712d73 to 0x37152be, (0x254b bytes) 2024-09-21T22:01:26.956 INFO:teuthology.orchestra.run.smithi102.stdout:2884 punch from 0x20e8c8b to 0x20f016d, (0x74e2 bytes) 2024-09-21T22:01:26.956 INFO:teuthology.orchestra.run.smithi102.stdout:2885 write 0x787bd88 thru 0x787c52a (0x7a3 bytes) 2024-09-21T22:01:26.956 INFO:teuthology.orchestra.run.smithi102.stdout:2886 read 0x485c48e thru 0x4869144 (0xccb7 bytes) 2024-09-21T22:01:26.957 INFO:teuthology.orchestra.run.smithi102.stdout:2887 writesame 0xd62bf28 thru 0xd63b003 data_size 0x2(0xf0dc bytes) 2024-09-21T22:01:26.971 INFO:teuthology.orchestra.run.smithi102.stdout:2889 punch from 0x8deb136 to 0x8deb245, (0x10f bytes) 2024-09-21T22:01:26.971 INFO:teuthology.orchestra.run.smithi102.stdout:2892 write 0xda6108e thru 0xda6e8fd (0xd870 bytes) 2024-09-21T22:01:26.972 INFO:teuthology.orchestra.run.smithi102.stdout:2893 write 0x4cd34f0 thru 0x4cd5784 (0x2295 bytes) 2024-09-21T22:01:26.975 INFO:teuthology.orchestra.run.smithi102.stdout:2895 write 0xc3de6b0 thru 0xc3ed049 (0xe99a bytes) 2024-09-21T22:01:26.977 INFO:teuthology.orchestra.run.smithi102.stdout:2896 write 0x20db490 thru 0x20de7ef (0x3360 bytes) 2024-09-21T22:01:26.979 INFO:teuthology.orchestra.run.smithi102.stdout:2901 read 0x8cfb1ea thru 0x8d02b59 (0x7970 bytes) 2024-09-21T22:01:26.980 INFO:teuthology.orchestra.run.smithi102.stdout:2903 read 0x97aac39 thru 0x97b3b31 (0x8ef9 bytes) 2024-09-21T22:01:26.980 INFO:teuthology.orchestra.run.smithi102.stdout:2904 write 0x3b0ec1d thru 0x3b0f561 (0x945 bytes) 2024-09-21T22:01:26.981 INFO:teuthology.orchestra.run.smithi102.stdout:2905 read 0x784109a thru 0x784f46f (0xe3d6 bytes) 2024-09-21T22:01:26.982 INFO:teuthology.orchestra.run.smithi102.stdout:2906 read 0x8cdc8c9 thru 0x8ce6a89 (0xa1c1 bytes) 2024-09-21T22:01:26.982 INFO:teuthology.orchestra.run.smithi102.stdout:2907 write 0xa240ada thru 0xa247da2 (0x72c9 bytes) 2024-09-21T22:01:26.983 INFO:teuthology.orchestra.run.smithi102.stdout:2910 writesame 0x1dcba79 thru 0x1dcff76 data_size 0x1(0x44fe bytes) 2024-09-21T22:01:26.991 INFO:teuthology.orchestra.run.smithi102.stdout:2913 punch from 0xb16526f to 0xb16c107, (0x6e98 bytes) 2024-09-21T22:01:26.991 INFO:teuthology.orchestra.run.smithi102.stdout:2914 writesame 0xc3953cd thru 0xc397475 data_size 0x3(0x20a9 bytes) 2024-09-21T22:01:26.993 INFO:teuthology.orchestra.run.smithi102.stdout:2915 write 0x692a716 thru 0x693493c (0xa227 bytes) 2024-09-21T22:01:26.995 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:26.995 INFO:teuthology.orchestra.run.smithi102.stdout:2917 punch from 0xa71d6e5 to 0xa720af1, (0x340c bytes) 2024-09-21T22:01:26.995 INFO:teuthology.orchestra.run.smithi102.stdout:2918 punch from 0xd784318 to 0xd78f023, (0xad0b bytes) 2024-09-21T22:01:26.995 INFO:teuthology.orchestra.run.smithi102.stdout:2919 read 0x1eb6831 thru 0x1ec414f (0xd91f bytes) 2024-09-21T22:01:26.995 INFO:teuthology.orchestra.run.smithi102.stdout:2921 read 0xb962439 thru 0xb967e61 (0x5a29 bytes) 2024-09-21T22:01:26.995 INFO:teuthology.orchestra.run.smithi102.stdout:2922 write 0x51ae668 thru 0x51b4b77 (0x6510 bytes) 2024-09-21T22:01:26.996 INFO:teuthology.orchestra.run.smithi102.stdout:2924 writesame 0x11fcae0 thru 0x120c7d1 data_size 0x1(0xfcf2 bytes) 2024-09-21T22:01:27.025 INFO:teuthology.orchestra.run.smithi102.stdout:2925 read 0x5b300d9 thru 0x5b343ae (0x42d6 bytes) 2024-09-21T22:01:27.031 INFO:teuthology.orchestra.run.smithi102.stdout:2926 writesame 0xe8ecfa3 thru 0xe8fa74c data_size 0x5(0xd7aa bytes) 2024-09-21T22:01:27.039 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:27.037+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:27.041 INFO:teuthology.orchestra.run.smithi102.stdout:2928 trunc from 0xe8fa74d to 0x5ae94cd 2024-09-21T22:01:27.049 INFO:teuthology.orchestra.run.smithi102.stdout:2929 read 0x3ce0ca8 thru 0x3ce2846 (0x1b9f bytes) 2024-09-21T22:01:27.059 INFO:teuthology.orchestra.run.smithi102.stdout:2930 writesame 0x911dca3 thru 0x9129a13 data_size 0x1(0xbd71 bytes) 2024-09-21T22:01:27.060 INFO:teuthology.orchestra.run.smithi102.stdout:2931 punch from 0x6199de8 to 0x61a3f18, (0xa130 bytes) 2024-09-21T22:01:27.060 INFO:teuthology.orchestra.run.smithi102.stdout:2932 punch from 0x782bb5b to 0x782e726, (0x2bcb bytes) 2024-09-21T22:01:27.061 INFO:teuthology.orchestra.run.smithi102.stdout:2933 punch from 0x5ea9c7c to 0x5eae312, (0x4696 bytes) 2024-09-21T22:01:27.061 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:27.071 INFO:teuthology.orchestra.run.smithi102.stdout:2935 writesame 0xdcb05a0 thru 0xdcb754c data_size 0x17(0x6fad bytes) 2024-09-21T22:01:27.073 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:27.073 INFO:teuthology.orchestra.run.smithi102.stdout:2939 read 0x38a9a92 thru 0x38ad2d2 (0x3841 bytes) 2024-09-21T22:01:27.073 INFO:teuthology.orchestra.run.smithi102.stdout:2940 writesame 0x203c62b thru 0x204a2d7 data_size 0x3(0xdcad bytes) 2024-09-21T22:01:27.077 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:27.077 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:27.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.023637168, 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.078 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:01:27.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:01:27.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29925 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 2961408~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1469971090000008, 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028025164000000002, 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.083 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29925 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:27.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928528+0000", 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928533+0000", 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-06 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928538+0000", 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1599999999999997e-06 2024-09-21T22:01:27.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928543+0000", 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4410000000000003e-06 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956398+0000", 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027855386999999999 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956472+0000", 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3448000000000006e-05 2024-09-21T22:01:27.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956553+0000", 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1730000000000005e-05 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29926 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3567616~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1469759069999999, 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028146526000000002, 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.087 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29926 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:27.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928550+0000", 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928552+0000", 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928558+0000", 2024-09-21T22:01:27.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6690000000000003e-06 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928562+0000", 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2910000000000001e-06 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956591+0000", 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028029011999999999 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956646+0000", 2024-09-21T22:01:27.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5016999999999999e-05 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956696+0000", 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9920999999999999e-05 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29927 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3002368~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1469576779999997, 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028301160999999998, 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.091 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29927 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928569+0000", 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.395e-06 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928573+0000", 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.225e-06 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928575+0000", 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956723+0000", 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028148237 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956768+0000", 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4749999999999997e-05 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956869+0000", 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010078599999999999 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29928 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3043328~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1469389779999997, 2024-09-21T22:01:27.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028496923, 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29928 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928587+0000", 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4699999999999998e-07 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928588+0000", 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.313e-06 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928591+0000", 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1999999999999999e-06 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928598+0000", 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0890000000000002e-06 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956939+0000", 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028341261 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957006+0000", 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6704000000000004e-05 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957083+0000", 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7108999999999996e-05 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1469226740000007, 2024-09-21T22:01:27.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1469127239999999, 2024-09-21T22:01:27.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.107 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1468993209999994, 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:01:27.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.111 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1468896500000003, 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:01:27.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29937 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3248128~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.115 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1451120079999999, 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028121855000000001, 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29937 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:27.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930414+0000", 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930416+0000", 2024-09-21T22:01:27.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-06 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930422+0000", 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930435+0000", 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2404e-05 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958382+0000", 2024-09-21T22:01:27.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027947339000000002 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958450+0000", 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7611e-05 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958535+0000", 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5680999999999995e-05 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.119 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29939 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3289088~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1450572789999995, 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028207189000000001, 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29939 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:27.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930471+0000", 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:01:27.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930476+0000", 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4410000000000001e-06 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930480+0000", 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.391e-06 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958565+0000", 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028084392999999999 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958617+0000", 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1706999999999998e-05 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958675+0000", 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8715999999999998e-05 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29941 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3330048~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:27.123 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1450199770000005, 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028386958, 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29941 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930506+0000", 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930508+0000", 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.782e-06 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930514+0000", 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930518+0000", 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0949999999999998e-06 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958712+0000", 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028194745 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958788+0000", 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5556000000000006e-05 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958892+0000", 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000104304 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29943 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:27.127 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1449766409999995, 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028512368999999999, 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29943 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-07 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930551+0000", 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930557+0000", 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6799999999999998e-06 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930561+0000", 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5399999999999997e-06 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958929+0000", 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028367277999999999 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958988+0000", 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8928000000000002e-05 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959061+0000", 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3460000000000005e-05 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29945 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3411968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:27.131 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1449382420000003, 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028678985000000001, 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29945 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930588+0000", 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930589+0000", 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.939e-06 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930595+0000", 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8810000000000001e-06 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930600+0000", 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5539999999999999e-06 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959097+0000", 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028497248999999999 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959184+0000", 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7170999999999996e-05 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959266+0000", 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1769999999999998e-05 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1448938129999995, 2024-09-21T22:01:27.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:01:27.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:01:27.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1448475570000003, 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.140 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:01:27.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.143 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1448102220000003, 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:01:27.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:01:27.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1447760410000001, 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.148 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1447361689999997, 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.152 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:01:27.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:01:27.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.1446908839999992, 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:01:27.156 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.160 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:27.161 INFO:teuthology.orchestra.run.smithi102.stdout:2941 read 0x31ebf8d thru 0x31f87f5 (0xc869 bytes) 2024-09-21T22:01:27.161 INFO:teuthology.orchestra.run.smithi102.stdout:2944 punch from 0x17bb584 to 0x17c72d8, (0xbd54 bytes) 2024-09-21T22:01:27.161 INFO:teuthology.orchestra.run.smithi102.stdout:2945 clone 23 order 22 su 524288 sc 6 2024-09-21T22:01:27.162 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:27.162 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:27.160+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:27.262 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:27.261+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:27.304 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:27.304 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:27.304 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:27.304 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:27.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:27.363 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:27.361+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:27.415 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:27.416 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:27.416 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:27.416 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:27.416 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:27.424 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:27.464 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:27.463+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:27.564 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:27.563+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:27.570 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:27.570 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:27.570 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:27.570 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:27.570 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.570 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:01:27.570 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:27.570 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 8.7247137170000002, 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.571 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.574 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:27.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.7258022039999998, 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:01:27.576 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:01:27.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:01:27.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:01:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6173454469999999, 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:01:27.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:01:27.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.586 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6173361540000002, 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:01:27.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:01:27.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:01:27.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:01:27.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6173124080000001, 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.591 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:01:27.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:01:27.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.617301855, 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.595 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:27.599 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.617292452, 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:27.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:01:27.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6172816619999999, 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.607 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6172483890000002, 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:01:27.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:01:27.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:01:27.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:01:27.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6172377170000001, 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.612 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:27.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:01:27.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:01:27.615 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6131082259999996, 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:01:27.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:01:27.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33412 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2490368~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955500+0000", 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6127415889999996, 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096339219999999996, 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.620 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33412 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955500+0000", 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955500+0000", 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955501+0000", 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5600000000000005e-07 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955504+0000", 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5580000000000001e-06 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955514+0000", 2024-09-21T22:01:27.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4199999999999996e-06 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955523+0000", 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964852+0000", 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0093289670000000005 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964916+0000", 2024-09-21T22:01:27.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4133000000000004e-05 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965134+0000", 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00021769899999999999 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6127090879999999, 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:01:27.624 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:01:27.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:01:27.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:01:27.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:01:27.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:01:27.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:01:27.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.630 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6117544969999997, 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:01:27.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6117312439999996, 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:01:27.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:01:27.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.638 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6104385739999998, 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:01:27.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:01:27.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6104194610000002, 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:01:27.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.646 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6104003310000001, 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:27.650 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6103819929999998, 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:01:27.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:01:27.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:27.654 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.6103635939999998, 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:27.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:01:27.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:27.658 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:27.659 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:27.666 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:27.665+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:27.766 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:27.765+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:27.803 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:27.803 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:27.803 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:27.803 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:27.812 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:27.835 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:01:27.867 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:27.865+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:27.919 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:27.919 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:27.919 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:27.919 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:27.919 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:27.928 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:27.967 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:27.966+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:28.030 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-21T22:01:28.068 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:28.067+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.000383202999998, 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.076 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.568346951999999, 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.083 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:01:28.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.088 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28830 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215587706999999, 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023121914, 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28830 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2500000000000001e-07 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858180+0000", 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3939999999999999e-06 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858187+0000", 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7399999999999998e-06 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858192+0000", 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0690000000000001e-06 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881115+0000", 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923756 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881192+0000", 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6867999999999997e-05 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881299+0000", 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000106662 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28831 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1175552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215567091, 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023343084, 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28831 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.093 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:28.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2e-07 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858200+0000", 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0430000000000002e-06 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858207+0000", 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6449999999999999e-06 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858212+0000", 2024-09-21T22:01:28.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0549999999999999e-06 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881352+0000", 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023140609999999999 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881438+0000", 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5278000000000006e-05 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881541+0000", 2024-09-21T22:01:28.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103033 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28832 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215546799, 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023498735999999999, 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.097 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28832 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3099999999999999e-07 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858220+0000", 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858223+0000", 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.641e-06 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858226+0000", 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9919999999999999e-06 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881570+0000", 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023343632999999999 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881644+0000", 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3645000000000004e-05 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881717+0000", 2024-09-21T22:01:28.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3066999999999997e-05 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28833 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1257472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215534738000001, 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023709134999999999, 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.101 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28833 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858231+0000", 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.175e-06 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858235+0000", 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4290000000000001e-06 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858239+0000", 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0990000000000001e-06 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881761+0000", 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023522279 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881847+0000", 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6018000000000002e-05 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881939+0000", 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1910999999999995e-05 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215520135, 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.105 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215500671999999, 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.109 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:01:28.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215472595, 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.113 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:28.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:01:28.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215450763, 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215430436, 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.121 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215409473999999, 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.125 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.215388487, 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.129 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29857 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2793472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893198+0000", 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.180566369999999, 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929718000000002, 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.133 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29857 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893198+0000", 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893198+0000", 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893199+0000", 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893201+0000", 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9130000000000001e-06 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893207+0000", 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.28e-06 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893218+0000", 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0479000000000001e-05 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.915992+0000", 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022774325000000002 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916062+0000", 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9839000000000007e-05 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916128+0000", 2024-09-21T22:01:28.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6395000000000004e-05 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29858 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2834432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.180538971000001, 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023030268999999999, 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29858 2024-09-21T22:01:28.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:28.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5900000000000002e-07 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893228+0000", 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1859999999999999e-06 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893235+0000", 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7139999999999996e-06 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893241+0000", 2024-09-21T22:01:28.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7620000000000001e-06 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916157+0000", 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022915819 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916200+0000", 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2898999999999997e-05 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916256+0000", 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.643e-05 2024-09-21T22:01:28.140 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29859 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2875392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.180517475, 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023235025999999999, 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29859 2024-09-21T22:01:28.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893248+0000", 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.89e-07 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893249+0000", 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4950000000000001e-06 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893255+0000", 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9410000000000004e-06 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893260+0000", 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1930000000000001e-06 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916285+0000", 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023024203 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916375+0000", 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0486000000000001e-05 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916482+0000", 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000107219 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29860 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2916352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.180497494000001, 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023394503000000001, 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.145 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29860 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893268+0000", 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893270+0000", 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893282+0000", 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2291e-05 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893287+0000", 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2480000000000004e-06 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916509+0000", 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023221836999999999 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916567+0000", 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7615999999999999e-05 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916662+0000", 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.501e-05 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29861 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2957312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:28.149 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.180470222, 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023596588000000002, 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29861 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893297+0000", 2024-09-21T22:01:28.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2539999999999999e-06 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893304+0000", 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893308+0000", 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4800000000000003e-06 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916697+0000", 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023388720000000002 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916787+0000", 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9777999999999993e-05 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916891+0000", 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010459900000000001 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29862 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2998272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.180450846999999, 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023721644, 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29862 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893316+0000", 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.091e-06 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893322+0000", 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893328+0000", 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2299999999999999e-06 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916932+0000", 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023603889999999999 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916980+0000", 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8803e-05 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917036+0000", 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5219000000000001e-05 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29863 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 3031040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.180431508, 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023866634000000001, 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29863 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:28.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893334+0000", 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:28.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893339+0000", 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893345+0000", 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1469999999999998e-06 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893356+0000", 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0772e-05 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917062+0000", 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023706261999999999 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917108+0000", 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5318000000000002e-05 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917200+0000", 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2238999999999996e-05 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.161 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.162 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:28.162 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:28.162 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:28.163 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:28.164 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.164 INFO:teuthology.orchestra.run.smithi102.stdout:2947 write 0x5274ac8 thru 0x5275054 (0x58d bytes) 2024-09-21T22:01:28.164 INFO:teuthology.orchestra.run.smithi102.stdout:2948 write 0x8146742 thru 0x814f9a3 (0x9262 bytes) 2024-09-21T22:01:28.164 INFO:teuthology.orchestra.run.smithi102.stdout:2950 read 0x590985c thru 0x591258d (0x8d32 bytes) 2024-09-21T22:01:28.164 INFO:teuthology.orchestra.run.smithi102.stdout:2951 writesame 0x814bbc3 thru 0x815b17d data_size 0xd(0xf5bb bytes) 2024-09-21T22:01:28.164 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.164 INFO:teuthology.orchestra.run.smithi102.stdout:2954 read 0x8b538c0 thru 0x8b55c78 (0x23b9 bytes) 2024-09-21T22:01:28.165 INFO:teuthology.orchestra.run.smithi102.stdout:2955 write 0x5d31b48 thru 0x5d35d77 (0x4230 bytes) 2024-09-21T22:01:28.165 INFO:teuthology.orchestra.run.smithi102.stdout:2956 read 0x300ad5a thru 0x300ee17 (0x40be bytes) 2024-09-21T22:01:28.165 INFO:teuthology.orchestra.run.smithi102.stdout:2957 read 0x9ddafcb thru 0x9de934a (0xe380 bytes) 2024-09-21T22:01:28.165 INFO:teuthology.orchestra.run.smithi102.stdout:2959 writesame 0x9ff572 thru 0xa0bd1d data_size 0x1a(0xc7ac bytes) 2024-09-21T22:01:28.165 INFO:teuthology.orchestra.run.smithi102.stdout:2960 read 0x5c51dd3 thru 0x5c59347 (0x7575 bytes) 2024-09-21T22:01:28.165 INFO:teuthology.orchestra.run.smithi102.stdout:2961 write 0xca3920c thru 0xca409c2 (0x77b7 bytes) 2024-09-21T22:01:28.165 INFO:teuthology.orchestra.run.smithi102.stdout:2962 write 0x83dd218 thru 0x83ec32c (0xf115 bytes) 2024-09-21T22:01:28.167 INFO:teuthology.orchestra.run.smithi102.stdout:2964 punch from 0x35d00ba to 0x35d9ac8, (0x9a0e bytes) 2024-09-21T22:01:28.167 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.175 INFO:teuthology.orchestra.run.smithi102.stdout:2967 trunc from 0xdcb754d to 0x6813472 2024-09-21T22:01:28.176 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:28.175+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:28.195 INFO:teuthology.orchestra.run.smithi102.stdout:2969 writesame 0x5fcca4f thru 0x5fd17f7 data_size 0x2f(0x4da9 bytes) 2024-09-21T22:01:28.199 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.199 INFO:teuthology.orchestra.run.smithi102.stdout:2973 write 0x10c1094 thru 0x10cd13c (0xc0a9 bytes) 2024-09-21T22:01:28.203 INFO:teuthology.orchestra.run.smithi102.stdout:2974 write 0x2dcd35b thru 0x2dd3e17 (0x6abd bytes) 2024-09-21T22:01:28.206 INFO:teuthology.orchestra.run.smithi102.stdout:2975 read 0x1911f03 thru 0x1920adc (0xebda bytes) 2024-09-21T22:01:28.207 INFO:teuthology.orchestra.run.smithi102.stdout:2979 read 0x2ca3784 thru 0x2caf416 (0xbc93 bytes) 2024-09-21T22:01:28.208 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.211 INFO:teuthology.orchestra.run.smithi102.stdout:2981 trunc from 0x6813472 to 0x3efbba0 2024-09-21T22:01:28.245 INFO:teuthology.orchestra.run.smithi102.stdout:2982 writesame 0x9716d57 thru 0x971c187 data_size 0x1(0x5431 bytes) 2024-09-21T22:01:28.246 INFO:teuthology.orchestra.run.smithi102.stdout:2983 punch from 0x672889c to 0x6731f29, (0x968d bytes) 2024-09-21T22:01:28.246 INFO:teuthology.orchestra.run.smithi102.stdout:2985 read 0x3ff1f63 thru 0x400088c (0xe92a bytes) 2024-09-21T22:01:28.254 INFO:teuthology.orchestra.run.smithi102.stdout:2986 trunc from 0x971c188 to 0x1979403 2024-09-21T22:01:28.270 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:28.268+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:28.273 INFO:teuthology.orchestra.run.smithi102.stdout:2987 read 0x26f60f thru 0x2700ce (0xac0 bytes) 2024-09-21T22:01:28.283 INFO:teuthology.orchestra.run.smithi102.stdout:2989 trunc from 0x1979403 to 0x8f4ef35 2024-09-21T22:01:28.288 INFO:teuthology.orchestra.run.smithi102.stdout:2991 read 0x67f48ae thru 0x67fa7be (0x5f11 bytes) 2024-09-21T22:01:28.288 INFO:teuthology.orchestra.run.smithi102.stdout:2992 punch from 0x4aaaca0 to 0x4ab630e, (0xb66e bytes) 2024-09-21T22:01:28.288 INFO:teuthology.orchestra.run.smithi102.stdout:2993 punch from 0x32e3d5f to 0x32e8cac, (0x4f4d bytes) 2024-09-21T22:01:28.288 INFO:teuthology.orchestra.run.smithi102.stdout:2995 read 0xa76fc thru 0xaba94 (0x4399 bytes) 2024-09-21T22:01:28.289 INFO:teuthology.orchestra.run.smithi102.stdout:2996 read 0x9a565a thru 0x9b4d14 (0xf6bb bytes) 2024-09-21T22:01:28.289 INFO:teuthology.orchestra.run.smithi102.stdout:2998 write 0x8d4acc6 thru 0x8d4df6b (0x32a6 bytes) 2024-09-21T22:01:28.291 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:28.291 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:28.291 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:28.291 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:28.292 INFO:teuthology.orchestra.run.smithi102.stdout:2999 write 0x6cec3a7 thru 0x6cf0266 (0x3ec0 bytes) 2024-09-21T22:01:28.295 INFO:teuthology.orchestra.run.smithi102.stdout:3000 write 0x3c3a76d thru 0x3c402da (0x5b6e bytes) 2024-09-21T22:01:28.298 INFO:teuthology.orchestra.run.smithi102.stdout:3001 read 0x7091a5e thru 0x70971de (0x5781 bytes) 2024-09-21T22:01:28.300 INFO:teuthology.orchestra.run.smithi102.stdout:3002 trunc from 0x8f4ef35 to 0xb20181d 2024-09-21T22:01:28.302 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:28.305 INFO:teuthology.orchestra.run.smithi102.stdout:3003 punch from 0x3c52456 to 0x3c5de4e, (0xb9f8 bytes) 2024-09-21T22:01:28.305 INFO:teuthology.orchestra.run.smithi102.stdout:3004 write 0x3827da6 thru 0x383140e (0x9669 bytes) 2024-09-21T22:01:28.309 INFO:teuthology.orchestra.run.smithi102.stdout:3006 read 0x6f1f281 thru 0x6f24bab (0x592b bytes) 2024-09-21T22:01:28.309 INFO:teuthology.orchestra.run.smithi102.stdout:3007 write 0x92c0ed8 thru 0x92d00c6 (0xf1ef bytes) 2024-09-21T22:01:28.311 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.312 INFO:teuthology.orchestra.run.smithi102.stdout:3009 punch from 0x434ae53 to 0x4351649, (0x67f6 bytes) 2024-09-21T22:01:28.312 INFO:teuthology.orchestra.run.smithi102.stdout:3010 write 0x19197a2 thru 0x1929403 (0xfc62 bytes) 2024-09-21T22:01:28.313 INFO:teuthology.orchestra.run.smithi102.stdout:3011 write 0x8df8151 thru 0x8e06d5f (0xec0f bytes) 2024-09-21T22:01:28.318 INFO:teuthology.orchestra.run.smithi102.stdout:3012 writesame 0x3fb9096 thru 0x3fc68e3 data_size 0x21(0xd84e bytes) 2024-09-21T22:01:28.320 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.321 INFO:teuthology.orchestra.run.smithi102.stdout:3014 writesame 0x9b851f2 thru 0x9b8a15e data_size 0x1(0x4f6d bytes) 2024-09-21T22:01:28.329 INFO:teuthology.orchestra.run.smithi102.stdout:3015 read 0x1e8afe9 thru 0x1e91d91 (0x6da9 bytes) 2024-09-21T22:01:28.329 INFO:teuthology.orchestra.run.smithi102.stdout:3016 writesame 0xa11ec1e thru 0xa12868d data_size 0x38(0x9a70 bytes) 2024-09-21T22:01:28.333 INFO:teuthology.orchestra.run.smithi102.stdout:3017 write 0xa9c2885 thru 0xa9c54e9 (0x2c65 bytes) 2024-09-21T22:01:28.337 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.337 INFO:teuthology.orchestra.run.smithi102.stdout:3020 punch from 0x4fa83b3 to 0x4fb7bd5, (0xf822 bytes) 2024-09-21T22:01:28.337 INFO:teuthology.orchestra.run.smithi102.stdout:3021 read 0x15ca2bd thru 0x15d43bd (0xa101 bytes) 2024-09-21T22:01:28.337 INFO:teuthology.orchestra.run.smithi102.stdout:3022 read 0x2642122 thru 0x264fe61 (0xdd40 bytes) 2024-09-21T22:01:28.345 INFO:teuthology.orchestra.run.smithi102.stdout:3023 writesame 0xd46224f thru 0xd46583a data_size 0x2(0x35ec bytes) 2024-09-21T22:01:28.345 INFO:teuthology.orchestra.run.smithi102.stdout:3025 punch from 0x1d7103b to 0x1d769d9, (0x599e bytes) 2024-09-21T22:01:28.345 INFO:teuthology.orchestra.run.smithi102.stdout:3026 write 0xc001252 thru 0xc002b05 (0x18b4 bytes) 2024-09-21T22:01:28.347 INFO:teuthology.orchestra.run.smithi102.stdout:3028 writesame 0x23570f7 thru 0x235ae5c data_size 0x1d(0x3d66 bytes) 2024-09-21T22:01:28.350 INFO:teuthology.orchestra.run.smithi102.stdout:3029 write 0xb31f9d thru 0xb3fd41 (0xdda5 bytes) 2024-09-21T22:01:28.352 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.352 INFO:teuthology.orchestra.run.smithi102.stdout:3031 punch from 0x62d7291 to 0x62dbf3a, (0x4ca9 bytes) 2024-09-21T22:01:28.352 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.352 INFO:teuthology.orchestra.run.smithi102.stdout:3034 punch from 0x5e75ec8 to 0x5e7f6d8, (0x9810 bytes) 2024-09-21T22:01:28.352 INFO:teuthology.orchestra.run.smithi102.stdout:3035 write 0x1397d47 thru 0x1399209 (0x14c3 bytes) 2024-09-21T22:01:28.353 INFO:teuthology.orchestra.run.smithi102.stdout:3036 read 0x5124c0f thru 0x512bef0 (0x72e2 bytes) 2024-09-21T22:01:28.354 INFO:teuthology.orchestra.run.smithi102.stdout:3040 read 0x714ccf4 thru 0x7151a78 (0x4d85 bytes) 2024-09-21T22:01:28.354 INFO:teuthology.orchestra.run.smithi102.stdout:3042 write 0x5b4ed0e thru 0x5b57071 (0x8364 bytes) 2024-09-21T22:01:28.356 INFO:teuthology.orchestra.run.smithi102.stdout:3043 read 0x9ce3c6c thru 0x9ceeb82 (0xaf17 bytes) 2024-09-21T22:01:28.356 INFO:teuthology.orchestra.run.smithi102.stdout:3045 write 0x8e2ba55 thru 0x8e2cb72 (0x111e bytes) 2024-09-21T22:01:28.357 INFO:teuthology.orchestra.run.smithi102.stdout:3047 read 0x1dc3cd2 thru 0x1dc9e0e (0x613d bytes) 2024-09-21T22:01:28.358 INFO:teuthology.orchestra.run.smithi102.stdout:3048 write 0x90f4355 thru 0x9103104 (0xedb0 bytes) 2024-09-21T22:01:28.366 INFO:teuthology.orchestra.run.smithi102.stdout:3049 write 0x3ee7247 thru 0x3ee7603 (0x3bd bytes) 2024-09-21T22:01:28.369 INFO:teuthology.orchestra.run.smithi102.stdout:3050 writesame 0x816949f thru 0x816cedc data_size 0x47(0x3a3e bytes) 2024-09-21T22:01:28.370 INFO:teuthology.orchestra.run.smithi102.stdout:3052 read 0x7c9b8c5 thru 0x7ca0a2e (0x516a bytes) 2024-09-21T22:01:28.370 INFO:teuthology.orchestra.run.smithi102.stdout:3053 writesame 0xfee451 thru 0xff0e83 data_size 0x1(0x2a33 bytes) 2024-09-21T22:01:28.370 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:28.369+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:28.380 INFO:teuthology.orchestra.run.smithi102.stdout:3056 writesame 0xddd46d7 thru 0xdddbe3f data_size 0xb(0x7769 bytes) 2024-09-21T22:01:28.381 INFO:teuthology.orchestra.run.smithi102.stdout:3057 write 0x43e6427 thru 0x43efee7 (0x9ac1 bytes) 2024-09-21T22:01:28.384 INFO:teuthology.orchestra.run.smithi102.stdout:3059 write 0xcd5555 thru 0xce3367 (0xde13 bytes) 2024-09-21T22:01:28.385 INFO:teuthology.orchestra.run.smithi102.stdout:3061 write 0x6ce79fc thru 0x6cf35ec (0xbbf1 bytes) 2024-09-21T22:01:28.387 INFO:teuthology.orchestra.run.smithi102.stdout:3062 read 0x85a84c7 thru 0x85aacda (0x2814 bytes) 2024-09-21T22:01:28.403 INFO:teuthology.orchestra.run.smithi102.stdout:3063 trunc from 0xdddbe40 to 0xcdac7d 2024-09-21T22:01:28.424 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:28.425 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:28.425 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:28.425 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:28.425 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:28.433 INFO:teuthology.orchestra.run.smithi102.stdout:3064 write 0x34141e8 thru 0x3417343 (0x315c bytes) 2024-09-21T22:01:28.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:28.436 INFO:teuthology.orchestra.run.smithi102.stdout:3065 write 0x631457 thru 0x63fe52 (0xe9fc bytes) 2024-09-21T22:01:28.445 INFO:teuthology.orchestra.run.smithi102.stdout:3066 write 0x4f3b875 thru 0x4f45570 (0x9cfc bytes) 2024-09-21T22:01:28.449 INFO:teuthology.orchestra.run.smithi102.stdout:3067 trunc from 0x4f45571 to 0x438e916 2024-09-21T22:01:28.460 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.461 INFO:teuthology.orchestra.run.smithi102.stdout:3069 trunc from 0x438e916 to 0x5133403 2024-09-21T22:01:28.467 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.467 INFO:teuthology.orchestra.run.smithi102.stdout:3071 read 0x43b6961 thru 0x43c62d3 (0xf973 bytes) 2024-09-21T22:01:28.467 INFO:teuthology.orchestra.run.smithi102.stdout:3073 punch from 0x277d8a5 to 0x278064b, (0x2da6 bytes) 2024-09-21T22:01:28.467 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.467 INFO:teuthology.orchestra.run.smithi102.stdout:3075 read 0x3c9c1e thru 0x3d4ea1 (0xb284 bytes) 2024-09-21T22:01:28.468 INFO:teuthology.orchestra.run.smithi102.stdout:3076 read 0x9b412b thru 0x9be1f5 (0xa0cb bytes) 2024-09-21T22:01:28.468 INFO:teuthology.orchestra.run.smithi102.stdout:3077 write 0x37f5ce6 thru 0x38018cb (0xbbe6 bytes) 2024-09-21T22:01:28.471 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:28.470+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:28.475 INFO:teuthology.orchestra.run.smithi102.stdout:3078 trunc from 0x5133403 to 0x26bd772 2024-09-21T22:01:28.501 INFO:teuthology.orchestra.run.smithi102.stdout:3079 writesame 0x9ea6d19 thru 0x9eb56b6 data_size 0x2(0xe99e bytes) 2024-09-21T22:01:28.501 INFO:teuthology.orchestra.run.smithi102.stdout:3080 write 0x684a50d thru 0x68583cf (0xdec3 bytes) 2024-09-21T22:01:28.504 INFO:teuthology.orchestra.run.smithi102.stdout:3082 read 0xd080cc thru 0xd11cac (0x9be1 bytes) 2024-09-21T22:01:28.504 INFO:teuthology.orchestra.run.smithi102.stdout:3083 read 0x680af13 thru 0x68197b3 (0xe8a1 bytes) 2024-09-21T22:01:28.505 INFO:teuthology.orchestra.run.smithi102.stdout:3084 read 0x7f2bbbe thru 0x7f3793f (0xbd82 bytes) 2024-09-21T22:01:28.512 INFO:teuthology.orchestra.run.smithi102.stdout:3085 trunc from 0x9eb56b7 to 0x4ebb38d 2024-09-21T22:01:28.536 INFO:teuthology.orchestra.run.smithi102.stdout:3088 write 0xb29f360 thru 0xb2a9f94 (0xac35 bytes) 2024-09-21T22:01:28.539 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.548 INFO:teuthology.orchestra.run.smithi102.stdout:3090 write 0xd784bbc thru 0xd792273 (0xd6b8 bytes) 2024-09-21T22:01:28.552 INFO:teuthology.orchestra.run.smithi102.stdout:3091 punch from 0x80af160 to 0x80b8eca, (0x9d6a bytes) 2024-09-21T22:01:28.552 INFO:teuthology.orchestra.run.smithi102.stdout:3092 read 0x204df39 thru 0x204efc7 (0x108f bytes) 2024-09-21T22:01:28.559 INFO:teuthology.orchestra.run.smithi102.stdout:3093 trunc from 0xd792274 to 0x82ba215 2024-09-21T22:01:28.572 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:28.571+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:28.574 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.33295472, 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:01:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:01:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:01:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332932701000001, 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:01:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:01:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:01:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.33291212, 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332883521999999, 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:01:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:01:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332861117, 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:01:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:01:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:01:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332841102, 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332820899, 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:01:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:01:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.33280164, 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:01:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:01:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332775572999999, 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332754921999999, 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:01:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332696743, 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:01:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:01:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332641964, 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332607508000001, 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:01:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332586178, 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332565017, 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:01:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:01:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332534493000001, 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:01:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:01:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332510134, 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:01:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332488829000001, 2024-09-21T22:01:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:01:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:01:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332467439, 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:01:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:01:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:01:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:01:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:01:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.332446072, 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:01:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:28.659 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:28.660 INFO:teuthology.orchestra.run.smithi102.stdout:3094 write 0xc3ed9ab thru 0xc3f7283 (0x98d9 bytes) 2024-09-21T22:01:28.661 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:3095 write 0x65471ea thru 0x6556f0b (0xfd22 bytes) 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:3096 write 0x9ae793d thru 0x9af6ddc (0xf4a0 bytes) 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:3101 write 0x25dd24e thru 0x25e4de9 (0x7b9c bytes) 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:3102 read 0x746dbe9 thru 0x747255d (0x4975 bytes) 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:3103 read 0xc250fce thru 0xc25df8c (0xcfbf bytes) 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:3104 read 0x549941b thru 0x549b393 (0x1f79 bytes) 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:3105 punch from 0xaf1480d to 0xaf22144, (0xd937 bytes) 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:3106 write 0xbc0fe4d thru 0xbc17eae (0x8062 bytes) 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:3108 write 0x4aa2662 thru 0x4aafeb9 (0xd858 bytes) 2024-09-21T22:01:28.663 INFO:teuthology.orchestra.run.smithi102.stdout:3109 write 0xd4b5b9d thru 0xd4b617a (0x5de bytes) 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:3110 write 0x26e4826 thru 0x26e7367 (0x2b42 bytes) 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:3113 flatten 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:3114 read 0x3f3b093 thru 0x3f421d7 (0x7145 bytes) 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:3116 read 0x5eb692d thru 0x5eba16f (0x3843 bytes) 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:3117 trunc from 0xd4b617b to 0x38fc295 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:3118 write 0x3adaca9 thru 0x3ae8da6 (0xe0fe bytes) 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:3120 trunc from 0x3ae8da7 to 0x8a6f1f6 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:3123 punch from 0x2c921a3 to 0x2c9c7dd, (0xa63a bytes) 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:3126 writesame 0x66cbc2d thru 0x66d0f67 data_size 0xd(0x533b bytes) 2024-09-21T22:01:28.669 INFO:teuthology.orchestra.run.smithi102.stdout:3127 trunc from 0x8a6f1f6 to 0xc4525ec 2024-09-21T22:01:28.673 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:28.672+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:28.686 INFO:teuthology.orchestra.run.smithi102.stdout:3128 trunc from 0xc4525ec to 0x2502048 2024-09-21T22:01:28.711 INFO:teuthology.orchestra.run.smithi102.stdout:3129 writesame 0x8a22f25 thru 0x8a2a59a data_size 0x2(0x7676 bytes) 2024-09-21T22:01:28.711 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.711 INFO:teuthology.orchestra.run.smithi102.stdout:3131 read 0x487b90e thru 0x4883052 (0x7745 bytes) 2024-09-21T22:01:28.711 INFO:teuthology.orchestra.run.smithi102.stdout:3132 write 0x11d39c5 thru 0x11d8172 (0x47ae bytes) 2024-09-21T22:01:28.712 INFO:teuthology.orchestra.run.smithi102.stdout:3133 write 0x3bb57e9 thru 0x3bc530b (0xfb23 bytes) 2024-09-21T22:01:28.722 INFO:teuthology.orchestra.run.smithi102.stdout:3134 trunc from 0x8a2a59b to 0x28021bb 2024-09-21T22:01:28.733 INFO:teuthology.orchestra.run.smithi102.stdout:3135 read 0x5d64ce thru 0x5de0cb (0x7bfe bytes) 2024-09-21T22:01:28.734 INFO:teuthology.orchestra.run.smithi102.stdout:3136 read 0x136695 thru 0x13f07e (0x89ea bytes) 2024-09-21T22:01:28.734 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.750 INFO:teuthology.orchestra.run.smithi102.stdout:3138 write 0xbeb2490 thru 0xbeb24f3 (0x64 bytes) 2024-09-21T22:01:28.753 INFO:teuthology.orchestra.run.smithi102.stdout:3139 writesame 0x680be76 thru 0x6815c24 data_size 0x1(0x9daf bytes) 2024-09-21T22:01:28.770 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.770 INFO:teuthology.orchestra.run.smithi102.stdout:3142 write 0x5655f67 thru 0x5657373 (0x140d bytes) 2024-09-21T22:01:28.773 INFO:teuthology.orchestra.run.smithi102.stdout:3143 write 0x318fc54 thru 0x3195410 (0x57bd bytes) 2024-09-21T22:01:28.775 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:28.773+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:28.776 INFO:teuthology.orchestra.run.smithi102.stdout:3144 read 0x4374fc0 thru 0x4384124 (0xf165 bytes) 2024-09-21T22:01:28.776 INFO:teuthology.orchestra.run.smithi102.stdout:3146 write 0xb5b7b84 thru 0xb5bc615 (0x4a92 bytes) 2024-09-21T22:01:28.782 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:28.782 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:28.783 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:28.783 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:28.785 INFO:teuthology.orchestra.run.smithi102.stdout:3147 write 0xe023ac7 thru 0xe02c183 (0x86bd bytes) 2024-09-21T22:01:28.788 INFO:teuthology.orchestra.run.smithi102.stdout:3148 read 0x4619a16 thru 0x4619f17 (0x502 bytes) 2024-09-21T22:01:28.793 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:28.800 INFO:teuthology.orchestra.run.smithi102.stdout:3149 trunc from 0xe02c184 to 0x3f6f31a 2024-09-21T22:01:28.822 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:01:28.826 INFO:teuthology.orchestra.run.smithi102.stdout:3150 write 0xa75f348 thru 0xa76322a (0x3ee3 bytes) 2024-09-21T22:01:28.831 INFO:teuthology.orchestra.run.smithi102.stdout:3152 read 0x5e3a473 thru 0x5e3be92 (0x1a20 bytes) 2024-09-21T22:01:28.831 INFO:teuthology.orchestra.run.smithi102.stdout:3153 punch from 0x9fa1b4c to 0x9faee55, (0xd309 bytes) 2024-09-21T22:01:28.831 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.836 INFO:teuthology.orchestra.run.smithi102.stdout:3156 trunc from 0xa76322b to 0x6b77418 2024-09-21T22:01:28.857 INFO:teuthology.orchestra.run.smithi102.stdout:3157 trunc from 0x6b77418 to 0xe31b508 2024-09-21T22:01:28.860 INFO:teuthology.orchestra.run.smithi102.stdout:3160 write 0x9eb65fb thru 0x9eb6a17 (0x41d bytes) 2024-09-21T22:01:28.865 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.871 INFO:teuthology.orchestra.run.smithi102.stdout:3165 trunc from 0xe31b508 to 0x903cd97 2024-09-21T22:01:28.875 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:28.874+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:28.880 INFO:teuthology.orchestra.run.smithi102.stdout:3166 read 0x4ecd6b0 thru 0x4ed462a (0x6f7b bytes) 2024-09-21T22:01:28.880 INFO:teuthology.orchestra.run.smithi102.stdout:3167 write 0x6675971 thru 0x667b4b6 (0x5b46 bytes) 2024-09-21T22:01:28.883 INFO:teuthology.orchestra.run.smithi102.stdout:3168 write 0x25825c4 thru 0x2584673 (0x20b0 bytes) 2024-09-21T22:01:28.884 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.885 INFO:teuthology.orchestra.run.smithi102.stdout:3172 punch from 0x4fca5ae to 0x4fd76a4, (0xd0f6 bytes) 2024-09-21T22:01:28.895 INFO:teuthology.orchestra.run.smithi102.stdout:3173 writesame 0xd75a255 thru 0xd75d844 data_size 0x8(0x35f0 bytes) 2024-09-21T22:01:28.895 INFO:teuthology.orchestra.run.smithi102.stdout:3174 write 0x72cb5e0 thru 0x72d062f (0x5050 bytes) 2024-09-21T22:01:28.899 INFO:teuthology.orchestra.run.smithi102.stdout:3175 write 0x6dd93fb thru 0x6ddde1a (0x4a20 bytes) 2024-09-21T22:01:28.902 INFO:teuthology.orchestra.run.smithi102.stdout:3176 write 0x4ea8de7 thru 0x4eac728 (0x3942 bytes) 2024-09-21T22:01:28.906 INFO:teuthology.orchestra.run.smithi102.stdout:3178 read 0x57a697 thru 0x58676e (0xc0d8 bytes) 2024-09-21T22:01:28.920 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:28.920 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:28.920 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:28.921 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:28.921 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:28.921 INFO:teuthology.orchestra.run.smithi102.stdout:3179 trunc from 0xd75d845 to 0x1b02146 2024-09-21T22:01:28.929 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:28.931 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:28.940 INFO:teuthology.orchestra.run.smithi102.stdout:3180 punch from 0x1342fef to 0x134f64f, (0xc660 bytes) 2024-09-21T22:01:28.940 INFO:teuthology.orchestra.run.smithi102.stdout:3182 read 0x33dc11 thru 0x34b01d (0xd40d bytes) 2024-09-21T22:01:28.947 INFO:teuthology.orchestra.run.smithi102.stdout:3183 write 0x306ea11 thru 0x3077d30 (0x9320 bytes) 2024-09-21T22:01:28.951 INFO:teuthology.orchestra.run.smithi102.stdout:3184 punch from 0xf1abbc to 0xf2731e, (0xc762 bytes) 2024-09-21T22:01:28.957 INFO:teuthology.orchestra.run.smithi102.stdout:3186 write 0x3ed8777 thru 0x3ed90b6 (0x940 bytes) 2024-09-21T22:01:28.960 INFO:teuthology.orchestra.run.smithi102.stdout:3188 read 0x128d2b3 thru 0x128eb39 (0x1887 bytes) 2024-09-21T22:01:28.961 INFO:teuthology.orchestra.run.smithi102.stdout:3189 read 0x2aa0438 thru 0x2aa94d0 (0x9099 bytes) 2024-09-21T22:01:28.976 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:28.975+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:28.976 INFO:teuthology.orchestra.run.smithi102.stdout:3190 writesame 0xa4d235d thru 0xa4dee94 data_size 0x8(0xcb38 bytes) 2024-09-21T22:01:28.985 INFO:teuthology.orchestra.run.smithi102.stdout:3191 trunc from 0xa4dee95 to 0x3f0b816 2024-09-21T22:01:28.993 INFO:teuthology.orchestra.run.smithi102.stdout:3192 read 0x9874b thru 0x9ab56 (0x240c bytes) 2024-09-21T22:01:28.993 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:28.993 INFO:teuthology.orchestra.run.smithi102.stdout:3195 read 0x13fa76 thru 0x147f72 (0x84fd bytes) 2024-09-21T22:01:28.994 INFO:teuthology.orchestra.run.smithi102.stdout:3196 punch from 0x2835aa2 to 0x2841584, (0xbae2 bytes) 2024-09-21T22:01:29.007 INFO:teuthology.orchestra.run.smithi102.stdout:3198 write 0x99a8599 thru 0x99ad18e (0x4bf6 bytes) 2024-09-21T22:01:29.011 INFO:teuthology.orchestra.run.smithi102.stdout:3199 write 0x1880fb2 thru 0x1887497 (0x64e6 bytes) 2024-09-21T22:01:29.015 INFO:teuthology.orchestra.run.smithi102.stdout:3201 clone 24 order 19 su 131072 sc 8 2024-09-21T22:01:29.055 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:29.055 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.090120928999999, 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.056 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:01:29.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.090099688, 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.060 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:29.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:29.064 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.090078460000001, 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:01:29.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:01:29.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.068 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.090054854, 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:29.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.090035564000001, 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:01:29.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.090003318000001, 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089979349, 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089959785, 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089939353, 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.092 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.08991823, 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:01:29.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089899014, 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.097 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:01:29.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089878541999999, 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:01:29.101 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:01:29.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089857826999999, 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:01:29.105 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089838071000001, 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:01:29.109 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:29.113 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089818356, 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:01:29.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:01:29.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.117 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089798446, 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:01:29.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089777463000001, 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:01:29.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:01:29.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089756779, 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:01:29.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089730875000001, 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:01:29.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.133 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 11.089709958, 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:29.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:01:29.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:29.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.137 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:29.138 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:29.138 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:29.138 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:29.138 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:29.139 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:29.140 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:29.140 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:29.140 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:29.140 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:29.141 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:29.141 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:29.141 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:29.141 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:29.142 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:29.137+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:29.145 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:29.145 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:29.163 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:29.163 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:29.180 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:29.180 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:29.222 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:01:29.222 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:01:29.222 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-21T22:01:29.222 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2024-09-21T22:01:29.222 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-21T22:01:29.239 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:29.237+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:29.251 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:29.251 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:29.260 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:29.344 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:29.343+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:29.408 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:29.408 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:29.417 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:29.459 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:29.458+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:29.541 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:29.540+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:29.562 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:29.562 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:29.570 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:29.643 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:29.642+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:29.675 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:29.675 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:29.683 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:29.775 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:29.773+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:29.828 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-21T22:01:29.833 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:29.833 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:29.845 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:29.886 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:29.884+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:29.947 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:29.945+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:29.997 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-21T22:01:29.998 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:29.998 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:30.010 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:30.046 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:30.045+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:30.125 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:30.125 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:30.135 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:30.179 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:30.177+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:30.238 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:30.238 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:30.245 INFO:teuthology.orchestra.run.smithi102.stdout:3202 trunc from 0x99ad18f to 0x5801c35 2024-09-21T22:01:30.247 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:30.248 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:30.245+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:30.270 INFO:teuthology.orchestra.run.smithi102.stdout:3204 write 0xaaeddb7 thru 0xaaf0974 (0x2bbe bytes) 2024-09-21T22:01:30.285 INFO:teuthology.orchestra.run.smithi102.stdout:3205 trunc from 0xaaf0975 to 0x1336b46 2024-09-21T22:01:30.304 INFO:teuthology.orchestra.run.smithi102.stdout:3207 punch from 0x117fe12 to 0x118bf3e, (0xc12c bytes) 2024-09-21T22:01:30.324 INFO:teuthology.orchestra.run.smithi102.stdout:3209 write 0xcabdd35 thru 0xcac9242 (0xb50e bytes) 2024-09-21T22:01:30.328 INFO:teuthology.orchestra.run.smithi102.stdout:3210 write 0x4fea82 thru 0x50e3e5 (0xf964 bytes) 2024-09-21T22:01:30.332 INFO:teuthology.orchestra.run.smithi102.stdout:3211 write 0x8571925 thru 0x857dd8c (0xc468 bytes) 2024-09-21T22:01:30.335 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:30.336 INFO:teuthology.orchestra.run.smithi102.stdout:3214 punch from 0x7d83f6 to 0x7dcde6, (0x49f0 bytes) 2024-09-21T22:01:30.336 INFO:teuthology.orchestra.run.smithi102.stdout:3215 write 0x4b3e386 thru 0x4b4c37b (0xdff6 bytes) 2024-09-21T22:01:30.339 INFO:teuthology.orchestra.run.smithi102.stdout:3216 read 0x4c76e5e thru 0x4c82ecc (0xc06f bytes) 2024-09-21T22:01:30.339 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:30.339 INFO:teuthology.orchestra.run.smithi102.stdout:3218 punch from 0x9b3527c to 0x9b3ad58, (0x5adc bytes) 2024-09-21T22:01:30.346 INFO:teuthology.orchestra.run.smithi102.stdout:3222 write 0xdc8c72e thru 0xdc9a292 (0xdb65 bytes) 2024-09-21T22:01:30.348 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:30.347+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:30.350 INFO:teuthology.orchestra.run.smithi102.stdout:3223 clone 25 order 20 su 524288 sc 9 2024-09-21T22:01:30.399 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:30.399 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:30.408 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:30.449 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:30.448+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:30.509 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:30.509 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:30.518 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:30.561 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:30.559+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:30.620 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:30.620 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:30.629 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:30.650 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:30.649+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:30.750 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:30.750+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:30.772 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:30.772 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:30.781 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:30.842 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:01:30.887 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:30.886+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:30.891 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:30.891 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:30.894 INFO:teuthology.orchestra.run.smithi102.stdout:leaving image image_client.0-clone24 intact 2024-09-21T22:01:30.902 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:30.952 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:30.951+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:31.006 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:31.006 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:31.015 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:31.044 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-21T22:01:31.059 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:31.057+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:31.119 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:31.119 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:31.128 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:31.169 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:31.167+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:31.192 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:31.222 INFO:teuthology.orchestra.run.smithi102.stdout:3227 writesame 0x35cf12d thru 0x35ddce9 data_size 0x1(0xebbd bytes) 2024-09-21T22:01:31.255 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:31.253+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:31.256 INFO:teuthology.orchestra.run.smithi102.stdout:3228 write 0x708a9a1 thru 0x708b953 (0xfb3 bytes) 2024-09-21T22:01:31.261 INFO:teuthology.orchestra.run.smithi102.stdout:3229 write 0xa354267 thru 0xa3636f6 (0xf490 bytes) 2024-09-21T22:01:31.266 INFO:teuthology.orchestra.run.smithi102.stdout:3231 write 0xcf9961e thru 0xcf9fc51 (0x6634 bytes) 2024-09-21T22:01:31.271 INFO:teuthology.orchestra.run.smithi102.stdout:3232 write 0x2983448 thru 0x298ab6d (0x7726 bytes) 2024-09-21T22:01:31.274 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:31.274 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:31.275 INFO:teuthology.orchestra.run.smithi102.stdout:3233 read 0xc5450c5 thru 0xc54acd1 (0x5c0d bytes) 2024-09-21T22:01:31.275 INFO:teuthology.orchestra.run.smithi102.stdout:3234 punch from 0x1b73e89 to 0x1b82259, (0xe3d0 bytes) 2024-09-21T22:01:31.275 INFO:teuthology.orchestra.run.smithi102.stdout:3236 writesame 0xd5e3989 thru 0xd5e95e8 data_size 0x10(0x5c60 bytes) 2024-09-21T22:01:31.282 INFO:teuthology.orchestra.run.smithi102.stdout:3237 writesame 0x893a408 thru 0x893ee3c data_size 0xb(0x4a35 bytes) 2024-09-21T22:01:31.284 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:31.287 INFO:teuthology.orchestra.run.smithi102.stdout:3238 read 0xcc089b1 thru 0xcc18263 (0xf8b3 bytes) 2024-09-21T22:01:31.287 INFO:teuthology.orchestra.run.smithi102.stdout:3239 read 0x5ea001d thru 0x5ead57d (0xd561 bytes) 2024-09-21T22:01:31.287 INFO:teuthology.orchestra.run.smithi102.stdout:3240 write 0x231be56 thru 0x231f5aa (0x3755 bytes) 2024-09-21T22:01:31.302 INFO:teuthology.orchestra.run.smithi102.stdout:3241 trunc from 0xdc9a293 to 0x6b1d43c 2024-09-21T22:01:31.327 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:31.328 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:31.328 INFO:teuthology.orchestra.run.smithi102.stdout:3242 trunc from 0x6b1d43c to 0xbeae7e7 2024-09-21T22:01:31.333 INFO:teuthology.orchestra.run.smithi102.stdout:3243 read 0x71f37b1 thru 0x71fcdb4 (0x9604 bytes) 2024-09-21T22:01:31.333 INFO:teuthology.orchestra.run.smithi102.stdout:3244 write 0xa96f85f thru 0xa97f3a7 (0xfb49 bytes) 2024-09-21T22:01:31.337 INFO:teuthology.orchestra.run.smithi102.stdout:3245 write 0xac8e220 thru 0xac8efe5 (0xdc6 bytes) 2024-09-21T22:01:31.346 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:31.346 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:31.347 INFO:teuthology.orchestra.run.smithi102.stdout:3246 trunc from 0xbeae7e7 to 0x77c07dd 2024-09-21T22:01:31.358 INFO:teuthology.orchestra.run.smithi102.stdout:3247 write 0xef5631 thru 0xf02d2e (0xd6fe bytes) 2024-09-21T22:01:31.365 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:31.365 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:31.365 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:31.366 INFO:teuthology.orchestra.run.smithi102.stdout:3250 read 0x50edf01 thru 0x50f9c7d (0xbd7d bytes) 2024-09-21T22:01:31.366 INFO:teuthology.orchestra.run.smithi102.stdout:3251 write 0x502f2fb thru 0x50375d7 (0x82dd bytes) 2024-09-21T22:01:31.368 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:31.366+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:31.371 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:31.371 INFO:teuthology.orchestra.run.smithi102.stdout:3258 punch from 0x4903c2c to 0x4909fc5, (0x6399 bytes) 2024-09-21T22:01:31.382 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:31.382 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:31.383 INFO:teuthology.orchestra.run.smithi102.stdout:3259 writesame 0xd333423 thru 0xd33a34c data_size 0x66(0x6f2a bytes) 2024-09-21T22:01:31.394 INFO:teuthology.orchestra.run.smithi102.stdout:3260 trunc from 0xd33a34d to 0x4da350a 2024-09-21T22:01:31.399 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:31.400 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:31.418 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:31.422 INFO:teuthology.orchestra.run.smithi102.stdout:3262 write 0xa488e13 thru 0xa48f143 (0x6331 bytes) 2024-09-21T22:01:31.425 INFO:teuthology.orchestra.run.smithi102.stdout:3263 punch from 0x6f828e4 to 0x6f8451a, (0x1c36 bytes) 2024-09-21T22:01:31.425 INFO:teuthology.orchestra.run.smithi102.stdout:3265 write 0x8f5668c thru 0x8f56df4 (0x769 bytes) 2024-09-21T22:01:31.427 INFO:teuthology.orchestra.run.smithi102.stdout:3266 write 0x5cf9430 thru 0x5cfd01b (0x3bec bytes) 2024-09-21T22:01:31.436 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:31.436 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:31.438 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:31.438 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:31.439 INFO:teuthology.orchestra.run.smithi102.stdout:3267 write 0xe058fa5 thru 0xe067192 (0xe1ee bytes) 2024-09-21T22:01:31.442 INFO:teuthology.orchestra.run.smithi102.stdout:3268 read 0x8e88f3f thru 0x8e89b1b (0xbdd bytes) 2024-09-21T22:01:31.442 INFO:teuthology.orchestra.run.smithi102.stdout:3269 read 0xa24e198 thru 0xa25a8fd (0xc766 bytes) 2024-09-21T22:01:31.442 INFO:teuthology.orchestra.run.smithi102.stdout:3271 read 0xb0556dc thru 0xb05993f (0x4264 bytes) 2024-09-21T22:01:31.447 INFO:teuthology.orchestra.run.smithi102.stdout:3272 writesame 0xe581e33 thru 0xe58723d data_size 0xd(0x540b bytes) 2024-09-21T22:01:31.447 INFO:teuthology.orchestra.run.smithi102.stdout:3273 write 0xaca713e thru 0xaca7367 (0x22a bytes) 2024-09-21T22:01:31.448 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:31.450 INFO:teuthology.orchestra.run.smithi102.stdout:3275 write 0x699dc39 thru 0x69ac2ce (0xe696 bytes) 2024-09-21T22:01:31.459 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:31.459 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:31.460 INFO:teuthology.orchestra.run.smithi102.stdout:3276 read 0x2c79df9 thru 0x2c87a33 (0xdc3b bytes) 2024-09-21T22:01:31.461 INFO:teuthology.orchestra.run.smithi102.stdout:3278 punch from 0x5ebe431 to 0x5ec2769, (0x4338 bytes) 2024-09-21T22:01:31.461 INFO:teuthology.orchestra.run.smithi102.stdout:3279 punch from 0x8dbafc8 to 0x8dbfff0, (0x5028 bytes) 2024-09-21T22:01:31.461 INFO:teuthology.orchestra.run.smithi102.stdout:3280 read 0x4aa78b8 thru 0x4aae06b (0x67b4 bytes) 2024-09-21T22:01:31.464 INFO:teuthology.orchestra.run.smithi102.stdout:3282 trunc from 0xe58723e to 0xb571a1f 2024-09-21T22:01:31.475 INFO:teuthology.orchestra.run.smithi102.stdout:3283 writesame 0x690007d thru 0x6905344 data_size 0xc(0x52c8 bytes) 2024-09-21T22:01:31.480 INFO:teuthology.orchestra.run.smithi102.stdout:3285 read 0x15669a1 thru 0x1569db3 (0x3413 bytes) 2024-09-21T22:01:31.480 INFO:teuthology.orchestra.run.smithi102.stdout:3286 write 0x560b31d thru 0x560c6e4 (0x13c8 bytes) 2024-09-21T22:01:31.484 INFO:teuthology.orchestra.run.smithi102.stdout:3288 punch from 0x2c110e to 0x2c5282, (0x4174 bytes) 2024-09-21T22:01:31.484 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:31.484 INFO:teuthology.orchestra.run.smithi102.stdout:3291 write 0x16b3301 thru 0x16b6f5e (0x3c5e bytes) 2024-09-21T22:01:31.489 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:31.487+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:31.493 INFO:teuthology.orchestra.run.smithi102.stdout:3292 writesame 0xc393d17 thru 0xc3989da data_size 0x11(0x4cc4 bytes) 2024-09-21T22:01:31.493 INFO:teuthology.orchestra.run.smithi102.stdout:3293 write 0x22153ba thru 0x221b4e8 (0x612f bytes) 2024-09-21T22:01:31.496 INFO:teuthology.orchestra.run.smithi102.stdout:3294 write 0x996bb7a thru 0x997a365 (0xe7ec bytes) 2024-09-21T22:01:31.507 INFO:teuthology.orchestra.run.smithi102.stdout:3295 writesame 0xde80954 thru 0xde8bffc data_size 0x6d(0xb6a9 bytes) 2024-09-21T22:01:31.513 INFO:teuthology.orchestra.run.smithi102.stdout:3297 trunc from 0xde8bffd to 0x9125f9e 2024-09-21T22:01:31.524 INFO:teuthology.orchestra.run.smithi102.stdout:3298 write 0x6551de9 thru 0x65606f5 (0xe90d bytes) 2024-09-21T22:01:31.526 INFO:teuthology.orchestra.run.smithi102.stdout:3299 read 0x48ce8d3 thru 0x48d044e (0x1b7c bytes) 2024-09-21T22:01:31.526 INFO:teuthology.orchestra.run.smithi102.stdout:3300 writesame 0x6a7dd3e thru 0x6a89a28 data_size 0x31(0xbceb bytes) 2024-09-21T22:01:31.535 INFO:teuthology.orchestra.run.smithi102.stdout:3301 read 0x4b03c69 thru 0x4b0e0ae (0xa446 bytes) 2024-09-21T22:01:31.536 INFO:teuthology.orchestra.run.smithi102.stdout:3302 write 0x81f286d thru 0x81f93c1 (0x6b55 bytes) 2024-09-21T22:01:31.545 INFO:teuthology.orchestra.run.smithi102.stdout:3304 writesame 0x96fd861 thru 0x970bf34 data_size 0x4f(0xe6d4 bytes) 2024-09-21T22:01:31.545 INFO:teuthology.orchestra.run.smithi102.stdout:3305 punch from 0x121236f to 0x121df7c, (0xbc0d bytes) 2024-09-21T22:01:31.552 INFO:teuthology.orchestra.run.smithi102.stdout:3306 trunc from 0x970bf35 to 0x35c3125 2024-09-21T22:01:31.557 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:31.555+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:31.583 INFO:teuthology.orchestra.run.smithi102.stdout:3307 write 0xc90e72b thru 0xc91bd2c (0xd602 bytes) 2024-09-21T22:01:31.586 INFO:teuthology.orchestra.run.smithi102.stdout:3309 read 0x5b11cb1 thru 0x5b1d6c4 (0xba14 bytes) 2024-09-21T22:01:31.586 INFO:teuthology.orchestra.run.smithi102.stdout:3311 write 0xa85b8e4 thru 0xa8691e4 (0xd901 bytes) 2024-09-21T22:01:31.589 INFO:teuthology.orchestra.run.smithi102.stdout:3312 read 0x2404459 thru 0x24045d6 (0x17e bytes) 2024-09-21T22:01:31.590 INFO:teuthology.orchestra.run.smithi102.stdout:3313 write 0x3b0be6c thru 0x3b1be09 (0xff9e bytes) 2024-09-21T22:01:31.595 INFO:teuthology.orchestra.run.smithi102.stdout:3314 read 0x782a018 thru 0x7837720 (0xd709 bytes) 2024-09-21T22:01:31.596 INFO:teuthology.orchestra.run.smithi102.stdout:3316 write 0x36e19a2 thru 0x36e35f3 (0x1c52 bytes) 2024-09-21T22:01:31.597 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:31.597 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:31.597 INFO:teuthology.orchestra.run.smithi102.stdout:3319 read 0x7d023da thru 0x7d11fb2 (0xfbd9 bytes) 2024-09-21T22:01:31.597 INFO:teuthology.orchestra.run.smithi102.stdout:3320 punch from 0x7828a9b to 0x7835fb1, (0xd516 bytes) 2024-09-21T22:01:31.597 INFO:teuthology.orchestra.run.smithi102.stdout:3321 write 0x89950c6 thru 0x89a2946 (0xd881 bytes) 2024-09-21T22:01:31.600 INFO:teuthology.orchestra.run.smithi102.stdout:3322 read 0x4be0cb4 thru 0x4be6d31 (0x607e bytes) 2024-09-21T22:01:31.600 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:31.600 INFO:teuthology.orchestra.run.smithi102.stdout:3326 read 0xc825194 thru 0xc82d602 (0x846f bytes) 2024-09-21T22:01:31.600 INFO:teuthology.orchestra.run.smithi102.stdout:3327 write 0xb57304c thru 0xb581d63 (0xed18 bytes) 2024-09-21T22:01:31.602 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 53.526586606000002, 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:01:31.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:01:31.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:01:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 26.094550354999999, 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.610 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:01:31.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:31.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:31.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28830 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.741791109999999, 2024-09-21T22:01:31.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023121914, 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28830 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2500000000000001e-07 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858180+0000", 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3939999999999999e-06 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858187+0000", 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7399999999999998e-06 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858192+0000", 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0690000000000001e-06 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881115+0000", 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923756 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881192+0000", 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6867999999999997e-05 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881299+0000", 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000106662 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28831 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1175552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.619 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.741770494000001, 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023343084, 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28831 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2e-07 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858200+0000", 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0430000000000002e-06 2024-09-21T22:01:31.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858207+0000", 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6449999999999999e-06 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858212+0000", 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0549999999999999e-06 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881352+0000", 2024-09-21T22:01:31.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023140609999999999 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881438+0000", 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5278000000000006e-05 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881541+0000", 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103033 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28832 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.741750202, 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023498735999999999, 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28832 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3099999999999999e-07 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858220+0000", 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858223+0000", 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.641e-06 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858226+0000", 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9919999999999999e-06 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881570+0000", 2024-09-21T22:01:31.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023343632999999999 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881644+0000", 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3645000000000004e-05 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881717+0000", 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3066999999999997e-05 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28833 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1257472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.627 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.741738141000001, 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023709134999999999, 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28833 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:31.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:01:31.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858231+0000", 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.175e-06 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858235+0000", 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4290000000000001e-06 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858239+0000", 2024-09-21T22:01:31.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0990000000000001e-06 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881761+0000", 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023522279 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881847+0000", 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6018000000000002e-05 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881939+0000", 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1910999999999995e-05 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.741723538, 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.632 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:01:31.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.741704074999999, 2024-09-21T22:01:31.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.640 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.741675998, 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:01:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:01:31.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.741654166, 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:01:31.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.741633839, 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:01:31.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:01:31.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:01:31.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.741612877, 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.653 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:01:31.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.74159189, 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:01:31.657 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29857 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2793472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.661 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893198+0000", 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.706769773, 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929718000000002, 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29857 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893198+0000", 2024-09-21T22:01:31.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893198+0000", 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893199+0000", 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8699999999999995e-07 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893201+0000", 2024-09-21T22:01:31.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9130000000000001e-06 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893207+0000", 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.28e-06 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893218+0000", 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0479000000000001e-05 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.915992+0000", 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022774325000000002 2024-09-21T22:01:31.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916062+0000", 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9839000000000007e-05 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916128+0000", 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6395000000000004e-05 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29858 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2834432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.665 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.706742373999999, 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023030268999999999, 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29858 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5900000000000002e-07 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893228+0000", 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1859999999999999e-06 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893235+0000", 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7139999999999996e-06 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893241+0000", 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7620000000000001e-06 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916157+0000", 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022915819 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916200+0000", 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2898999999999997e-05 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916256+0000", 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.643e-05 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.669 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29859 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2875392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.706720878, 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023235025999999999, 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29859 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893248+0000", 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.89e-07 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893249+0000", 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4950000000000001e-06 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893255+0000", 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9410000000000004e-06 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893260+0000", 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1930000000000001e-06 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916285+0000", 2024-09-21T22:01:31.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023024203 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916375+0000", 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0486000000000001e-05 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916482+0000", 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000107219 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29860 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2916352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.706700896999999, 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023394503000000001, 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29860 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893268+0000", 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893270+0000", 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893282+0000", 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2291e-05 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893287+0000", 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2480000000000004e-06 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916509+0000", 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023221836999999999 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916567+0000", 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7615999999999999e-05 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916662+0000", 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.501e-05 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29861 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2957312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.706673625000001, 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023596588000000002, 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29861 2024-09-21T22:01:31.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:01:31.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893297+0000", 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2539999999999999e-06 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893304+0000", 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893308+0000", 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4800000000000003e-06 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916697+0000", 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023388720000000002 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916787+0000", 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9777999999999993e-05 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916891+0000", 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010459900000000001 2024-09-21T22:01:31.681 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29862 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2998272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.70665425, 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023721644, 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.682 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29862 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893316+0000", 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.091e-06 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893322+0000", 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893328+0000", 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2299999999999999e-06 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916932+0000", 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023603889999999999 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916980+0000", 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8803e-05 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.685 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917036+0000", 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5219000000000001e-05 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29863 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 3031040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.706634911, 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023866634000000001, 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:31.686 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29863 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:31.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893334+0000", 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893339+0000", 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893345+0000", 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1469999999999998e-06 2024-09-21T22:01:31.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893356+0000", 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0772e-05 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917062+0000", 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023706261999999999 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917108+0000", 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5318000000000002e-05 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:31.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:31.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:31.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917200+0000", 2024-09-21T22:01:31.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2238999999999996e-05 2024-09-21T22:01:31.690 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.690 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.690 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.690 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:31.690 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:31.690 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:31.692 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:31.689+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:31.692 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:31.693 INFO:teuthology.orchestra.run.smithi102.stdout:3328 write 0xb7aca7c thru 0xb7ae0ed (0x1672 bytes) 2024-09-21T22:01:31.693 INFO:teuthology.orchestra.run.smithi102.stdout:3329 write 0xd3bdeb7 thru 0xd3c4778 (0x68c2 bytes) 2024-09-21T22:01:31.693 INFO:teuthology.orchestra.run.smithi102.stdout:3330 trunc from 0xd3c4779 to 0xa7e7f67 2024-09-21T22:01:31.693 INFO:teuthology.orchestra.run.smithi102.stdout:3331 trunc from 0xa7e7f67 to 0xa96c7d8 2024-09-21T22:01:31.693 INFO:teuthology.orchestra.run.smithi102.stdout:3332 write 0x15fd37b thru 0x15ffe64 (0x2aea bytes) 2024-09-21T22:01:31.693 INFO:teuthology.orchestra.run.smithi102.stdout:3333 writesame 0x3a82429 thru 0x3a8761c data_size 0xa(0x51f4 bytes) 2024-09-21T22:01:31.693 INFO:teuthology.orchestra.run.smithi102.stdout:3334 trunc from 0xa96c7d8 to 0x6f687b5 2024-09-21T22:01:31.694 INFO:teuthology.orchestra.run.smithi102.stdout:3336 writesame 0x659b283 thru 0x65a3afd data_size 0x1(0x887b bytes) 2024-09-21T22:01:31.694 INFO:teuthology.orchestra.run.smithi102.stdout:3337 read 0x6d162bb thru 0x6d25162 (0xeea8 bytes) 2024-09-21T22:01:31.694 INFO:teuthology.orchestra.run.smithi102.stdout:3339 write 0x9bd63ff thru 0x9bd6998 (0x59a bytes) 2024-09-21T22:01:31.694 INFO:teuthology.orchestra.run.smithi102.stdout:3342 read 0x505b632 thru 0x5064c97 (0x9666 bytes) 2024-09-21T22:01:31.694 INFO:teuthology.orchestra.run.smithi102.stdout:3343 punch from 0x7c29bcd to 0x7c3242f, (0x8862 bytes) 2024-09-21T22:01:31.696 INFO:teuthology.orchestra.run.smithi102.stdout:3344 write 0xb95ed10 thru 0xb95f383 (0x674 bytes) 2024-09-21T22:01:31.698 INFO:teuthology.orchestra.run.smithi102.stdout:3345 punch from 0x436dd68 to 0x4375a3a, (0x7cd2 bytes) 2024-09-21T22:01:31.698 INFO:teuthology.orchestra.run.smithi102.stdout:3346 trunc from 0xb95f384 to 0xb113df8 2024-09-21T22:01:31.707 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:31.713 INFO:teuthology.orchestra.run.smithi102.stdout:3348 trunc from 0xb113df8 to 0x66fced9 2024-09-21T22:01:31.730 INFO:teuthology.orchestra.run.smithi102.stdout:3349 write 0x8374dc3 thru 0x837cdac (0x7fea bytes) 2024-09-21T22:01:31.737 INFO:teuthology.orchestra.run.smithi102.stdout:3350 trunc from 0x837cdad to 0xbfb80ae 2024-09-21T22:01:31.742 INFO:teuthology.orchestra.run.smithi102.stdout:3351 read 0xe824df thru 0xe8b66c (0x918e bytes) 2024-09-21T22:01:31.743 INFO:teuthology.orchestra.run.smithi102.stdout:3352 write 0xbb7b07e thru 0xbb8688e (0xb811 bytes) 2024-09-21T22:01:31.747 INFO:teuthology.orchestra.run.smithi102.stdout:3353 read 0x9c02b24 thru 0x9c03011 (0x4ee bytes) 2024-09-21T22:01:31.754 INFO:teuthology.orchestra.run.smithi102.stdout:3354 trunc from 0xbfb80ae to 0x637a750 2024-09-21T22:01:31.766 INFO:teuthology.orchestra.run.smithi102.stdout:3356 clone 26 order 21 su 131072 sc 14 2024-09-21T22:01:31.792 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:31.791+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:31.804 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:31.804 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:31.804 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:31.804 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:31.813 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:31.840 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:01:31.893 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:31.891+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:31.910 INFO:teuthology.orchestra.run.smithi102.stdout:leaving image image_client.0-clone25 intact 2024-09-21T22:01:31.951 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:31.951 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:31.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:32.004 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:32.003+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:32.009 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-21T22:01:32.095 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:32.093+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:32.114 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:32.114 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:32.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:32.114 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:32.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.114 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.114 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:32.114 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.872105895000001, 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.872083876000001, 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.119 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:01:32.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.872063295, 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:32.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.872034697, 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:01:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:01:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.872012292000001, 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:01:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:01:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871992277, 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871972073999999, 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871952815, 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871926748, 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871906097, 2024-09-21T22:01:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:01:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871847918, 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871793139000001, 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871758682999999, 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871737353, 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:01:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:01:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871716192000001, 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871685668000001, 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:01:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871661309, 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:01:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871640004, 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:01:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871618613999999, 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:01:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.871597247, 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.198 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:32.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:32.200 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:32.198+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:32.277 INFO:teuthology.orchestra.run.smithi102.stdout:3357 read 0x4a236ed thru 0x4a2e085 (0xa999 bytes) 2024-09-21T22:01:32.281 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.288 INFO:teuthology.orchestra.run.smithi102.stdout:3360 trunc from 0x637a750 to 0xc3b1ec1 2024-09-21T22:01:32.294 INFO:teuthology.orchestra.run.smithi102.stdout:3364 writesame 0xa6529da thru 0xa65815c data_size 0x1(0x5783 bytes) 2024-09-21T22:01:32.300 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:32.298+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:32.313 INFO:teuthology.orchestra.run.smithi102.stdout:3365 trunc from 0xc3b1ec1 to 0x6e1b4c5 2024-09-21T22:01:32.342 INFO:teuthology.orchestra.run.smithi102.stdout:3367 punch from 0x5ac9e00 to 0x5ad79e7, (0xdbe7 bytes) 2024-09-21T22:01:32.349 INFO:teuthology.orchestra.run.smithi102.stdout:3368 trunc from 0x6e1b4c5 to 0xcc9dd17 2024-09-21T22:01:32.353 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:32.353 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:32.353 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:32.353 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:32.354 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.354 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.354 INFO:teuthology.orchestra.run.smithi102.stdout:3371 writesame 0x6cea41b thru 0x6cf28c9 data_size 0x1(0x84af bytes) 2024-09-21T22:01:32.362 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:32.369 INFO:teuthology.orchestra.run.smithi102.stdout:3373 read 0x69db223 thru 0x69ea38b (0xf169 bytes) 2024-09-21T22:01:32.370 INFO:teuthology.orchestra.run.smithi102.stdout:3375 write 0x4d5f821 thru 0x4d6d4ab (0xdc8b bytes) 2024-09-21T22:01:32.375 INFO:teuthology.orchestra.run.smithi102.stdout:3376 read 0x8f0f4ff thru 0x8f1dec9 (0xe9cb bytes) 2024-09-21T22:01:32.375 INFO:teuthology.orchestra.run.smithi102.stdout:3377 read 0xbdaf371 thru 0xbdbb4f7 (0xc187 bytes) 2024-09-21T22:01:32.376 INFO:teuthology.orchestra.run.smithi102.stdout:3379 read 0x1df2a8f thru 0x1df78d2 (0x4e44 bytes) 2024-09-21T22:01:32.384 INFO:teuthology.orchestra.run.smithi102.stdout:3380 write 0xded9183 thru 0xdee37ff (0xa67d bytes) 2024-09-21T22:01:32.387 INFO:teuthology.orchestra.run.smithi102.stdout:3381 write 0x674ea51 thru 0x67594e7 (0xaa97 bytes) 2024-09-21T22:01:32.389 INFO:teuthology.orchestra.run.smithi102.stdout:3382 writesame 0x4f0eb99 thru 0x4f1eafb data_size 0x5d(0xff63 bytes) 2024-09-21T22:01:32.396 INFO:teuthology.orchestra.run.smithi102.stdout:3383 trunc from 0xdee3800 to 0x8e6255d 2024-09-21T22:01:32.400 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:32.399+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:32.405 INFO:teuthology.orchestra.run.smithi102.stdout:3384 read 0x5f84a6d thru 0x5f8ee87 (0xa41b bytes) 2024-09-21T22:01:32.409 INFO:teuthology.orchestra.run.smithi102.stdout:3385 trunc from 0x8e6255d to 0xbb44672 2024-09-21T22:01:32.415 INFO:teuthology.orchestra.run.smithi102.stdout:3387 write 0x463bb7e thru 0x46403f1 (0x4874 bytes) 2024-09-21T22:01:32.419 INFO:teuthology.orchestra.run.smithi102.stdout:3389 punch from 0x7e77e18 to 0x7e852c5, (0xd4ad bytes) 2024-09-21T22:01:32.419 INFO:teuthology.orchestra.run.smithi102.stdout:3390 writesame 0x1494406 thru 0x149e699 data_size 0xa(0xa294 bytes) 2024-09-21T22:01:32.434 INFO:teuthology.orchestra.run.smithi102.stdout:3391 write 0xd0af2e3 thru 0xd0bd030 (0xdd4e bytes) 2024-09-21T22:01:32.437 INFO:teuthology.orchestra.run.smithi102.stdout:3392 read 0x52b17fa thru 0x52c0a77 (0xf27e bytes) 2024-09-21T22:01:32.438 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.438 INFO:teuthology.orchestra.run.smithi102.stdout:3394 punch from 0x2b7ef4d to 0x2b89ea5, (0xaf58 bytes) 2024-09-21T22:01:32.438 INFO:teuthology.orchestra.run.smithi102.stdout:3397 read 0xad7161a thru 0xad80f2c (0xf913 bytes) 2024-09-21T22:01:32.438 INFO:teuthology.orchestra.run.smithi102.stdout:3398 read 0x8a36e45 thru 0x8a3bda7 (0x4f63 bytes) 2024-09-21T22:01:32.438 INFO:teuthology.orchestra.run.smithi102.stdout:3399 write 0x3dc2e3b thru 0x3dcd2e7 (0xa4ad bytes) 2024-09-21T22:01:32.442 INFO:teuthology.orchestra.run.smithi102.stdout:3400 trunc from 0xd0bd031 to 0xe3f0e1f 2024-09-21T22:01:32.448 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.448 INFO:teuthology.orchestra.run.smithi102.stdout:3404 read 0xacb983d thru 0xacbdd08 (0x44cc bytes) 2024-09-21T22:01:32.448 INFO:teuthology.orchestra.run.smithi102.stdout:3405 write 0xcdb109d thru 0xcdb2a9d (0x1a01 bytes) 2024-09-21T22:01:32.457 INFO:teuthology.orchestra.run.smithi102.stdout:3406 trunc from 0xe3f0e1f to 0x8ba2ec4 2024-09-21T22:01:32.477 INFO:teuthology.orchestra.run.smithi102.stdout:3407 write 0xac64b4c thru 0xac72a0d (0xdec2 bytes) 2024-09-21T22:01:32.480 INFO:teuthology.orchestra.run.smithi102.stdout:3408 write 0x103234a thru 0x103bb90 (0x9847 bytes) 2024-09-21T22:01:32.485 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:32.485 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:32.486 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:32.486 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:32.486 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:32.488 INFO:teuthology.orchestra.run.smithi102.stdout:3409 writesame 0x878ac94 thru 0x879196d data_size 0x1(0x6cda bytes) 2024-09-21T22:01:32.495 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:32.501 INFO:teuthology.orchestra.run.smithi102.stdout:3410 punch from 0x34d562e to 0x34d7b49, (0x251b bytes) 2024-09-21T22:01:32.501 INFO:teuthology.orchestra.run.smithi102.stdout:3414 read 0x92ba016 thru 0x92c8605 (0xe5f0 bytes) 2024-09-21T22:01:32.501 INFO:teuthology.orchestra.run.smithi102.stdout:3416 write 0x4c3de85 thru 0x4c482c4 (0xa440 bytes) 2024-09-21T22:01:32.501 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:32.500+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:32.513 INFO:teuthology.orchestra.run.smithi102.stdout:3418 writesame 0xd7f7ef4 thru 0xd807979 data_size 0x3f(0xfa86 bytes) 2024-09-21T22:01:32.513 INFO:teuthology.orchestra.run.smithi102.stdout:3420 write 0x3ce4a3 thru 0x3d6145 (0x7ca3 bytes) 2024-09-21T22:01:32.521 INFO:teuthology.orchestra.run.smithi102.stdout:3421 punch from 0x4c858b1 to 0x4c85b10, (0x25f bytes) 2024-09-21T22:01:32.521 INFO:teuthology.orchestra.run.smithi102.stdout:3422 punch from 0x2cfe3b5 to 0x2d0837e, (0x9fc9 bytes) 2024-09-21T22:01:32.530 INFO:teuthology.orchestra.run.smithi102.stdout:3423 trunc from 0xd80797a to 0x5ad2387 2024-09-21T22:01:32.543 INFO:teuthology.orchestra.run.smithi102.stdout:3424 punch from 0x4eb4d27 to 0x4eb8171, (0x344a bytes) 2024-09-21T22:01:32.543 INFO:teuthology.orchestra.run.smithi102.stdout:3426 read 0x38a5cd6 thru 0x38acc0b (0x6f36 bytes) 2024-09-21T22:01:32.543 INFO:teuthology.orchestra.run.smithi102.stdout:3427 punch from 0x1400715 to 0x140b222, (0xab0d bytes) 2024-09-21T22:01:32.543 INFO:teuthology.orchestra.run.smithi102.stdout:3428 write 0x2f2d9d2 thru 0x2f33e79 (0x64a8 bytes) 2024-09-21T22:01:32.558 INFO:teuthology.orchestra.run.smithi102.stdout:3429 write 0xa27236e thru 0xa27fa2c (0xd6bf bytes) 2024-09-21T22:01:32.560 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.561 INFO:teuthology.orchestra.run.smithi102.stdout:3432 read 0x3afaf18 thru 0x3aff3b4 (0x449d bytes) 2024-09-21T22:01:32.568 INFO:teuthology.orchestra.run.smithi102.stdout:3433 trunc from 0xa27fa2d to 0x4726c60 2024-09-21T22:01:32.597 INFO:teuthology.orchestra.run.smithi102.stdout:3434 writesame 0x66dd4b4 thru 0x66dfcce data_size 0x1(0x281b bytes) 2024-09-21T22:01:32.602 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:32.601+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:32.612 INFO:teuthology.orchestra.run.smithi102.stdout:3435 write 0xe09c68c thru 0xe0a6210 (0x9b85 bytes) 2024-09-21T22:01:32.616 INFO:teuthology.orchestra.run.smithi102.stdout:3436 writesame 0x40d73e thru 0x40e04f data_size 0x12(0x912 bytes) 2024-09-21T22:01:32.623 INFO:teuthology.orchestra.run.smithi102.stdout:3437 punch from 0x2dd1734 to 0x2ddcdeb, (0xb6b7 bytes) 2024-09-21T22:01:32.623 INFO:teuthology.orchestra.run.smithi102.stdout:3438 read 0x1f5b2ce thru 0x1f5cef9 (0x1c2c bytes) 2024-09-21T22:01:32.626 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.661232865000001, 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.627 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.661211624, 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.631 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.661190396, 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.635 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:01:32.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:01:32.638 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.661166789999999, 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.6611475, 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.643 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:32.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:01:32.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:32.647 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.661115254, 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:01:32.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:01:32.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.651 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.661091284999999, 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:32.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:01:32.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:01:32.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.655 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.661071721000001, 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:32.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:01:32.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:01:32.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.659 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.661051289, 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.660 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:01:32.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.661030166, 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.664 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.66101095, 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.668 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:01:32.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.660990478, 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:01:32.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.660969763000001, 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.676 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:32.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:01:32.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:01:32.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.678 INFO:teuthology.orchestra.run.smithi102.stdout:3439 trunc from 0xe0a6211 to 0xbc9be01 2024-09-21T22:01:32.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:01:32.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:01:32.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.660950007, 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:01:32.681 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:01:32.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:01:32.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:32.685 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.660930292, 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.660910382000001, 2024-09-21T22:01:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:01:32.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.693 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.660889399, 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.660868714999999, 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.701 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.660842811, 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.702 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:01:32.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.705 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.660821894, 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:32.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:01:32.709 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.710 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.710 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.710 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:32.710 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:32.710 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:32.710 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:32.713 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.713 INFO:teuthology.orchestra.run.smithi102.stdout:3441 writesame 0x948aa70 thru 0x9495771 data_size 0x2b(0xad02 bytes) 2024-09-21T22:01:32.713 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:3444 read 0x506f3a2 thru 0x507413b (0x4d9a bytes) 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:3447 write 0xbcf32a9 thru 0xbcfd5a8 (0xa300 bytes) 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:3450 read 0x970b0b3 thru 0x9719cb4 (0xec02 bytes) 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:3451 write 0x6097644 thru 0x60a7437 (0xfdf4 bytes) 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:3453 write 0xd76f03d thru 0xd779e45 (0xae09 bytes) 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:3454 read 0x2bb75e thru 0x2c5341 (0x9be4 bytes) 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:3460 read 0xbed69f8 thru 0xbedd490 (0x6a99 bytes) 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:3461 read 0x8301ecf thru 0x830e7e4 (0xc916 bytes) 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:3462 writesame 0x8b770f thru 0x8bc99d data_size 0x5(0x528f bytes) 2024-09-21T22:01:32.714 INFO:teuthology.orchestra.run.smithi102.stdout:3463 punch from 0x2b16540 to 0x2b1ebfc, (0x86bc bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3464 read 0x69eef44 thru 0x69f502b (0x60e8 bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3465 punch from 0x77950aa to 0x77a2c2c, (0xdb82 bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3468 read 0x369784 thru 0x373412 (0x9c8f bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3469 write 0x1802398 thru 0x1805461 (0x30ca bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3470 punch from 0x6a374cb to 0x6a41d96, (0xa8cb bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3472 writesame 0x2c73ff5 thru 0x2c7b4ec data_size 0x4c(0x74f8 bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3473 write 0x70b26fd thru 0x70b5f81 (0x3885 bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:truncating to largest ever: 0xed04f97 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3474 trunc from 0xd779e46 to 0xed04f97 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3475 write 0x3531ac9 thru 0x3537308 (0x5840 bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3476 read 0x6e54169 thru 0x6e5b8ca (0x7762 bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3477 write 0x15030cc thru 0x150592c (0x2861 bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3478 read 0x761bd18 thru 0x76235e2 (0x78cb bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3479 write 0xb564020 thru 0xb56cf5b (0x8f3c bytes) 2024-09-21T22:01:32.715 INFO:teuthology.orchestra.run.smithi102.stdout:3480 writesame 0x61cc6d8 thru 0x61d1808 data_size 0x1(0x5131 bytes) 2024-09-21T22:01:32.716 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:32.712+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:32.716 INFO:teuthology.orchestra.run.smithi102.stdout:3483 read 0x9513d0c thru 0x9518d98 (0x508d bytes) 2024-09-21T22:01:32.716 INFO:teuthology.orchestra.run.smithi102.stdout:3484 read 0x2b9a9fc thru 0x2baa47d (0xfa82 bytes) 2024-09-21T22:01:32.717 INFO:teuthology.orchestra.run.smithi102.stdout:3485 write 0xc3c8b94 thru 0xc3cf1fd (0x666a bytes) 2024-09-21T22:01:32.720 INFO:teuthology.orchestra.run.smithi102.stdout:3486 punch from 0x5a8c54a to 0x5a8d512, (0xfc8 bytes) 2024-09-21T22:01:32.720 INFO:teuthology.orchestra.run.smithi102.stdout:3487 read 0xced9326 thru 0xcedb0fe (0x1dd9 bytes) 2024-09-21T22:01:32.720 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.720 INFO:teuthology.orchestra.run.smithi102.stdout:3490 read 0x3cae253 thru 0x3cb1ebb (0x3c69 bytes) 2024-09-21T22:01:32.720 INFO:teuthology.orchestra.run.smithi102.stdout:3492 punch from 0xc11ea0c to 0xc129a12, (0xb006 bytes) 2024-09-21T22:01:32.720 INFO:teuthology.orchestra.run.smithi102.stdout:3493 read 0x21c970f thru 0x21d2063 (0x8955 bytes) 2024-09-21T22:01:32.736 INFO:teuthology.orchestra.run.smithi102.stdout:3495 trunc from 0xed04f97 to 0x1ed0908 2024-09-21T22:01:32.789 INFO:teuthology.orchestra.run.smithi102.stdout:3496 write 0xe6e4e49 thru 0xe6eeb3f (0x9cf7 bytes) 2024-09-21T22:01:32.798 INFO:teuthology.orchestra.run.smithi102.stdout:3497 write 0xeb26e1e thru 0xeb2d408 (0x65eb bytes) 2024-09-21T22:01:32.801 INFO:teuthology.orchestra.run.smithi102.stdout:3498 read 0xbb568bc thru 0xbb5ff26 (0x966b bytes) 2024-09-21T22:01:32.801 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.801 INFO:teuthology.orchestra.run.smithi102.stdout:3501 writesame 0xd4bd73e thru 0xd4c76cf data_size 0x19(0x9f92 bytes) 2024-09-21T22:01:32.814 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:32.813+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:32.823 INFO:teuthology.orchestra.run.smithi102.stdout:3502 trunc from 0xeb2d409 to 0x348da2a 2024-09-21T22:01:32.836 INFO:teuthology.orchestra.run.smithi102.stdout:3503 punch from 0x270b94 to 0x27699d, (0x5e09 bytes) 2024-09-21T22:01:32.836 INFO:teuthology.orchestra.run.smithi102.stdout:3504 read 0x71d347 thru 0x72d0b1 (0xfd6b bytes) 2024-09-21T22:01:32.837 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:32.837 INFO:teuthology.orchestra.run.smithi102.stdout:3506 punch from 0x19df819 to 0x19e2b74, (0x335b bytes) 2024-09-21T22:01:32.857 INFO:teuthology.orchestra.run.smithi102.stdout:3507 write 0xe2d41ec thru 0xe2d96cc (0x54e1 bytes) 2024-09-21T22:01:32.860 INFO:teuthology.orchestra.run.smithi102.stdout:3508 punch from 0xbc282a to 0xbc9232, (0x6a08 bytes) 2024-09-21T22:01:32.860 INFO:teuthology.orchestra.run.smithi102.stdout:3510 read 0xbd59478 thru 0xbd65a19 (0xc5a2 bytes) 2024-09-21T22:01:32.861 INFO:teuthology.orchestra.run.smithi102.stdout:3511 write 0x40e6bee thru 0x40eefff (0x8412 bytes) 2024-09-21T22:01:32.862 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:32.862 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:32.862 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:32.862 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:32.881 INFO:teuthology.orchestra.run.smithi102.stdout:3512 trunc from 0xe2d96cd to 0x1b342b9 2024-09-21T22:01:32.887 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:32.915 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:32.913+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:33.016 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:33.014+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:33.031 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:33.031 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:33.031 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:33.031 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:33.032 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:33.040 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:33.108 INFO:teuthology.orchestra.run.smithi102.stdout:3514 punch from 0x964573 to 0x971fa7, (0xda34 bytes) 2024-09-21T22:01:33.116 INFO:teuthology.orchestra.run.smithi102.stdout:3515 writesame 0x32eda9e thru 0x32edf13 data_size 0x2(0x476 bytes) 2024-09-21T22:01:33.117 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:33.115+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:33.126 INFO:teuthology.orchestra.run.smithi102.stdout:3516 trunc from 0x32edf14 to 0xbe3a73d 2024-09-21T22:01:33.133 INFO:teuthology.orchestra.run.smithi102.stdout:3517 read 0xb23cbbd thru 0xb2480f0 (0xb534 bytes) 2024-09-21T22:01:33.133 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:33.133 INFO:teuthology.orchestra.run.smithi102.stdout:3519 punch from 0x61827d6 to 0x618da83, (0xb2ad bytes) 2024-09-21T22:01:33.133 INFO:teuthology.orchestra.run.smithi102.stdout:3520 punch from 0x505d034 to 0x506733d, (0xa309 bytes) 2024-09-21T22:01:33.133 INFO:teuthology.orchestra.run.smithi102.stdout:3521 punch from 0x265fc25 to 0x2663174, (0x354f bytes) 2024-09-21T22:01:33.133 INFO:teuthology.orchestra.run.smithi102.stdout:3523 write 0xba1f01b thru 0xba21a6a (0x2a50 bytes) 2024-09-21T22:01:33.138 INFO:teuthology.orchestra.run.smithi102.stdout:3525 write 0x72f556a thru 0x72fa2cb (0x4d62 bytes) 2024-09-21T22:01:33.141 INFO:teuthology.orchestra.run.smithi102.stdout:3527 write 0x62a4ffc thru 0x62b38f0 (0xe8f5 bytes) 2024-09-21T22:01:33.145 INFO:teuthology.orchestra.run.smithi102.stdout:3528 read 0x5f0d40a thru 0x5f143ae (0x6fa5 bytes) 2024-09-21T22:01:33.147 INFO:teuthology.orchestra.run.smithi102.stdout:3529 trunc from 0xbe3a73d to 0x9821063 2024-09-21T22:01:33.154 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.282327326000001, 2024-09-21T22:01:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.282307333, 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.282187898, 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:01:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:01:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281921192, 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:01:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281891030000001, 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281865494, 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:01:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281842965999999, 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:01:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:01:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281819346000001, 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:01:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281798996999999, 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:01:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:01:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281776582999999, 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:01:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281600515999999, 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:01:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:01:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:01:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281571508000001, 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281549676999999, 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:01:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:01:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281392532, 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:01:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:01:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281360061999999, 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.217 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281338530999999, 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:01:33.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281317214, 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.222 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:01:33.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:01:33.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281291771999999, 2024-09-21T22:01:33.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.230 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281271072999999, 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:01:33.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.281250440999999, 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:01:33.235 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:01:33.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:01:33.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.239 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:33.240 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:33.240 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:33.241 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:33.242 INFO:teuthology.orchestra.run.smithi102.stdout:3531 write 0x98b90ba thru 0x98be058 (0x4f9f bytes) 2024-09-21T22:01:33.242 INFO:teuthology.orchestra.run.smithi102.stdout:3532 read 0x52ea5c9 thru 0x52f3f63 (0x999b bytes) 2024-09-21T22:01:33.242 INFO:teuthology.orchestra.run.smithi102.stdout:3533 write 0x5dd88bb thru 0x5de1de9 (0x952f bytes) 2024-09-21T22:01:33.242 INFO:teuthology.orchestra.run.smithi102.stdout:3534 trunc from 0x98be059 to 0x73c8064 2024-09-21T22:01:33.242 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:33.242 INFO:teuthology.orchestra.run.smithi102.stdout:3537 trunc from 0x73c8064 to 0x6ed1cef 2024-09-21T22:01:33.242 INFO:teuthology.orchestra.run.smithi102.stdout:3538 read 0x1128345 thru 0x112e721 (0x63dd bytes) 2024-09-21T22:01:33.243 INFO:teuthology.orchestra.run.smithi102.stdout:3539 read 0x45f94be thru 0x460886b (0xf3ae bytes) 2024-09-21T22:01:33.243 INFO:teuthology.orchestra.run.smithi102.stdout:3540 write 0x71d6970 thru 0x71e6776 (0xfe07 bytes) 2024-09-21T22:01:33.243 INFO:teuthology.orchestra.run.smithi102.stdout:3541 trunc from 0x71e6777 to 0xfbc351 2024-09-21T22:01:33.243 INFO:teuthology.orchestra.run.smithi102.stdout:3544 read 0x70ed79 thru 0x719655 (0xa8dd bytes) 2024-09-21T22:01:33.243 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:33.240+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:33.257 INFO:teuthology.orchestra.run.smithi102.stdout:3545 write 0xbc9f78b thru 0xbca064c (0xec2 bytes) 2024-09-21T22:01:33.263 INFO:teuthology.orchestra.run.smithi102.stdout:3546 trunc from 0xbca064d to 0xe2e234b 2024-09-21T22:01:33.269 INFO:teuthology.orchestra.run.smithi102.stdout:3547 writesame 0x7cc1262 thru 0x7ccea0c data_size 0x1f(0xd7ab bytes) 2024-09-21T22:01:33.273 INFO:teuthology.orchestra.run.smithi102.stdout:3548 write 0xe0d0b54 thru 0xe0d11d6 (0x683 bytes) 2024-09-21T22:01:33.276 INFO:teuthology.orchestra.run.smithi102.stdout:3549 write 0x1bbd132 thru 0x1bc5c4a (0x8b19 bytes) 2024-09-21T22:01:33.277 INFO:teuthology.orchestra.run.smithi102.stdout:3550 write 0x65badb4 thru 0x65c6c5e (0xbeab bytes) 2024-09-21T22:01:33.283 INFO:teuthology.orchestra.run.smithi102.stdout:3551 punch from 0xc04239a to 0xc04c236, (0x9e9c bytes) 2024-09-21T22:01:33.284 INFO:teuthology.orchestra.run.smithi102.stdout:3552 clone 27 order 22 su 131072 sc 9 2024-09-21T22:01:33.342 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:33.340+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:33.361 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:33.361 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:33.370 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:33.442 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:33.440+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:33.473 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:33.515 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:33.515 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:33.515 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:33.515 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:33.515 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:33.524 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:33.542 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:33.541+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:33.596 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:33.596 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:33.628 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:33.628 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:33.643 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:33.642+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:33.644 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:33.645 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:33.660 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:33.661 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:33.677 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:33.677 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:33.682 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:33.682 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:33.691 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:33.694 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:33.695 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:33.711 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:33.711 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:33.728 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:33.728 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:33.744 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:33.743+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:33.797 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:33.797 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:33.806 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:33.848 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:33.846+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:33.857 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:01:33.927 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone26 from 0xe2e234b (overlap 0xfbc351) to 0x64b486 2024-09-21T22:01:33.946 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:33.945+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:33.967 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:33.967 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:33.976 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:34.039 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-21T22:01:34.046 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:34.044+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:34.099 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:34.099 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:34.113 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:34.154 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:34.152+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:34.195 INFO:teuthology.orchestra.run.smithi102.stdout:3553 writesame 0x10eeaf3 thru 0x10eeda0 data_size 0x7(0x2ae bytes) 2024-09-21T22:01:34.204 INFO:teuthology.orchestra.run.smithi102.stdout:3555 write 0xd495b82 thru 0xd49bd13 (0x6192 bytes) 2024-09-21T22:01:34.208 INFO:teuthology.orchestra.run.smithi102.stdout:3556 read 0x61c89df thru 0x61cfee3 (0x7505 bytes) 2024-09-21T22:01:34.210 INFO:teuthology.orchestra.run.smithi102.stdout:3557 trunc from 0xe2e234b to 0xcb3df8f 2024-09-21T22:01:34.232 INFO:teuthology.orchestra.run.smithi102.stdout:3558 write 0x3e2e923 thru 0x3e331d1 (0x48af bytes) 2024-09-21T22:01:34.235 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:34.247 INFO:teuthology.orchestra.run.smithi102.stdout:3561 trunc from 0xcb3df8f to 0x3662637 2024-09-21T22:01:34.247 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:34.245+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:34.268 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:34.269 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:34.278 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:34.285 INFO:teuthology.orchestra.run.smithi102.stdout:3562 write 0x7acf345 thru 0x7ad8f64 (0x9c20 bytes) 2024-09-21T22:01:34.288 INFO:teuthology.orchestra.run.smithi102.stdout:3563 write 0x73639c1 thru 0x73681b5 (0x47f5 bytes) 2024-09-21T22:01:34.291 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:34.291 INFO:teuthology.orchestra.run.smithi102.stdout:3565 write 0x1bda2a7 thru 0x1be0a0c (0x6766 bytes) 2024-09-21T22:01:34.303 INFO:teuthology.orchestra.run.smithi102.stdout:3566 punch from 0x5488a44 to 0x5493345, (0xa901 bytes) 2024-09-21T22:01:34.303 INFO:teuthology.orchestra.run.smithi102.stdout:3567 write 0x224a188 thru 0x224db4e (0x39c7 bytes) 2024-09-21T22:01:34.312 INFO:teuthology.orchestra.run.smithi102.stdout:3568 read 0x3d89522 thru 0x3d97a7b (0xe55a bytes) 2024-09-21T22:01:34.312 INFO:teuthology.orchestra.run.smithi102.stdout:3569 read 0x51dc1b3 thru 0x51dceb3 (0xd01 bytes) 2024-09-21T22:01:34.312 INFO:teuthology.orchestra.run.smithi102.stdout:3570 read 0x75ed031 thru 0x75fcbf6 (0xfbc6 bytes) 2024-09-21T22:01:34.312 INFO:teuthology.orchestra.run.smithi102.stdout:3571 read 0x3575c4a thru 0x35833f5 (0xd7ac bytes) 2024-09-21T22:01:34.312 INFO:teuthology.orchestra.run.smithi102.stdout:3572 read 0x404bd41 thru 0x405330a (0x75ca bytes) 2024-09-21T22:01:34.313 INFO:teuthology.orchestra.run.smithi102.stdout:3573 trunc from 0x7ad8f65 to 0x790456c 2024-09-21T22:01:34.319 INFO:teuthology.orchestra.run.smithi102.stdout:3574 write 0x7751bb1 thru 0x7757729 (0x5b79 bytes) 2024-09-21T22:01:34.322 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:34.333 INFO:teuthology.orchestra.run.smithi102.stdout:3576 write 0xbc265a0 thru 0xbc2d329 (0x6d8a bytes) 2024-09-21T22:01:34.343 INFO:teuthology.orchestra.run.smithi102.stdout:3577 write 0xc4bf9a3 thru 0xc4c7ae3 (0x8141 bytes) 2024-09-21T22:01:34.346 INFO:teuthology.orchestra.run.smithi102.stdout:3578 read 0x4f64bf4 thru 0x4f6f2a5 (0xa6b2 bytes) 2024-09-21T22:01:34.347 INFO:teuthology.orchestra.run.smithi102.stdout:3579 writesame 0x25c994a thru 0x25d0c3d data_size 0x1c(0x72f4 bytes) 2024-09-21T22:01:34.347 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:34.346+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:34.348 INFO:teuthology.orchestra.run.smithi102.stdout:3582 read 0x4929e97 thru 0x492f65a (0x57c4 bytes) 2024-09-21T22:01:34.348 INFO:teuthology.orchestra.run.smithi102.stdout:3583 writesame 0x7379c05 thru 0x737cd8c data_size 0x14(0x3188 bytes) 2024-09-21T22:01:34.350 INFO:teuthology.orchestra.run.smithi102.stdout:3584 punch from 0x46d776 to 0x476a9a, (0x9324 bytes) 2024-09-21T22:01:34.350 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:34.350 INFO:teuthology.orchestra.run.smithi102.stdout:3586 read 0xa02297b thru 0xa02aa94 (0x811a bytes) 2024-09-21T22:01:34.350 INFO:teuthology.orchestra.run.smithi102.stdout:3588 writesame 0x7bc8b6e thru 0x7bcf32c data_size 0x27(0x67bf bytes) 2024-09-21T22:01:34.351 INFO:teuthology.orchestra.run.smithi102.stdout:3589 write 0x33ed9e1 thru 0x33ee6a7 (0xcc7 bytes) 2024-09-21T22:01:34.355 INFO:teuthology.orchestra.run.smithi102.stdout:3590 trunc from 0xc4c7ae4 to 0x9800e3e 2024-09-21T22:01:34.365 INFO:teuthology.orchestra.run.smithi102.stdout:3592 clone 28 order 20 su 32768 sc 4 2024-09-21T22:01:34.424 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:34.424 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:34.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:34.448 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:34.447+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:34.536 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:34.536 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:34.545 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:34.588 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:34.586+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:34.648 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:34.648 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:34.650 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:34.648+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:34.656 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:34.757 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:34.755+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:34.800 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:34.800 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:34.809 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:34.844 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:01:34.844 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:01:34.844 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [0, 1, 2, 3, 4, 5, 7, 6] 2024-09-21T22:01:34.845 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 6 2024-09-21T22:01:34.852 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:34.850+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:34.858 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:01:34.947 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone27 from 0x9800e3e (overlap 0x3662637) to 0x1b3131b 2024-09-21T22:01:34.952 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:34.951+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:34.970 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:34.970 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:34.983 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:35.068 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:35.066+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:35.077 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-21T22:01:35.098 INFO:teuthology.orchestra.run.smithi102.stdout:3593 trunc from 0x9800e3e to 0x7c32540 2024-09-21T22:01:35.112 INFO:teuthology.orchestra.run.smithi102.stdout:3594 read 0x1ab87d6 thru 0x1ac4d72 (0xc59d bytes) 2024-09-21T22:01:35.113 INFO:teuthology.orchestra.run.smithi102.stdout:3597 punch from 0x325310f to 0x325476a, (0x165b bytes) 2024-09-21T22:01:35.114 INFO:teuthology.orchestra.run.smithi102.stdout:3598 trunc from 0x7c32540 to 0x83ac529 2024-09-21T22:01:35.132 INFO:teuthology.orchestra.run.smithi102.stdout:3600 trunc from 0x83ac529 to 0xbaee2ea 2024-09-21T22:01:35.137 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.137 INFO:teuthology.orchestra.run.smithi102.stdout:3604 read 0x3585a79 thru 0x3594aec (0xf074 bytes) 2024-09-21T22:01:35.137 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:35.137 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:35.138 INFO:teuthology.orchestra.run.smithi102.stdout:3605 write 0x47e4d0f thru 0x47e746d (0x275f bytes) 2024-09-21T22:01:35.149 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:35.153 INFO:teuthology.orchestra.run.smithi102.stdout:3607 punch from 0xb251ab0 to 0xb25b1ff, (0x974f bytes) 2024-09-21T22:01:35.153 INFO:teuthology.orchestra.run.smithi102.stdout:3608 punch from 0xb6bf862 to 0xb6c682e, (0x6fcc bytes) 2024-09-21T22:01:35.153 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.153 INFO:teuthology.orchestra.run.smithi102.stdout:3610 write 0x18d688b thru 0x18e51c7 (0xe93d bytes) 2024-09-21T22:01:35.154 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:35.153+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:35.158 INFO:teuthology.orchestra.run.smithi102.stdout:3613 write 0xa6bdf4f thru 0xa6c8624 (0xa6d6 bytes) 2024-09-21T22:01:35.166 INFO:teuthology.orchestra.run.smithi102.stdout:3615 punch from 0x6a50892 to 0x6a5d209, (0xc977 bytes) 2024-09-21T22:01:35.166 INFO:teuthology.orchestra.run.smithi102.stdout:3616 read 0x74a22f3 thru 0x74afc89 (0xd997 bytes) 2024-09-21T22:01:35.167 INFO:teuthology.orchestra.run.smithi102.stdout:3617 write 0xde7a34 thru 0xdf0e09 (0x93d6 bytes) 2024-09-21T22:01:35.189 INFO:tasks.ceph.mon.a.smithi102.stderr:2024-09-21T22:01:35.188+0000 7f46e9689640 -1 mon.a@0(leader).osd e62 definitely_dead 0 2024-09-21T22:01:35.190 INFO:teuthology.orchestra.run.smithi102.stdout:3618 write 0xe46d569 thru 0xe46f425 (0x1ebd bytes) 2024-09-21T22:01:35.193 INFO:teuthology.orchestra.run.smithi102.stdout:3619 writesame 0x313b0d3 thru 0x3145367 data_size 0x1(0xa295 bytes) 2024-09-21T22:01:35.209 INFO:teuthology.orchestra.run.smithi102.stdout:3620 read 0xbbc6b03 thru 0xbbd1fb8 (0xb4b6 bytes) 2024-09-21T22:01:35.209 INFO:teuthology.orchestra.run.smithi102.stdout:3622 writesame 0xca1c4bb thru 0xca20368 data_size 0x47(0x3eae bytes) 2024-09-21T22:01:35.213 INFO:teuthology.orchestra.run.smithi102.stdout:3623 punch from 0x9b08e66 to 0x9b0e875, (0x5a0f bytes) 2024-09-21T22:01:35.213 INFO:teuthology.orchestra.run.smithi102.stdout:3624 read 0x9d65b84 thru 0x9d66229 (0x6a6 bytes) 2024-09-21T22:01:35.213 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.213 INFO:teuthology.orchestra.run.smithi102.stdout:3628 read 0xb63a44 thru 0xb65c98 (0x2255 bytes) 2024-09-21T22:01:35.215 INFO:teuthology.orchestra.run.smithi102.stdout:3629 write 0xe0e9450 thru 0xe0f4234 (0xade5 bytes) 2024-09-21T22:01:35.219 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.219 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.219 INFO:teuthology.orchestra.run.smithi102.stdout:3632 read 0xe381101 thru 0xe390846 (0xf746 bytes) 2024-09-21T22:01:35.220 INFO:teuthology.orchestra.run.smithi102.stdout:3633 write 0x21135d5 thru 0x2120797 (0xd1c3 bytes) 2024-09-21T22:01:35.228 INFO:teuthology.orchestra.run.smithi102.stdout:3634 write 0x1eab9ab thru 0x1eb7849 (0xbe9f bytes) 2024-09-21T22:01:35.238 INFO:teuthology.orchestra.run.smithi102.stdout:3635 trunc from 0xe46f426 to 0xad3d1b4 2024-09-21T22:01:35.248 INFO:teuthology.orchestra.run.smithi102.stdout:3636 write 0x8cdf059 thru 0x8cedb3b (0xeae3 bytes) 2024-09-21T22:01:35.253 INFO:teuthology.orchestra.run.smithi102.stdout:3638 write 0x11d0daa thru 0x11dcfb1 (0xc208 bytes) 2024-09-21T22:01:35.255 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:35.254+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:35.259 INFO:teuthology.orchestra.run.smithi102.stdout:3639 punch from 0x8875a88 to 0x88814c8, (0xba40 bytes) 2024-09-21T22:01:35.259 INFO:teuthology.orchestra.run.smithi102.stdout:3641 write 0x5a1fe4a thru 0x5a213e2 (0x1599 bytes) 2024-09-21T22:01:35.262 INFO:teuthology.orchestra.run.smithi102.stdout:3642 write 0x3386092 thru 0x3388cc9 (0x2c38 bytes) 2024-09-21T22:01:35.280 INFO:teuthology.orchestra.run.smithi102.stdout:3643 trunc from 0xad3d1b4 to 0x27d01f4 2024-09-21T22:01:35.306 INFO:teuthology.orchestra.run.smithi102.stdout:3644 punch from 0x9e9503 to 0x9eac14, (0x1711 bytes) 2024-09-21T22:01:35.306 INFO:teuthology.orchestra.run.smithi102.stdout:3645 writesame 0x148d915 thru 0x1491e50 data_size 0x1c(0x453c bytes) 2024-09-21T22:01:35.313 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:35.313 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:35.315 INFO:teuthology.orchestra.run.smithi102.stdout:3648 read 0x245d5a0 thru 0x2469b86 (0xc5e7 bytes) 2024-09-21T22:01:35.322 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:35.336 INFO:teuthology.orchestra.run.smithi102.stdout:3649 write 0xd3d03a4 thru 0xd3db316 (0xaf73 bytes) 2024-09-21T22:01:35.341 INFO:teuthology.orchestra.run.smithi102.stdout:3650 read 0x6f086b1 thru 0x6f11fea (0x993a bytes) 2024-09-21T22:01:35.343 INFO:teuthology.orchestra.run.smithi102.stdout:3651 trunc from 0xd3db317 to 0xc12aa7c 2024-09-21T22:01:35.356 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:35.355+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:35.357 INFO:teuthology.orchestra.run.smithi102.stdout:3653 trunc from 0xc12aa7c to 0x8c0f638 2024-09-21T22:01:35.374 INFO:teuthology.orchestra.run.smithi102.stdout:3654 writesame 0xee1bd60 thru 0xee2ac8b data_size 0x2(0xef2c bytes) 2024-09-21T22:01:35.374 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.374 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.375 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.375 INFO:teuthology.orchestra.run.smithi102.stdout:3660 write 0x784bc9 thru 0x7911c2 (0xc5fa bytes) 2024-09-21T22:01:35.390 INFO:teuthology.orchestra.run.smithi102.stdout:3661 write 0xdd37731 thru 0xdd390a1 (0x1971 bytes) 2024-09-21T22:01:35.395 INFO:teuthology.orchestra.run.smithi102.stdout:3663 read 0xcf18fb3 thru 0xcf1939d (0x3eb bytes) 2024-09-21T22:01:35.395 INFO:teuthology.orchestra.run.smithi102.stdout:3664 read 0x10915f3 thru 0x109896b (0x7379 bytes) 2024-09-21T22:01:35.395 INFO:teuthology.orchestra.run.smithi102.stdout:3665 read 0xd6b8361 thru 0xd6c8309 (0xffa9 bytes) 2024-09-21T22:01:35.395 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.395 INFO:teuthology.orchestra.run.smithi102.stdout:3668 writesame 0x9e0e159 thru 0x9e152e9 data_size 0xb(0x7191 bytes) 2024-09-21T22:01:35.400 INFO:teuthology.orchestra.run.smithi102.stdout:3669 read 0x4728eca thru 0x47337cb (0xa902 bytes) 2024-09-21T22:01:35.400 INFO:teuthology.orchestra.run.smithi102.stdout:3670 write 0x3a67874 thru 0x3a76e0c (0xf599 bytes) 2024-09-21T22:01:35.405 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.405 INFO:teuthology.orchestra.run.smithi102.stdout:3672 writesame 0x7563a52 thru 0x75689b3 data_size 0x9(0x4f62 bytes) 2024-09-21T22:01:35.410 INFO:teuthology.orchestra.run.smithi102.stdout:3673 write 0xe60569b thru 0xe605b51 (0x4b7 bytes) 2024-09-21T22:01:35.413 INFO:teuthology.orchestra.run.smithi102.stdout:3674 read 0x5aeaa7a thru 0x5af1c1e (0x71a5 bytes) 2024-09-21T22:01:35.413 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:35.413 INFO:teuthology.orchestra.run.smithi102.stdout:3676 read 0x78948dd thru 0x789f1fa (0xa91e bytes) 2024-09-21T22:01:35.413 INFO:teuthology.orchestra.run.smithi102.stdout:3677 write 0x4ed9560 thru 0x4edb4a3 (0x1f44 bytes) 2024-09-21T22:01:35.416 INFO:teuthology.orchestra.run.smithi102.stdout:3678 punch from 0x5db017 to 0x5db775, (0x75e bytes) 2024-09-21T22:01:35.416 INFO:teuthology.orchestra.run.smithi102.stdout:3680 write 0xc6a104d thru 0xc6ab2f5 (0xa2a9 bytes) 2024-09-21T22:01:35.424 INFO:teuthology.orchestra.run.smithi102.stdout:3682 trunc from 0xee2ac8c to 0xdfee269 2024-09-21T22:01:35.434 INFO:teuthology.orchestra.run.smithi102.stdout:3684 writesame 0x6e60736 thru 0x6e6796f data_size 0x1(0x723a bytes) 2024-09-21T22:01:35.441 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:35.441 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:35.449 INFO:teuthology.orchestra.run.smithi102.stdout:3686 punch from 0x78e8211 to 0x78f191e, (0x970d bytes) 2024-09-21T22:01:35.450 INFO:teuthology.orchestra.run.smithi102.stdout:3687 clone 29 order 21 su 1048576 sc 13 2024-09-21T22:01:35.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:35.494 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:35.493+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:35.554 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:35.554 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:35.557 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:35.555+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:35.562 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:35.657 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:35.656+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:35.706 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:35.706 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:35.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:35.739 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:35.759 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:35.758+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:35.819 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:35.820 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:35.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:35.865 INFO:teuthology.orchestra.run.smithi102.stderr:marked out osd.6. 2024-09-21T22:01:35.866 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:35.865+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:35.898 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:35.898 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:35.917 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:35.917 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:35.936 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:35.936 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:35.944 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:35.944 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:35.944 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:35.944 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:35.952 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:35.952 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:35.953 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:35.960 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:35.958+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:35.969 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:35.969 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:35.986 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:35.986 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:36.003 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:36.003 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:36.019 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:36.020 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:36.073 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:36.072+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:36.074 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:36.074 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:36.074 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:36.074 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:36.074 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:36.083 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:36.161 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:36.160+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:36.228 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:36.228 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:36.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:36.228 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:36.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.228 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.228 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:36.228 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262750472, 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:36.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:01:36.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:01:36.232 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262729231000002, 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.233 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:01:36.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262708003, 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.237 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:36.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:01:36.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:01:36.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262684397000001, 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:36.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:01:36.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:01:36.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262665107, 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.245 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262632861, 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:01:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:01:36.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.253 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262608891999999, 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.257 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262589328000001, 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:01:36.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:01:36.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:01:36.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:01:36.261 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262568896000001, 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.262 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:36.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:01:36.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262547773000001, 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.266 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:01:36.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262528557, 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.270 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262508085, 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.274 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:36.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.278 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262487369999999, 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:01:36.282 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262467613999998, 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.283 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:01:36.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:01:36.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262447899000001, 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.287 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:36.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262427988999999, 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.291 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:36.295 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262407006, 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:01:36.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262386322000001, 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.300 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:36.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:01:36.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:01:36.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262360418, 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.304 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:01:36.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.262339501, 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.309 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:01:36.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:01:36.313 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.313 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.313 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.313 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.313 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.313 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:36.314 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:36.315 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:36.313+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:36.415 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:36.413+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:36.458 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:36.458 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:36.459 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:36.459 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:36.467 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:36.515 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:36.514+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:36.570 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:36.570 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:36.571 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:36.571 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:36.571 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:36.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:36.620 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:36.619+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:36.717 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:36.716+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.853263467000001, 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.725 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.729 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.853243473999999, 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.733 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.853124039000001, 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852857332999999, 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.739 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:01:36.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852827171000001, 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.743 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852801634999999, 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.747 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.751 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852779107, 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852755487, 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:01:36.759 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852735138, 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.760 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:36.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:01:36.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:01:36.763 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852712724, 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.764 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:01:36.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:01:36.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852536657000002, 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.768 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852507649, 2024-09-21T22:01:36.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:36.776 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852485818000002, 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852328672999999, 2024-09-21T22:01:36.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:01:36.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:01:36.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.784 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852296203000002, 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:36.788 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852274672, 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:01:36.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.792 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852253354999998, 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852227913, 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852207214, 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.801 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:36.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.804 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.852186582000002, 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:36.805 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:36.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:01:36.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:01:36.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.809 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.809 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.809 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:36.809 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:36.809 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:36.810 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:36.851 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:36.850+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:36.876 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:01:36.919 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:36.917+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:36.959 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:36.959 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:36.959 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:36.960 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:36.969 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:37.020 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:37.019+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:37.079 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:37.079 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:37.079 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:37.079 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:37.079 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:37.088 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:37.130 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:37.129+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:37.222 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:37.221+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:37.234 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:37.234 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:37.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:37.234 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:37.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.234 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31366 3.8 3:12d1962e:::rbd_header.1124528f4459:head [watch reconnect cookie 140678969648192 gen 7] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.234 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:37.234 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.265769707, 2024-09-21T22:01:37.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030645964000000001, 2024-09-21T22:01:37.234 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31366 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:37.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966206+0000", 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4499999999999997e-07 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966208+0000", 2024-09-21T22:01:37.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966214+0000", 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966219+0000", 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6929999999999998e-06 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.990079+0000", 2024-09-21T22:01:37.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023859706000000001 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.990148+0000", 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9617999999999997e-05 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.996851+0000", 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067029969999999996 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31674 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3407872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252916648999999, 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028037220000000002, 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31674 2024-09-21T22:01:37.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979059+0000", 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979061+0000", 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.95e-06 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979066+0000", 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.711e-06 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979071+0000", 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.006972+0000", 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027900748 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007034+0000", 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2069999999999994e-05 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007096+0000", 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1691000000000003e-05 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31675 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3248128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252898269999999, 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028176435999999999, 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31675 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5299999999999999e-07 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979080+0000", 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.898e-06 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979086+0000", 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979091+0000", 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6720000000000003e-06 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007123+0000", 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028032267 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007183+0000", 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9979999999999998e-05 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007253+0000", 2024-09-21T22:01:37.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0184000000000004e-05 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31676 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3448832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252878429999999, 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028418516000000001, 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31676 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979106+0000", 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.969e-06 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979112+0000", 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2210000000000002e-06 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979117+0000", 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6290000000000001e-06 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007349+0000", 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028232548 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007430+0000", 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0894000000000002e-05 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007515+0000", 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4875000000000003e-05 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31677 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3289088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252851841999998, 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028585294000000001, 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.251 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31677 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979124+0000", 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979125+0000", 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.756e-06 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979131+0000", 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9839999999999998e-06 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979136+0000", 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007548+0000", 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0284119 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007628+0000", 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9921999999999998e-05 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007709+0000", 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0840000000000005e-05 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31678 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3489792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.2528334, 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028748336999999999, 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.255 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31678 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979144+0000", 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.849e-06 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979150+0000", 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6710000000000004e-06 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979154+0000", 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007740+0000", 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028585880000000001 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007810+0000", 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9883999999999997e-05 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007890+0000", 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0203000000000004e-05 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31679 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3330048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252815120000001, 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028877613999999999, 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.259 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31679 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:37.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2300000000000002e-07 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979162+0000", 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9190000000000002e-06 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979168+0000", 2024-09-21T22:01:37.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979173+0000", 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5600000000000004e-06 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007934+0000", 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028761627000000001 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007996+0000", 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1571999999999999e-05 2024-09-21T22:01:37.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008038+0000", 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1718000000000003e-05 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31680 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3530752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252796617000001, 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029001378000000001, 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.263 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31680 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:37.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979179+0000", 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000002e-07 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979181+0000", 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.787e-06 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979188+0000", 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1199999999999996e-06 2024-09-21T22:01:37.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979193+0000", 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8919999999999999e-06 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008069+0000", 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028875872 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008115+0000", 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6069999999999998e-05 2024-09-21T22:01:37.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008180+0000", 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5290000000000007e-05 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31681 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3371008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252776638, 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029168017000000001, 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.267 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31681 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:37.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979199+0000", 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979205+0000", 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9970000000000004e-06 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979211+0000", 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4919999999999998e-06 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979216+0000", 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8749999999999999e-06 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008223+0000", 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029006451999999999 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008295+0000", 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2248000000000004e-05 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008366+0000", 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1581999999999993e-05 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31682 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252752681, 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029288165000000001, 2024-09-21T22:01:37.271 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31682 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979223+0000", 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979225+0000", 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8980000000000001e-06 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979231+0000", 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.981e-06 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979236+0000", 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008404+0000", 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029168296 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008453+0000", 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8729000000000001e-05 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008511+0000", 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8048999999999999e-05 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31683 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3411968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252733832000001, 2024-09-21T22:01:37.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029408805, 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31683 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979242+0000", 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979243+0000", 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.838e-06 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979249+0000", 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9259999999999997e-06 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979254+0000", 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7899999999999999e-06 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008535+0000", 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029281042 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008592+0000", 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6369000000000002e-05 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008650+0000", 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8457e-05 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31684 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3612672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252696442000001, 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029486117999999999, 2024-09-21T22:01:37.279 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31684 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3200000000000005e-07 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979281+0000", 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0679999999999999e-06 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979288+0000", 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7510000000000002e-06 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979293+0000", 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008667+0000", 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029373574 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008702+0000", 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5827000000000001e-05 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008765+0000", 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2378999999999993e-05 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31685 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3452928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:37.283 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252675881999998, 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029661091000000001, 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31685 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979300+0000", 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979301+0000", 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7910000000000001e-06 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979307+0000", 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9440000000000002e-06 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979312+0000", 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008813+0000", 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029500623 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008889+0000", 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6219999999999999e-05 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008960+0000", 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1378999999999995e-05 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31686 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3653632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:37.287 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252657289999998, 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029843732000000001, 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31686 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979326+0000", 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3889999999999999e-06 2024-09-21T22:01:37.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979332+0000", 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4339999999999997e-06 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979337+0000", 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009017+0000", 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029680213 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009093+0000", 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6039999999999997e-05 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009162+0000", 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8554999999999997e-05 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31687 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3493888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252631820000001, 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030002866, 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31687 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979344+0000", 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979346+0000", 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8670000000000001e-06 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979352+0000", 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0090000000000004e-06 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979356+0000", 2024-09-21T22:01:37.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5719999999999996e-06 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009203+0000", 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029847041000000001 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009274+0000", 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0722000000000005e-05 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009346+0000", 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2266000000000002e-05 2024-09-21T22:01:37.295 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31689 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3534848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252613364999998, 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030169466999999998, 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.296 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31689 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979364+0000", 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7799999999999999e-06 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979370+0000", 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6999999999999996e-06 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979374+0000", 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7199999999999997e-06 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009378+0000", 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030003795999999999 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009453+0000", 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4801000000000004e-05 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009531+0000", 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8342000000000003e-05 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31690 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3575808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252594843000001, 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030330343999999999, 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.300 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31690 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979381+0000", 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.15e-07 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979382+0000", 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.821e-06 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979388+0000", 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0229999999999998e-06 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979393+0000", 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5480000000000003e-06 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009561+0000", 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030168107999999999 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009633+0000", 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2402000000000002e-05 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009711+0000", 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7126999999999995e-05 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31692 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3616768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252576241, 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030488531999999999, 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.304 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31692 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979401+0000", 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.767e-06 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979407+0000", 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9390000000000002e-06 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979412+0000", 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009789+0000", 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030377662999999999 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009845+0000", 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5890000000000002e-05 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009887+0000", 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2231999999999998e-05 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31694 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3657728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.252556892000001, 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030552935999999999, 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:37.308 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31694 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979419+0000", 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2799999999999996e-07 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979421+0000", 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.832e-06 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979426+0000", 2024-09-21T22:01:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8930000000000002e-06 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979431+0000", 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7360000000000001e-06 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009906+0000", 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030474378 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009940+0000", 2024-09-21T22:01:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4183000000000001e-05 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009971+0000", 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1386000000000001e-05 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:32214 3.8 3:1692a8f0:::rbd_data.1124528f4459.0000000000000017:head [stat,delete] snapc 11=[11] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.23783667, 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027931175999999999, 2024-09-21T22:01:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 32214 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994139+0000", 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994144+0000", 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7319999999999998e-06 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994155+0000", 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1164e-05 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994163+0000", 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6190000000000002e-06 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.016856+0000", 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.022692985999999998 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.016924+0000", 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8299000000000005e-05 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.017307+0000", 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00038259200000000001 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.020069+0000", 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027618180000000001 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.021976+0000", 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019070580000000001 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.022030+0000", 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4265000000000003e-05 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.022070+0000", 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9700000000000003e-05 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.318 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:37.318 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:37.318 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:37.319 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:37.363 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:37.361+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:37.424 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:37.423+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:37.440 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:37.440 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:37.440 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:37.440 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:37.450 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:37.534 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:37.532+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:37.596 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:37.596 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:37.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:37.626 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:37.625+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:37.727 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:37.726+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:37.750 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:37.750 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:37.750 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:37.750 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 38.536498178999999, 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.751 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:01:37.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:01:37.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.755 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15469 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.515137284000001, 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015141767, 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.756 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15469 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233118+0000", 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233126+0000", 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8720000000000002e-06 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233139+0000", 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3059e-05 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248059+0000", 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.014920022999999999 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248146+0000", 2024-09-21T22:01:37.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7787000000000005e-05 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248257+0000", 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011013799999999999 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15470 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5963776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:37.760 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.515106721999999, 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015332264, 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15470 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233146+0000", 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233148+0000", 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1409999999999999e-06 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233155+0000", 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5329999999999997e-06 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233160+0000", 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3560000000000003e-06 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248307+0000", 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015147396 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248400+0000", 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2592999999999999e-05 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248478+0000", 2024-09-21T22:01:37.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7789999999999999e-05 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15471 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.515079147000002, 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015441796000000001, 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.765 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15471 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233175+0000", 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1459999999999999e-06 2024-09-21T22:01:37.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233183+0000", 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4170000000000003e-06 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233188+0000", 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8459999999999999e-06 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248509+0000", 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015321461 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248556+0000", 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6417e-05 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248615+0000", 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9148999999999999e-05 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.769 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15736 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509823296, 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01497829, 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15736 2024-09-21T22:01:37.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238429+0000", 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238431+0000", 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238437+0000", 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8300000000000001e-06 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238441+0000", 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4349999999999999e-06 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253306+0000", 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01486497 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253351+0000", 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4394000000000002e-05 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253407+0000", 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6218999999999998e-05 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15737 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509804858999999, 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015163012999999999, 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.774 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15737 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238448+0000", 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238449+0000", 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.922e-06 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238456+0000", 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6649999999999997e-06 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238460+0000", 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3100000000000002e-06 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253442+0000", 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.014981563 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253520+0000", 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8242000000000001e-05 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253610+0000", 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9936000000000001e-05 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.778 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15738 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509785984000001, 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015268319000000001, 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15738 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238467+0000", 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9599999999999999e-07 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238468+0000", 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.832e-06 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238474+0000", 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1880000000000001e-06 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238478+0000", 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2529999999999998e-06 2024-09-21T22:01:37.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253637+0000", 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015159540000000001 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253680+0000", 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2904000000000001e-05 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253734+0000", 2024-09-21T22:01:37.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4106e-05 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15739 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509769309999999, 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015455638000000001, 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.783 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15739 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1300000000000001e-07 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238485+0000", 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.773e-06 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238490+0000", 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.558e-06 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238495+0000", 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3089999999999997e-06 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253769+0000", 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015274601 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253852+0000", 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3022000000000006e-05 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253938+0000", 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6062000000000004e-05 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15740 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3080192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509751998999999, 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015561972, 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.787 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15740 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238501+0000", 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.89e-07 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238508+0000", 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3509999999999996e-06 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238514+0000", 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238519+0000", 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6890000000000003e-06 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253965+0000", 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015445739999999999 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254008+0000", 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3096000000000002e-05 2024-09-21T22:01:37.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254062+0000", 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4153999999999997e-05 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15741 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3538944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509726889, 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015737879, 2024-09-21T22:01:37.791 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15741 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238526+0000", 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238527+0000", 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.79e-06 2024-09-21T22:01:37.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238533+0000", 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238543+0000", 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8430000000000005e-06 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254096+0000", 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015553301 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254175+0000", 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8708999999999995e-05 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254263+0000", 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7886000000000005e-05 2024-09-21T22:01:37.795 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15742 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.50970323, 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015842728, 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.796 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15742 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238552+0000", 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3769999999999999e-06 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238557+0000", 2024-09-21T22:01:37.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7420000000000003e-06 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238562+0000", 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000003e-06 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254295+0000", 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015733080999999999 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254338+0000", 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2967999999999999e-05 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254392+0000", 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3956999999999999e-05 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.800 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15743 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509684667999998, 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016024549999999999, 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15743 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238568+0000", 2024-09-21T22:01:37.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238570+0000", 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238575+0000", 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6559999999999997e-06 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238580+0000", 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4309999999999996e-06 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254427+0000", 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015847070000000001 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254504+0000", 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7230000000000004e-05 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254592+0000", 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7902e-05 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15744 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 4653056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509666662000001, 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016131405000000001, 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.805 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15744 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238586+0000", 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1100000000000002e-07 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238587+0000", 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238593+0000", 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9669999999999998e-06 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238603+0000", 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4020000000000008e-06 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254619+0000", 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01601619 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254663+0000", 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3532000000000003e-05 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254717+0000", 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4197000000000003e-05 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.809 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15745 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5111808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.50964325, 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016324899, 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15745 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238615+0000", 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0329999999999997e-06 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238621+0000", 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1680000000000001e-06 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238626+0000", 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7060000000000003e-06 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254751+0000", 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016125409 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254834+0000", 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2945e-05 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254934+0000", 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9259999999999995e-05 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.813 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15746 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509619790999999, 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016492038000000001, 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15746 2024-09-21T22:01:37.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238633+0000", 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.53e-07 2024-09-21T22:01:37.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238635+0000", 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0449999999999999e-06 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238646+0000", 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1357e-05 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238651+0000", 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1370000000000001e-06 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254971+0000", 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016319966000000002 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255050+0000", 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8827999999999998e-05 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255124+0000", 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4351999999999996e-05 2024-09-21T22:01:37.817 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15747 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509592759, 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016613851999999998, 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15747 2024-09-21T22:01:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238660+0000", 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.82e-07 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238666+0000", 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5050000000000004e-06 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238673+0000", 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4060000000000002e-06 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238677+0000", 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5839999999999996e-06 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255157+0000", 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016480113000000001 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255213+0000", 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5251999999999999e-05 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255273+0000", 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0409999999999999e-05 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15748 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509568251000001, 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016710974, 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.822 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15748 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7999999999999996e-07 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238686+0000", 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-06 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238692+0000", 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4330000000000003e-06 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238696+0000", 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2440000000000004e-06 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255306+0000", 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016609749 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255346+0000", 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0052000000000002e-05 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255395+0000", 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8976e-05 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15749 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6684672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509550564000001, 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016816903000000001, 2024-09-21T22:01:37.826 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15749 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238702+0000", 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6399999999999998e-07 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238704+0000", 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.046e-06 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238709+0000", 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238714+0000", 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3209999999999998e-06 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255419+0000", 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016704734999999998 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255466+0000", 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7179999999999999e-05 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255518+0000", 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2676999999999997e-05 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15750 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:37.830 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509532588999999, 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016896227999999999, 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15750 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238720+0000", 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238722+0000", 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0059999999999999e-06 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238728+0000", 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8150000000000002e-06 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238732+0000", 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255531+0000", 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016798678000000001 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255568+0000", 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7316e-05 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255616+0000", 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7515000000000002e-05 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15751 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.509514233000001, 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.017028596, 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15751 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238740+0000", 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9240000000000001e-06 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238746+0000", 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238750+0000", 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2440000000000004e-06 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255635+0000", 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016884356999999999 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255679+0000", 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3974000000000003e-05 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255766+0000", 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.838 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.839 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.839 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:37.840 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:37.840 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:37.839+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:37.873 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:01:37.940 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:37.939+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:37.951 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone28 from 0xdfee269 (overlap 0x27d01f4) to 0x3fb365 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:47342 3.1c 3:38f0b263:::rbd_data.1124144236b8.0000000000000005:head [stat out=16b,delete] snapc 1f=[1f] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:37.953660+0000", 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.0072536620000000001, 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.007271858, 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "waiting for sub ops", 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.962 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 47342 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953660+0000", 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953660+0000", 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.963 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953661+0000", 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0890000000000001e-06 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953665+0000", 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4309999999999996e-06 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953677+0000", 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2019e-05 2024-09-21T22:01:37.964 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953685+0000", 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6629999999999993e-06 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953738+0000", 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3083e-05 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953814+0000", 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6582000000000006e-05 2024-09-21T22:01:37.965 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953983+0000", 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000168598 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.958621+0000", 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046383170000000003 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.966 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:47346 3.1d 3:bf839440:::rbd_data.1124144236b8.0000000000000009:head [stat,delete] snapc 1f=[1f] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:37.953739+0000", 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.0071742009999999998, 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0072455669999999996, 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 47346 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:37.967 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953739+0000", 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953739+0000", 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953740+0000", 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7999999999999996e-07 2024-09-21T22:01:37.968 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953744+0000", 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3989999999999997e-06 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953751+0000", 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7379999999999997e-06 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.953756+0000", 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0969999999999996e-06 2024-09-21T22:01:37.969 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.955124+0000", 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0013679670000000001 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:37.955245+0000", 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000121704 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: ], 2024-09-21T22:01:37.970 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 2 2024-09-21T22:01:37.971 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:37.976 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:38.032 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:38.041 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:38.039+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:38.099 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:38.099 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:38.099 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:38.099 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:38.099 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:38.108 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:38.111 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-21T22:01:38.149 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:38.147+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:38.162 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:38.163 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:38.169 INFO:teuthology.orchestra.run.smithi102.stdout:3688 trunc from 0xdfee269 to 0x2db2681 2024-09-21T22:01:38.185 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:38.185 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:38.202 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:38.203 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:38.204 INFO:teuthology.orchestra.run.smithi102.stdout:3689 write 0x7b0f7f9 thru 0x7b16a24 (0x722c bytes) 2024-09-21T22:01:38.213 INFO:teuthology.orchestra.run.smithi102.stdout:3690 trunc from 0x7b16a25 to 0x3c6ce7d 2024-09-21T22:01:38.223 INFO:teuthology.orchestra.run.smithi102.stdout:3691 read 0x13774bb thru 0x1381e99 (0xa9df bytes) 2024-09-21T22:01:38.223 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:38.223 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:38.239 INFO:teuthology.orchestra.run.smithi102.stdout:3692 write 0xaa23c18 thru 0xaa25fd3 (0x23bc bytes) 2024-09-21T22:01:38.241 INFO:teuthology.orchestra.run.smithi102.stdout:3693 read 0xfa330b thru 0xfaafaf (0x7ca5 bytes) 2024-09-21T22:01:38.242 INFO:teuthology.orchestra.run.smithi102.stdout:3694 write 0x361073d thru 0x3616cab (0x656f bytes) 2024-09-21T22:01:38.243 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:38.241+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:38.247 INFO:teuthology.orchestra.run.smithi102.stdout:3695 read 0x696c7f3 thru 0x6975f73 (0x9781 bytes) 2024-09-21T22:01:38.247 INFO:teuthology.orchestra.run.smithi102.stdout:3696 read 0x7903c39 thru 0x790fd56 (0xc11e bytes) 2024-09-21T22:01:38.247 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:38.248 INFO:teuthology.orchestra.run.smithi102.stdout:3698 punch from 0x3dcfd9c to 0x3ddfb1a, (0xfd7e bytes) 2024-09-21T22:01:38.249 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:38.256 INFO:teuthology.orchestra.run.smithi102.stdout:3699 write 0xd4bb54e thru 0xd4bef98 (0x3a4b bytes) 2024-09-21T22:01:38.258 INFO:teuthology.orchestra.run.smithi102.stdout:3700 write 0x88f7ef9 thru 0x89069d6 (0xeade bytes) 2024-09-21T22:01:38.263 INFO:teuthology.orchestra.run.smithi102.stdout:3702 punch from 0x4b9b783 to 0x4b9bb88, (0x405 bytes) 2024-09-21T22:01:38.263 INFO:teuthology.orchestra.run.smithi102.stdout:3703 read 0x4e9d3ca thru 0x4eac668 (0xf29f bytes) 2024-09-21T22:01:38.263 INFO:teuthology.orchestra.run.smithi102.stdout:3704 read 0x61cf576 thru 0x61d7b6b (0x85f6 bytes) 2024-09-21T22:01:38.263 INFO:teuthology.orchestra.run.smithi102.stdout:3705 punch from 0x68812e3 to 0x688d41f, (0xc13c bytes) 2024-09-21T22:01:38.263 INFO:teuthology.orchestra.run.smithi102.stdout:3706 writesame 0x17ebe06 thru 0x17f76c6 data_size 0x1(0xb8c1 bytes) 2024-09-21T22:01:38.264 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:38.264 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:38.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 34.209602429, 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:01:38.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29926 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3567616~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.332941168000001, 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028146526000000002, 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.270 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29926 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:38.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928550+0000", 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928552+0000", 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928558+0000", 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6690000000000003e-06 2024-09-21T22:01:38.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928562+0000", 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2910000000000001e-06 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956591+0000", 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028029011999999999 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956646+0000", 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5016999999999999e-05 2024-09-21T22:01:38.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956696+0000", 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9920999999999999e-05 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29927 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3002368~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.332922938999999, 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028301160999999998, 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.274 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29927 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928569+0000", 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.395e-06 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928573+0000", 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.225e-06 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928575+0000", 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956723+0000", 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028148237 2024-09-21T22:01:38.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956768+0000", 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4749999999999997e-05 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956869+0000", 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010078599999999999 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.278 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29928 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3043328~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.332904239000001, 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028496923, 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29928 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928587+0000", 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4699999999999998e-07 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928588+0000", 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.313e-06 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928591+0000", 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1999999999999999e-06 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928598+0000", 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0890000000000002e-06 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956939+0000", 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028341261 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957006+0000", 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6704000000000004e-05 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957083+0000", 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7108999999999996e-05 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.332887934999999, 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.286 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.332877985, 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:01:38.290 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.332864581999999, 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:01:38.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:38.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:01:38.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.332854910999998, 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.295 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29937 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3248128~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:38.299 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.331077269000001, 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028121855000000001, 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29937 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930414+0000", 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930416+0000", 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-06 2024-09-21T22:01:38.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930422+0000", 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930435+0000", 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2404e-05 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958382+0000", 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027947339000000002 2024-09-21T22:01:38.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958450+0000", 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7611e-05 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958535+0000", 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5680999999999995e-05 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29939 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3289088~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.331022539999999, 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028207189000000001, 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29939 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930471+0000", 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930476+0000", 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4410000000000001e-06 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930480+0000", 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.391e-06 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958565+0000", 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028084392999999999 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958617+0000", 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1706999999999998e-05 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958675+0000", 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8715999999999998e-05 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.307 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29941 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3330048~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.330985238, 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028386958, 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29941 2024-09-21T22:01:38.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930506+0000", 2024-09-21T22:01:38.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930508+0000", 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.782e-06 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930514+0000", 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930518+0000", 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0949999999999998e-06 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958712+0000", 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028194745 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958788+0000", 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5556000000000006e-05 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958892+0000", 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000104304 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29943 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.330941901999999, 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028512368999999999, 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.312 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29943 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-07 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930551+0000", 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930557+0000", 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6799999999999998e-06 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930561+0000", 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5399999999999997e-06 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958929+0000", 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028367277999999999 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958988+0000", 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8928000000000002e-05 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959061+0000", 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3460000000000005e-05 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29945 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3411968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.330903502999998, 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028678985000000001, 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.316 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29945 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930588+0000", 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930589+0000", 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.939e-06 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930595+0000", 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8810000000000001e-06 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930600+0000", 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5539999999999999e-06 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959097+0000", 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028497248999999999 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959184+0000", 2024-09-21T22:01:38.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7170999999999996e-05 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959266+0000", 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1769999999999998e-05 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.330859073999999, 2024-09-21T22:01:38.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:01:38.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:01:38.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.330812817999998, 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:38.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:01:38.328 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.330775483, 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.329 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:01:38.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:01:38.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.330741302, 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.333 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.330701430000001, 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:01:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:38.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 20.330656144999999, 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:01:38.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:01:38.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:40935 3.5 3:a2bf362e:::rbd_data.112498fbc780.0000000000000004:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 11.26514077, 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028536945000000001, 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:38.346 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 40935 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996352+0000", 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.041e-06 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996362+0000", 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0447e-05 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996382+0000", 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9639e-05 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996393+0000", 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1358e-05 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996458+0000", 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4649999999999999e-05 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996523+0000", 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4775000000000002e-05 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.001040+0000", 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045170920000000003 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024702+0000", 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023662336999999999 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024758+0000", 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6138999999999999e-05 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024825+0000", 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6834000000000004e-05 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024887+0000", 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1632999999999998e-05 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:38.351 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:38.352 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:38.353 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:38.354 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:38.355 INFO:teuthology.orchestra.run.smithi102.stdout:3707 punch from 0x4334d0c to 0x43383e1, (0x36d5 bytes) 2024-09-21T22:01:38.355 INFO:teuthology.orchestra.run.smithi102.stdout:3708 read 0xa1b2fe6 thru 0xa1b4c6f (0x1c8a bytes) 2024-09-21T22:01:38.355 INFO:teuthology.orchestra.run.smithi102.stdout:3709 writesame 0x96709bb thru 0x967fe37 data_size 0x3(0xf47d bytes) 2024-09-21T22:01:38.355 INFO:teuthology.orchestra.run.smithi102.stdout:3710 read 0xf9be32 thru 0xfa7735 (0xb904 bytes) 2024-09-21T22:01:38.355 INFO:teuthology.orchestra.run.smithi102.stdout:3713 write 0x6c965ff thru 0x6c9bc39 (0x563b bytes) 2024-09-21T22:01:38.355 INFO:teuthology.orchestra.run.smithi102.stdout:3714 read 0x2c5f3f3 thru 0x2c6326a (0x3e78 bytes) 2024-09-21T22:01:38.355 INFO:teuthology.orchestra.run.smithi102.stdout:3715 writesame 0xcdc1337 thru 0xcdcc868 data_size 0x1b(0xb532 bytes) 2024-09-21T22:01:38.355 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:38.356 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:38.356 INFO:teuthology.orchestra.run.smithi102.stdout:3716 punch from 0x408fa28 to 0x4094bc6, (0x519e bytes) 2024-09-21T22:01:38.356 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:38.356 INFO:teuthology.orchestra.run.smithi102.stdout:3719 read 0xa85879b thru 0xa85a9eb (0x2251 bytes) 2024-09-21T22:01:38.356 INFO:teuthology.orchestra.run.smithi102.stdout:3721 read 0xd835ea thru 0xd911a9 (0xdbc0 bytes) 2024-09-21T22:01:38.356 INFO:teuthology.orchestra.run.smithi102.stdout:3722 write 0xc5ce9d thru 0xc62138 (0x529c bytes) 2024-09-21T22:01:38.358 INFO:teuthology.orchestra.run.smithi102.stdout:3724 read 0x9207a33 thru 0x9211fbb (0xa589 bytes) 2024-09-21T22:01:38.358 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:38.358 INFO:teuthology.orchestra.run.smithi102.stdout:3727 punch from 0xa93c6d1 to 0xa947b28, (0xb457 bytes) 2024-09-21T22:01:38.358 INFO:teuthology.orchestra.run.smithi102.stdout:3728 read 0x98fff27 thru 0x990d110 (0xd1ea bytes) 2024-09-21T22:01:38.358 INFO:teuthology.orchestra.run.smithi102.stdout:3730 write 0x34df237 thru 0x34e5d6a (0x6b34 bytes) 2024-09-21T22:01:38.358 INFO:teuthology.orchestra.run.smithi102.stdout:3731 writesame 0x4feb2ee thru 0x4ff34d2 data_size 0x1(0x81e5 bytes) 2024-09-21T22:01:38.358 INFO:teuthology.orchestra.run.smithi102.stdout:3732 clone 30 order 24 su 524288 sc 4 2024-09-21T22:01:38.358 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:38.351+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:38.454 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:38.451+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:38.460 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:38.460 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:38.469 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:38.555 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:38.553+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:38.612 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:38.612 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:38.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:38.665 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:38.663+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:38.723 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:38.723 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:38.732 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:38.757 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:38.755+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:38.857 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:38.855+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:38.876 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:38.877 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:38.886 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:38.959 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:38.958+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:39.029 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:39.029 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:39.038 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:39.083 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:39.081+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:39.142 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:39.142 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:39.151 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:39.192 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:39.190+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:39.260 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:39.258+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:39.267 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:39.268 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:39.277 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:39.361 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:39.360+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:39.380 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:39.380 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:39.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:39.462 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:39.461+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:39.491 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:39.491 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:39.499 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:39.562 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:39.561+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:39.602 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:39.602 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:39.610 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:39.663 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:39.662+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:39.754 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:39.754 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:39.763 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:39.764 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:39.762+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:39.866 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:39.866 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:39.868 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:39.867+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:39.875 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:39.890 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:01:39.966 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:39.964+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:39.989 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone29 from 0xd4bef99 (overlap 0x2db2681) to 0x248eb9a 2024-09-21T22:01:40.002 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:40.002 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:40.017 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:40.068 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:40.066+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:40.133 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:40.133 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:40.142 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:40.149 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-21T22:01:40.168 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:40.166+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:40.184 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.184 INFO:teuthology.orchestra.run.smithi102.stdout:3736 write 0xb5981fa thru 0xb5a614b (0xdf52 bytes) 2024-09-21T22:01:40.191 INFO:teuthology.orchestra.run.smithi102.stdout:3737 write 0x987c02 thru 0x9907d9 (0x8bd8 bytes) 2024-09-21T22:01:40.221 INFO:teuthology.orchestra.run.smithi102.stdout:3739 write 0x6c33c06 thru 0x6c4244b (0xe846 bytes) 2024-09-21T22:01:40.225 INFO:teuthology.orchestra.run.smithi102.stdout:3740 read 0x7533dde thru 0x753971f (0x5942 bytes) 2024-09-21T22:01:40.225 INFO:teuthology.orchestra.run.smithi102.stdout:3742 read 0x83c42e8 thru 0x83caaa5 (0x67be bytes) 2024-09-21T22:01:40.225 INFO:teuthology.orchestra.run.smithi102.stdout:3743 read 0x173e676 thru 0x174e443 (0xfdce bytes) 2024-09-21T22:01:40.236 INFO:teuthology.orchestra.run.smithi102.stdout:3744 trunc from 0xd4bef99 to 0x652903f 2024-09-21T22:01:40.269 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:40.267+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:40.274 INFO:teuthology.orchestra.run.smithi102.stdout:3745 read 0x4cb912e thru 0x4cc0685 (0x7558 bytes) 2024-09-21T22:01:40.275 INFO:teuthology.orchestra.run.smithi102.stdout:3747 read 0x1500735 thru 0x150e4a2 (0xdd6e bytes) 2024-09-21T22:01:40.275 INFO:teuthology.orchestra.run.smithi102.stdout:3749 writesame 0x50049a1 thru 0x5007db1 data_size 0x3(0x3411 bytes) 2024-09-21T22:01:40.279 INFO:teuthology.orchestra.run.smithi102.stdout:3750 punch from 0x641ba25 to 0x642897f, (0xcf5a bytes) 2024-09-21T22:01:40.280 INFO:teuthology.orchestra.run.smithi102.stdout:3752 trunc from 0x652903f to 0x744123b 2024-09-21T22:01:40.286 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:40.286 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:40.287 INFO:teuthology.orchestra.run.smithi102.stdout:3753 punch from 0x249ac7b to 0x24a045c, (0x57e1 bytes) 2024-09-21T22:01:40.287 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.287 INFO:teuthology.orchestra.run.smithi102.stdout:3757 write 0x1f86ab9 thru 0x1f90921 (0x9e69 bytes) 2024-09-21T22:01:40.288 INFO:teuthology.orchestra.run.smithi102.stdout:3760 trunc from 0x744123b to 0x859428e 2024-09-21T22:01:40.293 INFO:teuthology.orchestra.run.smithi102.stdout:3761 punch from 0x48d72b to 0x48e0ce, (0x9a3 bytes) 2024-09-21T22:01:40.295 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:40.295 INFO:teuthology.orchestra.run.smithi102.stdout:3763 trunc from 0x859428e to 0x64ed774 2024-09-21T22:01:40.302 INFO:teuthology.orchestra.run.smithi102.stdout:3764 writesame 0x493cd61 thru 0x4944e39 data_size 0xf(0x80d9 bytes) 2024-09-21T22:01:40.304 INFO:teuthology.orchestra.run.smithi102.stdout:3765 read 0x46229e3 thru 0x46274a6 (0x4ac4 bytes) 2024-09-21T22:01:40.304 INFO:teuthology.orchestra.run.smithi102.stdout:3766 writesame 0x50eb9c1 thru 0x50ee8c4 data_size 0x11(0x2f04 bytes) 2024-09-21T22:01:40.305 INFO:teuthology.orchestra.run.smithi102.stdout:3767 punch from 0x438c744 to 0x4398a59, (0xc315 bytes) 2024-09-21T22:01:40.314 INFO:teuthology.orchestra.run.smithi102.stdout:3768 writesame 0x9a8aa27 thru 0x9a94e54 data_size 0x2d(0xa42e bytes) 2024-09-21T22:01:40.315 INFO:teuthology.orchestra.run.smithi102.stdout:3769 punch from 0x945daec to 0x9467d13, (0xa227 bytes) 2024-09-21T22:01:40.326 INFO:teuthology.orchestra.run.smithi102.stdout:3770 trunc from 0x9a94e55 to 0x238477 2024-09-21T22:01:40.358 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:40.361 INFO:teuthology.orchestra.run.smithi102.stdout:3771 trunc from 0x238477 to 0x8c8e2e3 2024-09-21T22:01:40.366 INFO:teuthology.orchestra.run.smithi102.stdout:3772 read 0x803a6be thru 0x803cb16 (0x2459 bytes) 2024-09-21T22:01:40.366 INFO:teuthology.orchestra.run.smithi102.stdout:3773 punch from 0x81fcef2 to 0x820cecb, (0xffd9 bytes) 2024-09-21T22:01:40.367 INFO:teuthology.orchestra.run.smithi102.stdout:3774 trunc from 0x8c8e2e3 to 0xa2a260a 2024-09-21T22:01:40.369 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:40.368+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:40.382 INFO:teuthology.orchestra.run.smithi102.stdout:3775 writesame 0xdebe42d thru 0xdec428c data_size 0x20(0x5e60 bytes) 2024-09-21T22:01:40.382 INFO:teuthology.orchestra.run.smithi102.stdout:3776 read 0xa2bad9c thru 0xa2c8c2c (0xde91 bytes) 2024-09-21T22:01:40.383 INFO:teuthology.orchestra.run.smithi102.stdout:3777 read 0x9d5de9a thru 0x9d60b34 (0x2c9b bytes) 2024-09-21T22:01:40.383 INFO:teuthology.orchestra.run.smithi102.stdout:3779 writesame 0x2017c8c thru 0x20220aa data_size 0x5(0xa41f bytes) 2024-09-21T22:01:40.387 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.387 INFO:teuthology.orchestra.run.smithi102.stdout:3781 read 0x8d5e3ae thru 0x8d6cdf3 (0xea46 bytes) 2024-09-21T22:01:40.387 INFO:teuthology.orchestra.run.smithi102.stdout:3785 trunc from 0xdec428d to 0xd85e2e4 2024-09-21T22:01:40.392 INFO:teuthology.orchestra.run.smithi102.stdout:3787 read 0x92c6e54 thru 0x92d6187 (0xf334 bytes) 2024-09-21T22:01:40.397 INFO:teuthology.orchestra.run.smithi102.stdout:3789 trunc from 0xd85e2e4 to 0x989e73c 2024-09-21T22:01:40.402 INFO:teuthology.orchestra.run.smithi102.stdout:3791 read 0x7f206a thru 0x801412 (0xf3a9 bytes) 2024-09-21T22:01:40.403 INFO:teuthology.orchestra.run.smithi102.stdout:3792 read 0x915dd02 thru 0x916442f (0x672e bytes) 2024-09-21T22:01:40.403 INFO:teuthology.orchestra.run.smithi102.stdout:3793 read 0x35f0c0 thru 0x3616e5 (0x2626 bytes) 2024-09-21T22:01:40.403 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.403 INFO:teuthology.orchestra.run.smithi102.stdout:3798 read 0x44ed002 thru 0x44fc178 (0xf177 bytes) 2024-09-21T22:01:40.403 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.403 INFO:teuthology.orchestra.run.smithi102.stdout:3800 punch from 0x345549a to 0x3459ffc, (0x4b62 bytes) 2024-09-21T22:01:40.409 INFO:teuthology.orchestra.run.smithi102.stdout:3802 trunc from 0x989e73c to 0x42d55e0 2024-09-21T22:01:40.421 INFO:teuthology.orchestra.run.smithi102.stdout:3803 write 0x53e5b91 thru 0x53efa63 (0x9ed3 bytes) 2024-09-21T22:01:40.423 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:40.423 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:40.424 INFO:teuthology.orchestra.run.smithi102.stdout:3805 read 0x511e69e thru 0x512a3b5 (0xbd18 bytes) 2024-09-21T22:01:40.424 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.426 INFO:teuthology.orchestra.run.smithi102.stdout:3807 trunc from 0x53efa64 to 0x3e5e3b5 2024-09-21T22:01:40.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:40.436 INFO:teuthology.orchestra.run.smithi102.stdout:3809 writesame 0x1414225 thru 0x1418f84 data_size 0x10(0x4d60 bytes) 2024-09-21T22:01:40.439 INFO:teuthology.orchestra.run.smithi102.stdout:3810 read 0x2f4c775 thru 0x2f58da1 (0xc62d bytes) 2024-09-21T22:01:40.439 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.451 INFO:teuthology.orchestra.run.smithi102.stdout:3813 write 0x98c994c thru 0x98d50ff (0xb7b4 bytes) 2024-09-21T22:01:40.463 INFO:teuthology.orchestra.run.smithi102.stdout:3814 write 0xcd67889 thru 0xcd72b36 (0xb2ae bytes) 2024-09-21T22:01:40.470 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:40.469+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:40.472 INFO:teuthology.orchestra.run.smithi102.stdout:3815 writesame 0xcfc0cf0 thru 0xcfc0f12 data_size 0x1(0x223 bytes) 2024-09-21T22:01:40.472 INFO:teuthology.orchestra.run.smithi102.stdout:3816 punch from 0x4a5d350 to 0x4a65ab0, (0x8760 bytes) 2024-09-21T22:01:40.473 INFO:teuthology.orchestra.run.smithi102.stdout:3817 punch from 0x5e4d9a6 to 0x5e531d9, (0x5833 bytes) 2024-09-21T22:01:40.473 INFO:teuthology.orchestra.run.smithi102.stdout:3818 write 0xafee5d9 thru 0xaff601b (0x7a43 bytes) 2024-09-21T22:01:40.483 INFO:teuthology.orchestra.run.smithi102.stdout:3819 write 0xe496238 thru 0xe49c75a (0x6523 bytes) 2024-09-21T22:01:40.486 INFO:teuthology.orchestra.run.smithi102.stdout:3821 read 0x7453a5a thru 0x745dc55 (0xa1fc bytes) 2024-09-21T22:01:40.486 INFO:teuthology.orchestra.run.smithi102.stdout:3823 read 0x6174d6d thru 0x617a04a (0x52de bytes) 2024-09-21T22:01:40.487 INFO:teuthology.orchestra.run.smithi102.stdout:3824 read 0x4144c5c thru 0x4150e74 (0xc219 bytes) 2024-09-21T22:01:40.494 INFO:teuthology.orchestra.run.smithi102.stdout:3825 trunc from 0xe49c75b to 0x77e806f 2024-09-21T22:01:40.498 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:40.498 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:40.514 INFO:teuthology.orchestra.run.smithi102.stdout:3826 write 0xb1e9a16 thru 0xb1f8c77 (0xf262 bytes) 2024-09-21T22:01:40.517 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:40.517 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:40.526 INFO:teuthology.orchestra.run.smithi102.stdout:3827 write 0xddf12f3 thru 0xddfa0dc (0x8dea bytes) 2024-09-21T22:01:40.528 INFO:teuthology.orchestra.run.smithi102.stdout:3828 read 0x33eb93f thru 0x33f5bca (0xa28c bytes) 2024-09-21T22:01:40.529 INFO:teuthology.orchestra.run.smithi102.stdout:3829 write 0x4b2524f thru 0x4b25b41 (0x8f3 bytes) 2024-09-21T22:01:40.532 INFO:teuthology.orchestra.run.smithi102.stdout:3830 read 0x7b62001 thru 0x7b6c6a1 (0xa6a1 bytes) 2024-09-21T22:01:40.532 INFO:teuthology.orchestra.run.smithi102.stdout:3831 writesame 0xb11fc42 thru 0xb127206 data_size 0x1(0x75c5 bytes) 2024-09-21T22:01:40.535 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:40.536 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:40.548 INFO:teuthology.orchestra.run.smithi102.stdout:3832 read 0x4c38633 thru 0x4c47db1 (0xf77f bytes) 2024-09-21T22:01:40.548 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.548 INFO:teuthology.orchestra.run.smithi102.stdout:3837 read 0x320b170 thru 0x320ed04 (0x3b95 bytes) 2024-09-21T22:01:40.548 INFO:teuthology.orchestra.run.smithi102.stdout:3838 writesame 0x430ecf4 thru 0x431c310 data_size 0x79(0xd61d bytes) 2024-09-21T22:01:40.550 INFO:teuthology.orchestra.run.smithi102.stdout:3840 punch from 0x498a8e1 to 0x498f12f, (0x484e bytes) 2024-09-21T22:01:40.554 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:40.554 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:40.555 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:40.555 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:40.555 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:40.555 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:40.555 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:40.563 INFO:teuthology.orchestra.run.smithi102.stdout:3842 trunc from 0xddfa0dd to 0x326a5e8 2024-09-21T22:01:40.569 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:40.572 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:40.570+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:40.573 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:40.573 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:40.591 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:40.591 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:40.592 INFO:teuthology.orchestra.run.smithi102.stdout:3844 writesame 0xc2ae572 thru 0xc2af1ee data_size 0x1(0xc7d bytes) 2024-09-21T22:01:40.592 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.592 INFO:teuthology.orchestra.run.smithi102.stdout:3846 write 0xabef9c7 thru 0xabf993c (0x9f76 bytes) 2024-09-21T22:01:40.596 INFO:teuthology.orchestra.run.smithi102.stdout:3848 trunc from 0xc2af1ef to 0xac21ba6 2024-09-21T22:01:40.603 INFO:teuthology.orchestra.run.smithi102.stdout:3849 write 0x81e5471 thru 0x81e840d (0x2f9d bytes) 2024-09-21T22:01:40.604 INFO:teuthology.orchestra.run.smithi102.stdout:3851 read 0xa10f0f0 thru 0xa11dc9f (0xebb0 bytes) 2024-09-21T22:01:40.605 INFO:teuthology.orchestra.run.smithi102.stdout:3852 read 0x4e4bab7 thru 0x4e56e5f (0xb3a9 bytes) 2024-09-21T22:01:40.609 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:40.614 INFO:teuthology.orchestra.run.smithi102.stdout:3853 write 0xdfb9992 thru 0xdfbb9a6 (0x2015 bytes) 2024-09-21T22:01:40.627 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:40.630 INFO:teuthology.orchestra.run.smithi102.stdout:3854 trunc from 0xdfbb9a7 to 0x20b12c6 2024-09-21T22:01:40.660 INFO:teuthology.orchestra.run.smithi102.stdout:3856 write 0xbff84c4 thru 0xbffc272 (0x3daf bytes) 2024-09-21T22:01:40.670 INFO:teuthology.orchestra.run.smithi102.stdout:3857 trunc from 0xbffc273 to 0x634ef3a 2024-09-21T22:01:40.673 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:40.671+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:40.679 INFO:teuthology.orchestra.run.smithi102.stdout:3858 write 0x1091867 thru 0x109ff60 (0xe6fa bytes) 2024-09-21T22:01:40.681 INFO:teuthology.orchestra.run.smithi102.stdout:3859 read 0x2688f00 thru 0x268aee3 (0x1fe4 bytes) 2024-09-21T22:01:40.684 INFO:teuthology.orchestra.run.smithi102.stdout:3860 trunc from 0x634ef3a to 0x8fc3a9b 2024-09-21T22:01:40.690 INFO:teuthology.orchestra.run.smithi102.stdout:3861 punch from 0x663c76d to 0x664ac80, (0xe513 bytes) 2024-09-21T22:01:40.690 INFO:teuthology.orchestra.run.smithi102.stdout:3863 punch from 0x89bfa6c to 0x89c84bc, (0x8a50 bytes) 2024-09-21T22:01:40.690 INFO:teuthology.orchestra.run.smithi102.stdout:3865 writesame 0x4edce5c thru 0x4ede2b4 data_size 0x1(0x1459 bytes) 2024-09-21T22:01:40.694 INFO:teuthology.orchestra.run.smithi102.stdout:3867 read 0x48bc9c1 thru 0x48bfc7d (0x32bd bytes) 2024-09-21T22:01:40.698 INFO:teuthology.orchestra.run.smithi102.stdout:3868 read 0x85cf9d0 thru 0x85d5dd9 (0x640a bytes) 2024-09-21T22:01:40.698 INFO:teuthology.orchestra.run.smithi102.stdout:3870 writesame 0xa6d8db thru 0xa79c11 data_size 0x5(0xc337 bytes) 2024-09-21T22:01:40.699 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:40.699 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:40.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:40.699 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31366 3.8 3:12d1962e:::rbd_header.1124528f4459:head [watch reconnect cookie 140678969648192 gen 7] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.728841338999999, 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030645964000000001, 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31366 2024-09-21T22:01:40.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966205+0000", 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966206+0000", 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4499999999999997e-07 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966208+0000", 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966214+0000", 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.966219+0000", 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6929999999999998e-06 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.990079+0000", 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023859706000000001 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.990148+0000", 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9617999999999997e-05 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.996851+0000", 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067029969999999996 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31674 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3407872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715988281000001, 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028037220000000002, 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31674 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979058+0000", 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979059+0000", 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2300000000000002e-07 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979061+0000", 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.95e-06 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979066+0000", 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.711e-06 2024-09-21T22:01:40.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979071+0000", 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7269999999999998e-06 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.006972+0000", 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027900748 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007034+0000", 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2069999999999994e-05 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007096+0000", 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1691000000000003e-05 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31675 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3248128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715969902000001, 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028176435999999999, 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.708 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31675 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979077+0000", 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5299999999999999e-07 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979080+0000", 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.898e-06 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979086+0000", 2024-09-21T22:01:40.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979091+0000", 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6720000000000003e-06 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007123+0000", 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028032267 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007183+0000", 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9979999999999998e-05 2024-09-21T22:01:40.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007253+0000", 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0184000000000004e-05 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31676 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3448832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715950062000001, 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028418516000000001, 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.712 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31676 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979097+0000", 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979106+0000", 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.969e-06 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979112+0000", 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2210000000000002e-06 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979117+0000", 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6290000000000001e-06 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007349+0000", 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028232548 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007430+0000", 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0894000000000002e-05 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007515+0000", 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4875000000000003e-05 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31677 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3289088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715923474, 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028585294000000001, 2024-09-21T22:01:40.716 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31677 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979123+0000", 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979124+0000", 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979125+0000", 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.756e-06 2024-09-21T22:01:40.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979131+0000", 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9839999999999998e-06 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979136+0000", 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5020000000000003e-06 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007548+0000", 2024-09-21T22:01:40.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0284119 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007628+0000", 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9921999999999998e-05 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007709+0000", 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0840000000000005e-05 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31678 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3489792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715905031999998, 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028748336999999999, 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31678 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979142+0000", 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979144+0000", 2024-09-21T22:01:40.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.849e-06 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979150+0000", 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6710000000000004e-06 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979154+0000", 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5009999999999998e-06 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007740+0000", 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028585880000000001 2024-09-21T22:01:40.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007810+0000", 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9883999999999997e-05 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007890+0000", 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0203000000000004e-05 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31679 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3330048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715886751999999, 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028877613999999999, 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31679 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979160+0000", 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2300000000000002e-07 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979162+0000", 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9190000000000002e-06 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979168+0000", 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979173+0000", 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5600000000000004e-06 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007934+0000", 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028761627000000001 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.007996+0000", 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1571999999999999e-05 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008038+0000", 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1718000000000003e-05 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.728 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31680 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3530752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715868249, 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029001378000000001, 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31680 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979178+0000", 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979179+0000", 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000002e-07 2024-09-21T22:01:40.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979181+0000", 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.787e-06 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979188+0000", 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1199999999999996e-06 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979193+0000", 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8919999999999999e-06 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008069+0000", 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028875872 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008115+0000", 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6069999999999998e-05 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008180+0000", 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5290000000000007e-05 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31681 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3371008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715848269999999, 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029168017000000001, 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.733 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31681 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979198+0000", 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979199+0000", 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979205+0000", 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9970000000000004e-06 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979211+0000", 2024-09-21T22:01:40.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4919999999999998e-06 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979216+0000", 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8749999999999999e-06 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008223+0000", 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029006451999999999 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008295+0000", 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2248000000000004e-05 2024-09-21T22:01:40.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008366+0000", 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1581999999999993e-05 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31682 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715824312999999, 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029288165000000001, 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.737 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31682 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979222+0000", 2024-09-21T22:01:40.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979223+0000", 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979225+0000", 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8980000000000001e-06 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979231+0000", 2024-09-21T22:01:40.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.981e-06 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979236+0000", 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008404+0000", 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029168296 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008453+0000", 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8729000000000001e-05 2024-09-21T22:01:40.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008511+0000", 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8048999999999999e-05 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31683 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3411968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715805463999999, 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029408805, 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31683 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979241+0000", 2024-09-21T22:01:40.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979242+0000", 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979243+0000", 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.838e-06 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979249+0000", 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9259999999999997e-06 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979254+0000", 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7899999999999999e-06 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008535+0000", 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029281042 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008592+0000", 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6369000000000002e-05 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008650+0000", 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8457e-05 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31684 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3612672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:40.745 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715768074, 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029486117999999999, 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31684 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979279+0000", 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3200000000000005e-07 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979281+0000", 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0679999999999999e-06 2024-09-21T22:01:40.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979288+0000", 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7510000000000002e-06 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979293+0000", 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008667+0000", 2024-09-21T22:01:40.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029373574 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008702+0000", 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5827000000000001e-05 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008765+0000", 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2378999999999993e-05 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31685 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3452928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715747514, 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029661091000000001, 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31685 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.750 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979299+0000", 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979300+0000", 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979301+0000", 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7910000000000001e-06 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979307+0000", 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9440000000000002e-06 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979312+0000", 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:01:40.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008813+0000", 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029500623 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008889+0000", 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6219999999999999e-05 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.008960+0000", 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1378999999999995e-05 2024-09-21T22:01:40.753 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31686 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3653632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715728922, 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029843732000000001, 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.754 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31686 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979318+0000", 2024-09-21T22:01:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979326+0000", 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3889999999999999e-06 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979332+0000", 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4339999999999997e-06 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979337+0000", 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:01:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009017+0000", 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029680213 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009093+0000", 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6039999999999997e-05 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009162+0000", 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8554999999999997e-05 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.757 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31687 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3493888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715703452, 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030002866, 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31687 2024-09-21T22:01:40.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979343+0000", 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979344+0000", 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979346+0000", 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8670000000000001e-06 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979352+0000", 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0090000000000004e-06 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979356+0000", 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5719999999999996e-06 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009203+0000", 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029847041000000001 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009274+0000", 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0722000000000005e-05 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009346+0000", 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2266000000000002e-05 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31689 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3534848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715684997, 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030169466999999998, 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.762 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31689 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979362+0000", 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979364+0000", 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7799999999999999e-06 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979370+0000", 2024-09-21T22:01:40.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6999999999999996e-06 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979374+0000", 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7199999999999997e-06 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009378+0000", 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030003795999999999 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009453+0000", 2024-09-21T22:01:40.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4801000000000004e-05 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009531+0000", 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8342000000000003e-05 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31690 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3575808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:40.766 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715666474999999, 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030330343999999999, 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31690 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979380+0000", 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979381+0000", 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.15e-07 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979382+0000", 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.821e-06 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979388+0000", 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0229999999999998e-06 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979393+0000", 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5480000000000003e-06 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009561+0000", 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030168107999999999 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009633+0000", 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2402000000000002e-05 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009711+0000", 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7126999999999995e-05 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31692 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3616768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715647873000002, 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030488531999999999, 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31692 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979399+0000", 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979401+0000", 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.767e-06 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979407+0000", 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9390000000000002e-06 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979412+0000", 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6920000000000001e-06 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009789+0000", 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030377662999999999 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009845+0000", 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5890000000000002e-05 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009887+0000", 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2231999999999998e-05 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31694 3.8 3:12bbcee3:::rbd_data.1124c77189a0.0000000000000002:10 [read 3657728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.774 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.715628524, 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030552935999999999, 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31694 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979418+0000", 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979419+0000", 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2799999999999996e-07 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979421+0000", 2024-09-21T22:01:40.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.832e-06 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979426+0000", 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8930000000000002e-06 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.979431+0000", 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7360000000000001e-06 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009906+0000", 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030474378 2024-09-21T22:01:40.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009940+0000", 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4183000000000001e-05 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.009971+0000", 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1386000000000001e-05 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.778 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:32214 3.8 3:1692a8f0:::rbd_data.1124528f4459.0000000000000017:head [stat,delete] snapc 11=[11] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.700908301999998, 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027931175999999999, 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 32214 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:40.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994138+0000", 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994139+0000", 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4300000000000001e-07 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994144+0000", 2024-09-21T22:01:40.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7319999999999998e-06 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994155+0000", 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1164e-05 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.994163+0000", 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6190000000000002e-06 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.016856+0000", 2024-09-21T22:01:40.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.022692985999999998 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.016924+0000", 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8299000000000005e-05 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.017307+0000", 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00038259200000000001 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.020069+0000", 2024-09-21T22:01:40.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027618180000000001 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.021976+0000", 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019070580000000001 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.022030+0000", 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4265000000000003e-05 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.022070+0000", 2024-09-21T22:01:40.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9700000000000003e-05 2024-09-21T22:01:40.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.784 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:40.784 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:40.784 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:40.785 INFO:teuthology.orchestra.run.smithi102.stdout:3871 read 0x73c3579 thru 0x73d3178 (0xfc00 bytes) 2024-09-21T22:01:40.785 INFO:teuthology.orchestra.run.smithi102.stdout:3872 punch from 0x26d63aa to 0x26d833c, (0x1f92 bytes) 2024-09-21T22:01:40.785 INFO:teuthology.orchestra.run.smithi102.stdout:3873 read 0x6378215 thru 0x6383f02 (0xbcee bytes) 2024-09-21T22:01:40.785 INFO:teuthology.orchestra.run.smithi102.stdout:3874 read 0x69e79e0 thru 0x69e9b28 (0x2149 bytes) 2024-09-21T22:01:40.785 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.785 INFO:teuthology.orchestra.run.smithi102.stdout:3876 read 0x3b92dd7 thru 0x3b9ddc9 (0xaff3 bytes) 2024-09-21T22:01:40.785 INFO:teuthology.orchestra.run.smithi102.stdout:3878 trunc from 0x8fc3a9b to 0x81888f9 2024-09-21T22:01:40.786 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3879 read 0x1904319 thru 0x190b871 (0x7559 bytes) 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3880 write 0xc6015df thru 0xc6070ff (0x5b21 bytes) 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3882 read 0x1327931 thru 0x1333bd8 (0xc2a8 bytes) 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3884 writesame 0x320e0a0 thru 0x321c4f5 data_size 0xb(0xe456 bytes) 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3886 write 0xa81940f thru 0xa823f48 (0xab3a bytes) 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3888 trunc from 0xc607100 to 0x2a33280 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3890 write 0xa741986 thru 0xa74c575 (0xabf0 bytes) 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3892 write 0x8134003 thru 0x813d8b9 (0x98b7 bytes) 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3893 trunc from 0xa74c576 to 0xb226b01 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3894 trunc from 0xb226b01 to 0xe79f566 2024-09-21T22:01:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:3895 write 0xbca9df3 thru 0xbcb3323 (0x9531 bytes) 2024-09-21T22:01:40.789 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:40.784+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:40.789 INFO:teuthology.orchestra.run.smithi102.stdout:3896 punch from 0x8e1a148 to 0x8e20c04, (0x6abc bytes) 2024-09-21T22:01:40.789 INFO:teuthology.orchestra.run.smithi102.stdout:3897 read 0x6976f83 thru 0x6980906 (0x9984 bytes) 2024-09-21T22:01:40.789 INFO:teuthology.orchestra.run.smithi102.stdout:3898 read 0x61c059c thru 0x61c6e2a (0x688f bytes) 2024-09-21T22:01:40.791 INFO:teuthology.orchestra.run.smithi102.stdout:3899 trunc from 0xe79f566 to 0xaa13b93 2024-09-21T22:01:40.799 INFO:teuthology.orchestra.run.smithi102.stdout:3901 punch from 0x604b43a to 0x604fa78, (0x463e bytes) 2024-09-21T22:01:40.799 INFO:teuthology.orchestra.run.smithi102.stdout:3902 writesame 0x4544cda thru 0x4552bb0 data_size 0x1(0xded7 bytes) 2024-09-21T22:01:40.826 INFO:teuthology.orchestra.run.smithi102.stdout:3903 read 0x11b111b thru 0x11ba128 (0x900e bytes) 2024-09-21T22:01:40.827 INFO:teuthology.orchestra.run.smithi102.stdout:3904 writesame 0x91a8bf0 thru 0x91b0271 data_size 0x4d(0x7682 bytes) 2024-09-21T22:01:40.833 INFO:teuthology.orchestra.run.smithi102.stdout:3907 trunc from 0xaa13b93 to 0xd1c0613 2024-09-21T22:01:40.843 INFO:teuthology.orchestra.run.smithi102.stdout:3908 trunc from 0xd1c0613 to 0x9e3b7a9 2024-09-21T22:01:40.851 INFO:teuthology.orchestra.run.smithi102.stdout:3911 write 0x836ef69 thru 0x8378897 (0x992f bytes) 2024-09-21T22:01:40.861 INFO:teuthology.orchestra.run.smithi102.stdout:3915 write 0xc0d3b79 thru 0xc0daa5e (0x6ee6 bytes) 2024-09-21T22:01:40.863 INFO:teuthology.orchestra.run.smithi102.stdout:3916 punch from 0xaf83d7f to 0xaf87a23, (0x3ca4 bytes) 2024-09-21T22:01:40.867 INFO:teuthology.orchestra.run.smithi102.stdout:3918 trunc from 0xc0daa5f to 0x94f8518 2024-09-21T22:01:40.877 INFO:teuthology.orchestra.run.smithi102.stdout:3919 read 0x6b8e028 thru 0x6b9b48a (0xd463 bytes) 2024-09-21T22:01:40.877 INFO:teuthology.orchestra.run.smithi102.stdout:3920 write 0x82ca5e4 thru 0x82d6c16 (0xc633 bytes) 2024-09-21T22:01:40.883 INFO:teuthology.orchestra.run.smithi102.stdout:3923 trunc from 0x94f8518 to 0xcccb8f4 2024-09-21T22:01:40.885 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:01:40.885 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:01:40.885 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-21T22:01:40.886 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T22:01:40.886 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T22:01:40.886 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-21T22:01:40.886 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:40.885+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:40.893 INFO:teuthology.orchestra.run.smithi102.stdout:3925 trunc from 0xcccb8f4 to 0x83d8311 2024-09-21T22:01:40.902 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:40.902 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:40.902 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:40.902 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:01:40.909 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:40.910 INFO:teuthology.orchestra.run.smithi102.stdout:3926 trunc from 0x83d8311 to 0x299e3f 2024-09-21T22:01:40.926 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.947 INFO:teuthology.orchestra.run.smithi102.stdout:3931 writesame 0xac2527e thru 0xac2d46e data_size 0x1(0x81f1 bytes) 2024-09-21T22:01:40.947 INFO:teuthology.orchestra.run.smithi102.stdout:3932 write 0x5c4e738 thru 0x5c5130c (0x2bd5 bytes) 2024-09-21T22:01:40.950 INFO:teuthology.orchestra.run.smithi102.stdout:3933 punch from 0x19bf90d to 0x19ccf87, (0xd67a bytes) 2024-09-21T22:01:40.957 INFO:teuthology.orchestra.run.smithi102.stdout:3936 trunc from 0xac2d46f to 0x529c7a5 2024-09-21T22:01:40.980 INFO:teuthology.orchestra.run.smithi102.stdout:3937 writesame 0xe209b78 thru 0xe20d633 data_size 0xe(0x3abc bytes) 2024-09-21T22:01:40.980 INFO:teuthology.orchestra.run.smithi102.stdout:3938 write 0xcdbe2ff thru 0xcdcb7ea (0xd4ec bytes) 2024-09-21T22:01:40.983 INFO:teuthology.orchestra.run.smithi102.stdout:3939 read 0x529b2bf thru 0x52a9d3b (0xea7d bytes) 2024-09-21T22:01:40.983 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:40.986 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:40.985+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:40.988 INFO:teuthology.orchestra.run.smithi102.stdout:3941 trunc from 0xe20d634 to 0x9fd8c21 2024-09-21T22:01:40.997 INFO:teuthology.orchestra.run.smithi102.stdout:3942 read 0x8103254 thru 0x8110aba (0xd867 bytes) 2024-09-21T22:01:40.998 INFO:teuthology.orchestra.run.smithi102.stdout:3943 read 0x9007a61 thru 0x900905d (0x15fd bytes) 2024-09-21T22:01:41.005 INFO:teuthology.orchestra.run.smithi102.stdout:3944 writesame 0xc0a9726 thru 0xc0ad1e1 data_size 0x2a(0x3abc bytes) 2024-09-21T22:01:41.007 INFO:teuthology.orchestra.run.smithi102.stdout:3945 trunc from 0xc0ad1e2 to 0xd684635 2024-09-21T22:01:41.013 INFO:teuthology.orchestra.run.smithi102.stdout:3947 read 0xaab9d3b thru 0xaac9b2a (0xfdf0 bytes) 2024-09-21T22:01:41.013 INFO:teuthology.orchestra.run.smithi102.stdout:3948 writesame 0x7ddd2a7 thru 0x7de45e3 data_size 0x1(0x733d bytes) 2024-09-21T22:01:41.019 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:41.019 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T22:01:41.019 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:41.021 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:41.021 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:41.033 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:41.041 INFO:teuthology.orchestra.run.smithi102.stdout:3950 trunc from 0xd684635 to 0x542827b 2024-09-21T22:01:41.052 INFO:teuthology.orchestra.run.smithi102.stdout:3951 trunc from 0x542827b to 0x2722a0c 2024-09-21T22:01:41.064 INFO:teuthology.orchestra.run.smithi102.stdout:3952 read 0x23587fb thru 0x2366f91 (0xe797 bytes) 2024-09-21T22:01:41.078 INFO:teuthology.orchestra.run.smithi102.stdout:3953 trunc from 0x2722a0c to 0xdf9d75c 2024-09-21T22:01:41.085 INFO:teuthology.orchestra.run.smithi102.stdout:3955 trunc from 0xdf9d75c to 0xc94c30e 2024-09-21T22:01:41.087 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:41.086+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:41.091 INFO:teuthology.orchestra.run.smithi102.stdout:3956 write 0xab7b5d2 thru 0xab8921d (0xdc4c bytes) 2024-09-21T22:01:41.098 INFO:teuthology.orchestra.run.smithi102.stdout:3957 read 0xa650825 thru 0xa65ee07 (0xe5e3 bytes) 2024-09-21T22:01:41.098 INFO:teuthology.orchestra.run.smithi102.stdout:3959 write 0x67da153 thru 0x67de277 (0x4125 bytes) 2024-09-21T22:01:41.103 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.103 INFO:teuthology.orchestra.run.smithi102.stdout:3961 read 0x8225737 thru 0x822ceb3 (0x777d bytes) 2024-09-21T22:01:41.103 INFO:teuthology.orchestra.run.smithi102.stdout:3962 punch from 0x9918745 to 0x99189f8, (0x2b3 bytes) 2024-09-21T22:01:41.103 INFO:teuthology.orchestra.run.smithi102.stdout:3964 punch from 0x8ce8247 to 0x8cf6f6d, (0xed26 bytes) 2024-09-21T22:01:41.103 INFO:teuthology.orchestra.run.smithi102.stdout:3967 trunc from 0xc94c30e to 0xcf0b5de 2024-09-21T22:01:41.117 INFO:teuthology.orchestra.run.smithi102.stdout:3968 trunc from 0xcf0b5de to 0x677edc7 2024-09-21T22:01:41.139 INFO:teuthology.orchestra.run.smithi102.stdout:3969 write 0xb4949ba thru 0xb49f0ff (0xa746 bytes) 2024-09-21T22:01:41.142 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.928737091000002, 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.143 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:01:41.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:01:41.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15469 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.907376196000001, 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015141767, 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.148 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15469 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:41.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233115+0000", 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233118+0000", 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233126+0000", 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8720000000000002e-06 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233139+0000", 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3059e-05 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248059+0000", 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.014920022999999999 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248146+0000", 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7787000000000005e-05 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248257+0000", 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011013799999999999 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15470 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5963776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.152 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.907345633999999, 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015332264, 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15470 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:41.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233145+0000", 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233146+0000", 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233148+0000", 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1409999999999999e-06 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233155+0000", 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5329999999999997e-06 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233160+0000", 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3560000000000003e-06 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248307+0000", 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015147396 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248400+0000", 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2592999999999999e-05 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248478+0000", 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7789999999999999e-05 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.156 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15471 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.907318059000001, 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015441796000000001, 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.157 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15471 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233173+0000", 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233175+0000", 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1459999999999999e-06 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233183+0000", 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4170000000000003e-06 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.233188+0000", 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8459999999999999e-06 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248509+0000", 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015321461 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248556+0000", 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6417e-05 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.248615+0000", 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9148999999999999e-05 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15737 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.902043770999999, 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015163012999999999, 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.161 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15737 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.162 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238447+0000", 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238448+0000", 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238449+0000", 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.922e-06 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238456+0000", 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6649999999999997e-06 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238460+0000", 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3100000000000002e-06 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253442+0000", 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.014981563 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253520+0000", 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8242000000000001e-05 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253610+0000", 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9936000000000001e-05 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15738 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.902024896, 2024-09-21T22:01:41.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015268319000000001, 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15738 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238466+0000", 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238467+0000", 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9599999999999999e-07 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238468+0000", 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.832e-06 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238474+0000", 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1880000000000001e-06 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238478+0000", 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2529999999999998e-06 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253637+0000", 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015159540000000001 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253680+0000", 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2904000000000001e-05 2024-09-21T22:01:41.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253734+0000", 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4106e-05 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15739 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.902008221999999, 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015455638000000001, 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.169 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15739 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:41.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238483+0000", 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1300000000000001e-07 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238485+0000", 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.773e-06 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238490+0000", 2024-09-21T22:01:41.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.558e-06 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238495+0000", 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3089999999999997e-06 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253769+0000", 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015274601 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253852+0000", 2024-09-21T22:01:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3022000000000006e-05 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253938+0000", 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6062000000000004e-05 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15740 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3080192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:41.173 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901990910999999, 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015561972, 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15740 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238500+0000", 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238501+0000", 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.89e-07 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238508+0000", 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3509999999999996e-06 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238514+0000", 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238519+0000", 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6890000000000003e-06 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.253965+0000", 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015445739999999999 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254008+0000", 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3096000000000002e-05 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254062+0000", 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4153999999999997e-05 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15741 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3538944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901965800999999, 2024-09-21T22:01:41.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015737879, 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15741 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238525+0000", 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238526+0000", 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238527+0000", 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.79e-06 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238533+0000", 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9510000000000003e-06 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238543+0000", 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8430000000000005e-06 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254096+0000", 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015553301 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254175+0000", 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8708999999999995e-05 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254263+0000", 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7886000000000005e-05 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15742 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:41.181 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901942141999999, 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015842728, 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15742 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238549+0000", 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238552+0000", 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3769999999999999e-06 2024-09-21T22:01:41.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238557+0000", 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7420000000000003e-06 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238562+0000", 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000003e-06 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254295+0000", 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015733080999999999 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254338+0000", 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2967999999999999e-05 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254392+0000", 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3956999999999999e-05 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15743 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:41.185 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901923579999998, 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016024549999999999, 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15743 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238567+0000", 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238568+0000", 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3200000000000001e-07 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238570+0000", 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238575+0000", 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6559999999999997e-06 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238580+0000", 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4309999999999996e-06 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254427+0000", 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015847070000000001 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254504+0000", 2024-09-21T22:01:41.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7230000000000004e-05 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254592+0000", 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7902e-05 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15744 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 4653056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901905574000001, 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016131405000000001, 2024-09-21T22:01:41.189 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15744 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238585+0000", 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238586+0000", 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1100000000000002e-07 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238587+0000", 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8059999999999999e-06 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238593+0000", 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9669999999999998e-06 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238603+0000", 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4020000000000008e-06 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254619+0000", 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01601619 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254663+0000", 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3532000000000003e-05 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254717+0000", 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4197000000000003e-05 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15745 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5111808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901882162, 2024-09-21T22:01:41.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016324899, 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15745 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238609+0000", 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238615+0000", 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0329999999999997e-06 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238621+0000", 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1680000000000001e-06 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238626+0000", 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7060000000000003e-06 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254751+0000", 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016125409 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254834+0000", 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2945e-05 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254934+0000", 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9259999999999995e-05 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15746 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901858702999998, 2024-09-21T22:01:41.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016492038000000001, 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15746 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238632+0000", 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238633+0000", 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.53e-07 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238635+0000", 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0449999999999999e-06 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238646+0000", 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1357e-05 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238651+0000", 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1370000000000001e-06 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.254971+0000", 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016319966000000002 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255050+0000", 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8827999999999998e-05 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255124+0000", 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4351999999999996e-05 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15747 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901831671, 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016613851999999998, 2024-09-21T22:01:41.201 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15747 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238659+0000", 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238660+0000", 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.82e-07 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238666+0000", 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5050000000000004e-06 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238673+0000", 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4060000000000002e-06 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238677+0000", 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5839999999999996e-06 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255157+0000", 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016480113000000001 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255213+0000", 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5251999999999999e-05 2024-09-21T22:01:41.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255273+0000", 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0409999999999999e-05 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15748 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901807163000001, 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016710974, 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.205 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15748 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238684+0000", 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7999999999999996e-07 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238686+0000", 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-06 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238692+0000", 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4330000000000003e-06 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238696+0000", 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2440000000000004e-06 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255306+0000", 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016609749 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255346+0000", 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0052000000000002e-05 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255395+0000", 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8976e-05 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15749 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 6684672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901789476000001, 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016816903000000001, 2024-09-21T22:01:41.209 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15749 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238701+0000", 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238702+0000", 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6399999999999998e-07 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238704+0000", 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.046e-06 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238709+0000", 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238714+0000", 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3209999999999998e-06 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255419+0000", 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016704734999999998 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255466+0000", 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7179999999999999e-05 2024-09-21T22:01:41.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255518+0000", 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2676999999999997e-05 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15750 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901771500999999, 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016896227999999999, 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.213 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15750 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238719+0000", 2024-09-21T22:01:41.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238720+0000", 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238722+0000", 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0059999999999999e-06 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238728+0000", 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8150000000000002e-06 2024-09-21T22:01:41.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238732+0000", 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4870000000000004e-06 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255531+0000", 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016798678000000001 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255568+0000", 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7316e-05 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255616+0000", 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7515000000000002e-05 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:15751 3.a 3:5742b743:::rbd_data.112457ad1d60.0000000000000006:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.901753145000001, 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.017028596, 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.217 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 15751 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238738+0000", 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3999999999999997e-07 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238740+0000", 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9240000000000001e-06 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238746+0000", 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.238750+0000", 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2440000000000004e-06 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255635+0000", 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.016884356999999999 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255679+0000", 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3974000000000003e-05 2024-09-21T22:01:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:15.255766+0000", 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:50014 3.3 3:c33db5d7:::rbd_data.1124298f9171.0000000000000007:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:41.014319+0000", 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.12617234699999999, 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.017297712999999999, 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 50014 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.014319+0000", 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.014319+0000", 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.014319+0000", 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.61e-07 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.014324+0000", 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.177e-06 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.014334+0000", 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0502e-05 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.014341+0000", 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1149999999999996e-06 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.014400+0000", 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8474000000000003e-05 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.014484+0000", 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4444000000000007e-05 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.018102+0000", 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0036180040000000002 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.031528+0000", 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.013425507 2024-09-21T22:01:41.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.031539+0000", 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1202e-05 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.031582+0000", 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3198000000000002e-05 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.031616+0000", 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4329000000000003e-05 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.226 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.227 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.227 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.227 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.227 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:41.229 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:41.229 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:41.226+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3971 trunc from 0xb49f100 to 0x9b2351e 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3972 write 0xe4d0f0b thru 0xe4da8a8 (0x999e bytes) 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3973 read 0xba248d0 thru 0xba2d99f (0x90d0 bytes) 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3974 trunc from 0xe4da8a9 to 0x9a74959 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3975 write 0x8ba2918 thru 0x8bac5a6 (0x9c8f bytes) 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3976 read 0x2543dbe thru 0x2545b6a (0x1dad bytes) 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3981 write 0xe4d3412 thru 0xe4d857d (0x516c bytes) 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3982 writesame 0x73b60f4 thru 0x73b6690 data_size 0x1(0x59d bytes) 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3983 write 0xc99954d thru 0xc9a0e18 (0x78cc bytes) 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3984 write 0x348c789 thru 0x348f3e7 (0x2c5f bytes) 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3985 trunc from 0xe4d857e to 0xc6586fa 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:3986 read 0x521d4f8 thru 0x521e950 (0x1459 bytes) 2024-09-21T22:01:41.231 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:3989 write 0x887e744 thru 0x8889d5c (0xb619 bytes) 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:3991 write 0xc8aa104 thru 0xc8ab6ef (0x15ec bytes) 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:3995 punch from 0x1b4a851 to 0x1b56f4f, (0xc6fe bytes) 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:3996 read 0x1cf05a1 thru 0x1cf88d9 (0x8339 bytes) 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:3999 read 0xc3beb90 thru 0xc3c1544 (0x29b5 bytes) 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:4003 read 0x66a759b thru 0x66ad33c (0x5da2 bytes) 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:4004 write 0x8a61df4 thru 0x8a6a8c4 (0x8ad1 bytes) 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:4005 write 0x4be0bb7 thru 0x4bf0385 (0xf7cf bytes) 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.232 INFO:teuthology.orchestra.run.smithi102.stdout:4007 read 0x478d85f thru 0x479ad0b (0xd4ad bytes) 2024-09-21T22:01:41.235 INFO:teuthology.orchestra.run.smithi102.stdout:4009 trunc from 0xc8ab6f0 to 0x890ae59 2024-09-21T22:01:41.247 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.257 INFO:teuthology.orchestra.run.smithi102.stdout:4011 write 0xb0d43ea thru 0xb0e3529 (0xf140 bytes) 2024-09-21T22:01:41.259 INFO:teuthology.orchestra.run.smithi102.stdout:4013 writesame 0x1a68ab4 thru 0x1a697a9 data_size 0xe(0xcf6 bytes) 2024-09-21T22:01:41.270 INFO:teuthology.orchestra.run.smithi102.stdout:4014 write 0xc6c125f thru 0xc6c9ad1 (0x8873 bytes) 2024-09-21T22:01:41.273 INFO:teuthology.orchestra.run.smithi102.stdout:4016 read 0x7e7fd10 thru 0x7e829ce (0x2cbf bytes) 2024-09-21T22:01:41.273 INFO:teuthology.orchestra.run.smithi102.stdout:4017 writesame 0x3b351ed thru 0x3b42d37 data_size 0x1(0xdb4b bytes) 2024-09-21T22:01:41.299 INFO:teuthology.orchestra.run.smithi102.stdout:4018 read 0xa03e274 thru 0xa04353c (0x52c9 bytes) 2024-09-21T22:01:41.306 INFO:teuthology.orchestra.run.smithi102.stdout:4019 trunc from 0xc6c9ad2 to 0x6f9989d 2024-09-21T22:01:41.317 INFO:teuthology.orchestra.run.smithi102.stdout:4021 read 0xa95d0d thru 0xa9af64 (0x5258 bytes) 2024-09-21T22:01:41.317 INFO:teuthology.orchestra.run.smithi102.stdout:4022 write 0x2ce7dda thru 0x2cf1992 (0x9bb9 bytes) 2024-09-21T22:01:41.326 INFO:teuthology.orchestra.run.smithi102.stdout:4023 write 0x7588cfe thru 0x758a198 (0x149b bytes) 2024-09-21T22:01:41.328 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.328 INFO:teuthology.orchestra.run.smithi102.stdout:4026 read 0x1d33b1f thru 0x1d3c0c7 (0x85a9 bytes) 2024-09-21T22:01:41.328 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:41.326+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:41.328 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.331 INFO:teuthology.orchestra.run.smithi102.stdout:4029 trunc from 0x758a199 to 0x4769ff7 2024-09-21T22:01:41.339 INFO:teuthology.orchestra.run.smithi102.stdout:4030 read 0x25a2adf thru 0x25aad4f (0x8271 bytes) 2024-09-21T22:01:41.339 INFO:teuthology.orchestra.run.smithi102.stdout:4031 read 0x3ff0e12 thru 0x3ffcf27 (0xc116 bytes) 2024-09-21T22:01:41.339 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.341 INFO:teuthology.orchestra.run.smithi102.stdout:4034 trunc from 0x4769ff7 to 0x5d4d593 2024-09-21T22:01:41.347 INFO:teuthology.orchestra.run.smithi102.stdout:4035 trunc from 0x5d4d593 to 0x5ed118c 2024-09-21T22:01:41.352 INFO:teuthology.orchestra.run.smithi102.stdout:4036 writesame 0x1929d58 thru 0x192f947 data_size 0x8(0x5bf0 bytes) 2024-09-21T22:01:41.364 INFO:teuthology.orchestra.run.smithi102.stdout:4038 write 0x912babe thru 0x913ae3c (0xf37f bytes) 2024-09-21T22:01:41.379 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:41.379 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:50303 3.1d 3.46e1e35d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:41.378756+0000", 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 3.748e-05, 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1953000000000002e-05, 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "queued for pg", 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 50303 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.378756+0000", 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.378756+0000", 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.378757+0000", 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7499999999999999e-07 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.378761+0000", 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5279999999999997e-06 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.378772+0000", 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0216e-05 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.378777+0000", 2024-09-21T22:01:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2440000000000001e-06 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:41.378812+0000", 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5209000000000001e-05 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: ], 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 1 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:41.383 INFO:teuthology.orchestra.run.smithi102.stdout:4040 write 0xebf71d8 thru 0xebfc765 (0x558e bytes) 2024-09-21T22:01:41.384 INFO:teuthology.orchestra.run.smithi102.stdout:4043 read 0x94c31e2 thru 0x94d1051 (0xde70 bytes) 2024-09-21T22:01:41.384 INFO:teuthology.orchestra.run.smithi102.stdout:4044 punch from 0x654dcc7 to 0x6556a07, (0x8d40 bytes) 2024-09-21T22:01:41.384 INFO:teuthology.orchestra.run.smithi102.stdout:4046 read 0xc3ba953 thru 0xc3ca8b1 (0xff5f bytes) 2024-09-21T22:01:41.384 INFO:teuthology.orchestra.run.smithi102.stdout:4047 read 0x121bf63 thru 0x121e010 (0x20ae bytes) 2024-09-21T22:01:41.384 INFO:teuthology.orchestra.run.smithi102.stdout:4048 read 0x3215c6a thru 0x321dca8 (0x803f bytes) 2024-09-21T22:01:41.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:41.398 INFO:teuthology.orchestra.run.smithi102.stdout:4049 trunc from 0xebfc766 to 0x2068012 2024-09-21T22:01:41.426 INFO:teuthology.orchestra.run.smithi102.stdout:4050 writesame 0xaf161a4 thru 0xaf19059 data_size 0x1(0x2eb6 bytes) 2024-09-21T22:01:41.426 INFO:teuthology.orchestra.run.smithi102.stdout:4051 punch from 0x93723c3 to 0x937fc0e, (0xd84b bytes) 2024-09-21T22:01:41.426 INFO:teuthology.orchestra.run.smithi102.stdout:4052 read 0x5a0dbb9 thru 0x5a11673 (0x3abb bytes) 2024-09-21T22:01:41.426 INFO:teuthology.orchestra.run.smithi102.stdout:4054 punch from 0x4f5e5ce to 0x4f65e7a, (0x78ac bytes) 2024-09-21T22:01:41.426 INFO:teuthology.orchestra.run.smithi102.stdout:4055 punch from 0x18e22a3 to 0x18eaa48, (0x87a5 bytes) 2024-09-21T22:01:41.426 INFO:teuthology.orchestra.run.smithi102.stdout:4056 read 0x6f6b902 thru 0x6f729cf (0x70ce bytes) 2024-09-21T22:01:41.426 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.427 INFO:teuthology.orchestra.run.smithi102.stdout:4060 trunc from 0xaf1905a to 0xcd65e01 2024-09-21T22:01:41.430 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:41.428+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:41.445 INFO:teuthology.orchestra.run.smithi102.stdout:4061 trunc from 0xcd65e01 to 0x2550a2b 2024-09-21T22:01:41.453 INFO:teuthology.orchestra.run.smithi102.stdout:4062 punch from 0xdf9aa2 to 0xe028bf, (0x8e1d bytes) 2024-09-21T22:01:41.462 INFO:teuthology.orchestra.run.smithi102.stdout:4063 write 0x553e2ea thru 0x554dd83 (0xfa9a bytes) 2024-09-21T22:01:41.471 INFO:teuthology.orchestra.run.smithi102.stdout:4065 writesame 0x56bb296 thru 0x56c8d86 data_size 0x77(0xdaf1 bytes) 2024-09-21T22:01:41.471 INFO:teuthology.orchestra.run.smithi102.stdout:4066 read 0x4bdfda4 thru 0x4bedfc8 (0xe225 bytes) 2024-09-21T22:01:41.477 INFO:teuthology.orchestra.run.smithi102.stdout:4067 trunc from 0x56c8d87 to 0xb2ee75e 2024-09-21T22:01:41.484 INFO:teuthology.orchestra.run.smithi102.stdout:4068 read 0x1d6ab1d thru 0x1d79ee8 (0xf3cc bytes) 2024-09-21T22:01:41.494 INFO:teuthology.orchestra.run.smithi102.stdout:4069 write 0xe405e5d thru 0xe414fe4 (0xf188 bytes) 2024-09-21T22:01:41.496 INFO:teuthology.orchestra.run.smithi102.stdout:4070 read 0x14d1181 thru 0x14e0a55 (0xf8d5 bytes) 2024-09-21T22:01:41.513 INFO:teuthology.orchestra.run.smithi102.stdout:4071 trunc from 0xe414fe5 to 0x141995f 2024-09-21T22:01:41.523 INFO:teuthology.orchestra.run.smithi102.stdout:4072 read 0x122b37a thru 0x122db2f (0x27b6 bytes) 2024-09-21T22:01:41.524 INFO:teuthology.orchestra.run.smithi102.stdout:4073 punch from 0xe05c8e to 0xe0f349, (0x96bb bytes) 2024-09-21T22:01:41.529 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:41.527+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:41.532 INFO:teuthology.orchestra.run.smithi102.stdout:4074 write 0x3ffac8a thru 0x3ffc048 (0x13bf bytes) 2024-09-21T22:01:41.533 INFO:teuthology.orchestra.run.smithi102.stdout:4075 read 0x37ec891 thru 0x37eff37 (0x36a7 bytes) 2024-09-21T22:01:41.534 INFO:teuthology.orchestra.run.smithi102.stdout:4076 read 0x5ca9b9 thru 0x5d811f (0xd767 bytes) 2024-09-21T22:01:41.534 INFO:teuthology.orchestra.run.smithi102.stdout:4078 punch from 0x2308964 to 0x2317bdf, (0xf27b bytes) 2024-09-21T22:01:41.534 INFO:teuthology.orchestra.run.smithi102.stdout:4079 read 0x24eaac9 thru 0x24f0b26 (0x605e bytes) 2024-09-21T22:01:41.537 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:41.537 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:41.537 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:41.537 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:41.537 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:41.539 INFO:teuthology.orchestra.run.smithi102.stdout:4082 trunc from 0x3ffc049 to 0x82e417b 2024-09-21T22:01:41.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:41.556 INFO:teuthology.orchestra.run.smithi102.stdout:4083 write 0xd92f158 thru 0xd93655f (0x7408 bytes) 2024-09-21T22:01:41.560 INFO:teuthology.orchestra.run.smithi102.stdout:4084 write 0xd1c66b7 thru 0xd1c8ede (0x2828 bytes) 2024-09-21T22:01:41.564 INFO:teuthology.orchestra.run.smithi102.stdout:4085 write 0x1da2222 thru 0x1dac754 (0xa533 bytes) 2024-09-21T22:01:41.566 INFO:teuthology.orchestra.run.smithi102.stdout:4086 punch from 0xacc17c8 to 0xacc5560, (0x3d98 bytes) 2024-09-21T22:01:41.566 INFO:teuthology.orchestra.run.smithi102.stdout:4087 writesame 0x43a0878 thru 0x43afc5e data_size 0xd(0xf3e7 bytes) 2024-09-21T22:01:41.570 INFO:teuthology.orchestra.run.smithi102.stdout:4088 read 0x9823cdf thru 0x9833acf (0xfdf1 bytes) 2024-09-21T22:01:41.570 INFO:teuthology.orchestra.run.smithi102.stdout:4089 read 0x1321224 thru 0x132fbb4 (0xe991 bytes) 2024-09-21T22:01:41.570 INFO:teuthology.orchestra.run.smithi102.stdout:4090 write 0x5d9f7b0 thru 0x5da045b (0xcac bytes) 2024-09-21T22:01:41.572 INFO:teuthology.orchestra.run.smithi102.stdout:4091 read 0x837a565 thru 0x8389704 (0xf1a0 bytes) 2024-09-21T22:01:41.572 INFO:teuthology.orchestra.run.smithi102.stdout:4093 writesame 0x88b2a1c thru 0x88ba478 data_size 0x23(0x7a5d bytes) 2024-09-21T22:01:41.575 INFO:teuthology.orchestra.run.smithi102.stdout:4094 read 0x26f8def thru 0x26ffec6 (0x70d8 bytes) 2024-09-21T22:01:41.575 INFO:teuthology.orchestra.run.smithi102.stdout:4095 punch from 0xc4c9f33 to 0xc4d6c14, (0xcce1 bytes) 2024-09-21T22:01:41.575 INFO:teuthology.orchestra.run.smithi102.stdout:4096 write 0x73c5219 thru 0x73cd0e8 (0x7ed0 bytes) 2024-09-21T22:01:41.577 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.577 INFO:teuthology.orchestra.run.smithi102.stdout:4098 writesame 0x35ac5fc thru 0x35b74f8 data_size 0x1(0xaefd bytes) 2024-09-21T22:01:41.597 INFO:teuthology.orchestra.run.smithi102.stdout:4099 read 0x2cfea8a thru 0x2d09ce9 (0xb260 bytes) 2024-09-21T22:01:41.598 INFO:teuthology.orchestra.run.smithi102.stdout:4100 read 0x7e7cb4d thru 0x7e7ebdb (0x208f bytes) 2024-09-21T22:01:41.598 INFO:teuthology.orchestra.run.smithi102.stdout:4101 punch from 0xa9c406f to 0xa9ca592, (0x6523 bytes) 2024-09-21T22:01:41.604 INFO:teuthology.orchestra.run.smithi102.stdout:4104 write 0xda870a2 thru 0xda8fcab (0x8c0a bytes) 2024-09-21T22:01:41.607 INFO:teuthology.orchestra.run.smithi102.stdout:4105 writesame 0xc918b5c thru 0xc91b26c data_size 0x1(0x2711 bytes) 2024-09-21T22:01:41.613 INFO:teuthology.orchestra.run.smithi102.stdout:4106 trunc from 0xda8fcac to 0xd3f4c5f 2024-09-21T22:01:41.620 INFO:teuthology.orchestra.run.smithi102.stdout:4107 read 0x97b6a0 thru 0x97eeb9 (0x381a bytes) 2024-09-21T22:01:41.620 INFO:teuthology.orchestra.run.smithi102.stdout:4113 punch from 0x2d75ce3 to 0x2d7af5f, (0x527c bytes) 2024-09-21T22:01:41.621 INFO:teuthology.orchestra.run.smithi102.stdout:4114 write 0x3aead0a thru 0x3af3672 (0x8969 bytes) 2024-09-21T22:01:41.622 INFO:teuthology.orchestra.run.smithi102.stdout:4117 write 0x8a6cc28 thru 0x8a76727 (0x9b00 bytes) 2024-09-21T22:01:41.627 INFO:teuthology.orchestra.run.smithi102.stdout:4118 punch from 0x164c101 to 0x1659f59, (0xde58 bytes) 2024-09-21T22:01:41.627 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.627 INFO:teuthology.orchestra.run.smithi102.stdout:4123 read 0xc66a2ae thru 0xc67a127 (0xfe7a bytes) 2024-09-21T22:01:41.627 INFO:teuthology.orchestra.run.smithi102.stdout:4124 read 0x69dadaa thru 0x69dd4c6 (0x271d bytes) 2024-09-21T22:01:41.627 INFO:teuthology.orchestra.run.smithi102.stdout:4126 read 0x5086b77 thru 0x5096950 (0xfdda bytes) 2024-09-21T22:01:41.628 INFO:teuthology.orchestra.run.smithi102.stdout:4127 write 0x89cadac thru 0x89cc349 (0x159e bytes) 2024-09-21T22:01:41.630 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:41.629+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:41.639 INFO:teuthology.orchestra.run.smithi102.stdout:4128 trunc from 0xd3f4c5f to 0x5d7495c 2024-09-21T22:01:41.656 INFO:teuthology.orchestra.run.smithi102.stdout:4129 trunc from 0x5d7495c to 0x10d700a 2024-09-21T22:01:41.668 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.669 INFO:teuthology.orchestra.run.smithi102.stdout:4131 punch from 0xf1bcab to 0xf1c73b, (0xa90 bytes) 2024-09-21T22:01:41.676 INFO:teuthology.orchestra.run.smithi102.stdout:4132 writesame 0x2313211 thru 0x2319196 data_size 0x1(0x5f86 bytes) 2024-09-21T22:01:41.691 INFO:teuthology.orchestra.run.smithi102.stdout:4133 writesame 0x8a0baa3 thru 0x8a1b154 data_size 0x5b(0xf6b2 bytes) 2024-09-21T22:01:41.691 INFO:teuthology.orchestra.run.smithi102.stdout:4134 punch from 0x557e98a to 0x55822c9, (0x393f bytes) 2024-09-21T22:01:41.692 INFO:teuthology.orchestra.run.smithi102.stdout:4135 trunc from 0x8a1b155 to 0x84b117f 2024-09-21T22:01:41.698 INFO:teuthology.orchestra.run.smithi102.stdout:4136 read 0x2d8d0fa thru 0x2d96423 (0x932a bytes) 2024-09-21T22:01:41.698 INFO:teuthology.orchestra.run.smithi102.stdout:4137 read 0x2c3a87a thru 0x2c3f834 (0x4fbb bytes) 2024-09-21T22:01:41.699 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:41.699 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:41.699 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:41.699 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:41.699 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 37.645076906, 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.701 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.702 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.704 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29926 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3567616~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.768415645000001, 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028146526000000002, 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.705 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29926 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.706 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928550+0000", 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928552+0000", 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928558+0000", 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6690000000000003e-06 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928562+0000", 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2910000000000001e-06 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956591+0000", 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028029011999999999 2024-09-21T22:01:41.708 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956646+0000", 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5016999999999999e-05 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956696+0000", 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9920999999999999e-05 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29927 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3002368~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.768397415999999, 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028301160999999998, 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29927 2024-09-21T22:01:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928569+0000", 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.395e-06 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928573+0000", 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.225e-06 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928575+0000", 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:01:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956723+0000", 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028148237 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956768+0000", 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4749999999999997e-05 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956869+0000", 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010078599999999999 2024-09-21T22:01:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29928 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3043328~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.768378716000001, 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028496923, 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29928 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928587+0000", 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4699999999999998e-07 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928588+0000", 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.313e-06 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928591+0000", 2024-09-21T22:01:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1999999999999999e-06 2024-09-21T22:01:41.717 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.717 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.717 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.717 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928598+0000", 2024-09-21T22:01:41.717 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0890000000000002e-06 2024-09-21T22:01:41.717 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.717 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.717 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956939+0000", 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028341261 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957006+0000", 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6704000000000004e-05 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957083+0000", 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7108999999999996e-05 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.718 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.768362411999998, 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:01:41.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:01:41.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.722 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.768352461999999, 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.723 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.724 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.725 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.726 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.768339058999999, 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.727 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.728 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.729 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:01:41.730 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.768329388000002, 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:01:41.731 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.732 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.733 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:01:41.734 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.735 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29937 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3248128~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.766551746000001, 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028121855000000001, 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29937 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.736 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930414+0000", 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:41.737 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930416+0000", 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-06 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930422+0000", 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930435+0000", 2024-09-21T22:01:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2404e-05 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958382+0000", 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027947339000000002 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958450+0000", 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7611e-05 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.739 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958535+0000", 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5680999999999995e-05 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29939 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3289088~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.766497016999999, 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028207189000000001, 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.740 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29939 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.741 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930471+0000", 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930476+0000", 2024-09-21T22:01:41.742 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4410000000000001e-06 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930480+0000", 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.391e-06 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958565+0000", 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028084392999999999 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958617+0000", 2024-09-21T22:01:41.743 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1706999999999998e-05 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958675+0000", 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8715999999999998e-05 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29941 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3330048~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.766459715, 2024-09-21T22:01:41.744 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028386958, 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29941 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.745 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930506+0000", 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930508+0000", 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.782e-06 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.746 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930514+0000", 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930518+0000", 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0949999999999998e-06 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958712+0000", 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028194745 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.747 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958788+0000", 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5556000000000006e-05 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958892+0000", 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000104304 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29943 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.748 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.766416378999999, 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028512368999999999, 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29943 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:41.749 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-07 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930551+0000", 2024-09-21T22:01:41.750 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930557+0000", 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6799999999999998e-06 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930561+0000", 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5399999999999997e-06 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958929+0000", 2024-09-21T22:01:41.751 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028367277999999999 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958988+0000", 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8928000000000002e-05 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959061+0000", 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3460000000000005e-05 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.752 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29945 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3411968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.766377980000001, 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028678985000000001, 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29945 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.753 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930588+0000", 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930589+0000", 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.939e-06 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930595+0000", 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8810000000000001e-06 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930600+0000", 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5539999999999999e-06 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959097+0000", 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028497248999999999 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959184+0000", 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7170999999999996e-05 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959266+0000", 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1769999999999998e-05 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.766333550999999, 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:01:41.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:01:41.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.766287295000001, 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:01:41.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.764 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.76624996, 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:41.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:01:41.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.767 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.766215778999999, 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:01:41.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.772 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.766175907000001, 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.776 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.766130621999999, 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.780 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:40935 3.5 3:a2bf362e:::rbd_data.112498fbc780.0000000000000004:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.700615247, 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028536945000000001, 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 40935 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.781 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996352+0000", 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.041e-06 2024-09-21T22:01:41.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996362+0000", 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0447e-05 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996382+0000", 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9639e-05 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996393+0000", 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1358e-05 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996458+0000", 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4649999999999999e-05 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996523+0000", 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4775000000000002e-05 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.001040+0000", 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045170920000000003 2024-09-21T22:01:41.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024702+0000", 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023662336999999999 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024758+0000", 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6138999999999999e-05 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024825+0000", 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6834000000000004e-05 2024-09-21T22:01:41.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024887+0000", 2024-09-21T22:01:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1632999999999998e-05 2024-09-21T22:01:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:41.786 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:41.786 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:41.788 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:41.788 INFO:teuthology.orchestra.run.smithi102.stdout:4138 writesame 0xc528dd6 thru 0xc535eda data_size 0x1(0xd105 bytes) 2024-09-21T22:01:41.788 INFO:teuthology.orchestra.run.smithi102.stdout:4139 write 0x81b7fd0 thru 0x81c33a9 (0xb3da bytes) 2024-09-21T22:01:41.788 INFO:teuthology.orchestra.run.smithi102.stdout:4140 write 0xd434955 thru 0xd440527 (0xbbd3 bytes) 2024-09-21T22:01:41.788 INFO:teuthology.orchestra.run.smithi102.stdout:4141 write 0x581939b thru 0x581c73b (0x33a1 bytes) 2024-09-21T22:01:41.789 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.789 INFO:teuthology.orchestra.run.smithi102.stdout:4144 punch from 0x990ae54 to 0x9917203, (0xc3af bytes) 2024-09-21T22:01:41.789 INFO:teuthology.orchestra.run.smithi102.stdout:4146 trunc from 0xd440528 to 0x20f216b 2024-09-21T22:01:41.789 INFO:teuthology.orchestra.run.smithi102.stdout:4148 write 0x4016ff3 thru 0x402523b (0xe249 bytes) 2024-09-21T22:01:41.789 INFO:teuthology.orchestra.run.smithi102.stdout:4151 writesame 0x20dc016 thru 0x20e6e8e data_size 0x1(0xae79 bytes) 2024-09-21T22:01:41.789 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:41.786+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:41.801 INFO:teuthology.orchestra.run.smithi102.stdout:4152 write 0xcd9df42 thru 0xcda5902 (0x79c1 bytes) 2024-09-21T22:01:41.804 INFO:teuthology.orchestra.run.smithi102.stdout:4153 write 0x237c543 thru 0x2386163 (0x9c21 bytes) 2024-09-21T22:01:41.805 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.808 INFO:teuthology.orchestra.run.smithi102.stdout:4156 trunc from 0xcda5903 to 0x9f313df 2024-09-21T22:01:41.819 INFO:teuthology.orchestra.run.smithi102.stdout:4157 read 0x2f1426 thru 0x2fb17c (0x9d57 bytes) 2024-09-21T22:01:41.823 INFO:teuthology.orchestra.run.smithi102.stdout:4158 trunc from 0x9f313df to 0x6e7432c 2024-09-21T22:01:41.831 INFO:teuthology.orchestra.run.smithi102.stdout:4159 read 0x39186ae thru 0x391cc0c (0x455f bytes) 2024-09-21T22:01:41.839 INFO:teuthology.orchestra.run.smithi102.stdout:4163 writesame 0x8fe2716 thru 0x8fefa68 data_size 0x3(0xd353 bytes) 2024-09-21T22:01:41.839 INFO:teuthology.orchestra.run.smithi102.stdout:4165 writesame 0x247ae4f thru 0x247ed6c data_size 0x3(0x3f1e bytes) 2024-09-21T22:01:41.852 INFO:teuthology.orchestra.run.smithi102.stdout:4166 write 0xc290b44 thru 0xc29fd2f (0xf1ec bytes) 2024-09-21T22:01:41.855 INFO:teuthology.orchestra.run.smithi102.stdout:4168 write 0xbce4794 thru 0xbcea51f (0x5d8c bytes) 2024-09-21T22:01:41.858 INFO:teuthology.orchestra.run.smithi102.stdout:4171 trunc from 0xc29fd30 to 0xc2bfa28 2024-09-21T22:01:41.863 INFO:teuthology.orchestra.run.smithi102.stdout:4174 read 0x3c87eeb thru 0x3c8e141 (0x6257 bytes) 2024-09-21T22:01:41.863 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.864 INFO:teuthology.orchestra.run.smithi102.stdout:4176 read 0xbe581c9 thru 0xbe64f20 (0xcd58 bytes) 2024-09-21T22:01:41.864 INFO:teuthology.orchestra.run.smithi102.stdout:4177 read 0x27b02de thru 0x27bec22 (0xe945 bytes) 2024-09-21T22:01:41.864 INFO:teuthology.orchestra.run.smithi102.stdout:4178 write 0x8253e53 thru 0x825a922 (0x6ad0 bytes) 2024-09-21T22:01:41.867 INFO:teuthology.orchestra.run.smithi102.stdout:4179 read 0x8aabbd thru 0x8b1234 (0x6678 bytes) 2024-09-21T22:01:41.867 INFO:teuthology.orchestra.run.smithi102.stdout:4180 read 0xbe91c2e thru 0xbe92cf8 (0x10cb bytes) 2024-09-21T22:01:41.867 INFO:teuthology.orchestra.run.smithi102.stdout:4182 read 0x9ba39ab thru 0x9baffeb (0xc641 bytes) 2024-09-21T22:01:41.867 INFO:teuthology.orchestra.run.smithi102.stdout:4184 write 0x67c68ac thru 0x67ce0e4 (0x7839 bytes) 2024-09-21T22:01:41.870 INFO:teuthology.orchestra.run.smithi102.stdout:4185 punch from 0x8bde4a6 to 0x8be566d, (0x71c7 bytes) 2024-09-21T22:01:41.879 INFO:teuthology.orchestra.run.smithi102.stdout:4186 write 0xeb4d1c2 thru 0xeb4d52c (0x36b bytes) 2024-09-21T22:01:41.882 INFO:teuthology.orchestra.run.smithi102.stdout:4187 read 0xd67b404 thru 0xd689b89 (0xe786 bytes) 2024-09-21T22:01:41.883 INFO:teuthology.orchestra.run.smithi102.stdout:4188 write 0x3624285 thru 0x3624530 (0x2ac bytes) 2024-09-21T22:01:41.886 INFO:teuthology.orchestra.run.smithi102.stdout:4190 trunc from 0xeb4d52d to 0xcd26fd1 2024-09-21T22:01:41.888 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:41.886+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:41.893 INFO:teuthology.orchestra.run.smithi102.stdout:4192 read 0xae7f3b5 thru 0xae8987c (0xa4c8 bytes) 2024-09-21T22:01:41.894 INFO:teuthology.orchestra.run.smithi102.stdout:4193 trunc from 0xcd26fd1 to 0xbeaacd1 2024-09-21T22:01:41.899 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:41.899 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:41.899 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:41.899 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:41.910 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:41.913 INFO:teuthology.orchestra.run.smithi102.stdout:4194 write 0xd912e21 thru 0xd91fafa (0xccda bytes) 2024-09-21T22:01:41.916 INFO:teuthology.orchestra.run.smithi102.stdout:4195 punch from 0x54485cb to 0x5453841, (0xb276 bytes) 2024-09-21T22:01:41.916 INFO:teuthology.orchestra.run.smithi102.stdout:4196 write 0x5515991 thru 0x551ef6e (0x95de bytes) 2024-09-21T22:01:41.920 INFO:teuthology.orchestra.run.smithi102.stdout:4198 trunc from 0xd91fafb to 0xe93f442 2024-09-21T22:01:41.925 INFO:teuthology.orchestra.run.smithi102.stdout:4199 writesame 0x49050ec thru 0x490a3f5 data_size 0x9(0x530a bytes) 2024-09-21T22:01:41.927 INFO:teuthology.orchestra.run.smithi102.stdout:4200 writesame 0xd52afa0 thru 0xd538ae7 data_size 0xc(0xdb48 bytes) 2024-09-21T22:01:41.930 INFO:teuthology.orchestra.run.smithi102.stdout:4201 write 0xa95c397 thru 0xa965fe6 (0x9c50 bytes) 2024-09-21T22:01:41.933 INFO:teuthology.orchestra.run.smithi102.stdout:4202 read 0x2054096 thru 0x205a6e8 (0x6653 bytes) 2024-09-21T22:01:41.933 INFO:teuthology.orchestra.run.smithi102.stdout:4204 read 0x5490d4c thru 0x549c9b5 (0xbc6a bytes) 2024-09-21T22:01:41.933 INFO:teuthology.orchestra.run.smithi102.stdout:4205 write 0x4d4102f thru 0x4d4a849 (0x981b bytes) 2024-09-21T22:01:41.935 INFO:teuthology.orchestra.run.smithi102.stdout:4206 read 0x46ef63c thru 0x46f566a (0x602f bytes) 2024-09-21T22:01:41.935 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.935 INFO:teuthology.orchestra.run.smithi102.stdout:4208 write 0x207e696 thru 0x208699e (0x8309 bytes) 2024-09-21T22:01:41.937 INFO:teuthology.orchestra.run.smithi102.stdout:4210 punch from 0xb757f5c to 0xb75d3f9, (0x549d bytes) 2024-09-21T22:01:41.937 INFO:teuthology.orchestra.run.smithi102.stdout:4211 read 0xd39291 thru 0xd47980 (0xe6f0 bytes) 2024-09-21T22:01:41.937 INFO:teuthology.orchestra.run.smithi102.stdout:4212 write 0xa000b93 thru 0xa0055d2 (0x4a40 bytes) 2024-09-21T22:01:41.939 INFO:teuthology.orchestra.run.smithi102.stdout:4213 write 0x294934b thru 0x29519a5 (0x865b bytes) 2024-09-21T22:01:41.940 INFO:teuthology.orchestra.run.smithi102.stdout:4214 writesame 0xb1200a8 thru 0xb124566 data_size 0x1(0x44bf bytes) 2024-09-21T22:01:41.949 INFO:teuthology.orchestra.run.smithi102.stdout:4216 writesame 0x56a8672 thru 0x56b0b2d data_size 0xa(0x84bc bytes) 2024-09-21T22:01:41.953 INFO:teuthology.orchestra.run.smithi102.stdout:4217 read 0xc30c442 thru 0xc30e870 (0x242f bytes) 2024-09-21T22:01:41.954 INFO:teuthology.orchestra.run.smithi102.stdout:4218 write 0x92c1dbe thru 0x92ce310 (0xc553 bytes) 2024-09-21T22:01:41.956 INFO:teuthology.orchestra.run.smithi102.stdout:4219 read 0x47b73f5 thru 0x47c4f50 (0xdb5c bytes) 2024-09-21T22:01:41.956 INFO:teuthology.orchestra.run.smithi102.stdout:4222 read 0x7cbb32a thru 0x7cbc7f9 (0x14d0 bytes) 2024-09-21T22:01:41.957 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:41.957 INFO:teuthology.orchestra.run.smithi102.stdout:4224 writesame 0x21e31fe thru 0x21e4dcc data_size 0x15(0x1bcf bytes) 2024-09-21T22:01:41.958 INFO:teuthology.orchestra.run.smithi102.stdout:4226 writesame 0x7dc11c9 thru 0x7dcc08c data_size 0xa(0xaec4 bytes) 2024-09-21T22:01:41.961 INFO:teuthology.orchestra.run.smithi102.stdout:4227 punch from 0x453ff6 to 0x45c003, (0x800d bytes) 2024-09-21T22:01:41.961 INFO:teuthology.orchestra.run.smithi102.stdout:4228 read 0x75adb15 thru 0x75bb293 (0xd77f bytes) 2024-09-21T22:01:41.961 INFO:teuthology.orchestra.run.smithi102.stdout:4230 writesame 0xc010ae1 thru 0xc01bd91 data_size 0x7(0xb2b1 bytes) 2024-09-21T22:01:41.966 INFO:teuthology.orchestra.run.smithi102.stdout:4231 writesame 0x9713aae thru 0x971b4d8 data_size 0x19(0x7a2b bytes) 2024-09-21T22:01:41.968 INFO:teuthology.orchestra.run.smithi102.stdout:4232 read 0x15c55bd thru 0x15c651a (0xf5e bytes) 2024-09-21T22:01:41.984 INFO:teuthology.orchestra.run.smithi102.stdout:4234 trunc from 0xe93f442 to 0x10b2ee1 2024-09-21T22:01:41.990 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:41.988+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:42.009 INFO:teuthology.orchestra.run.smithi102.stdout:4237 write 0x4e28b86 thru 0x4e2fd7b (0x71f6 bytes) 2024-09-21T22:01:42.012 INFO:teuthology.orchestra.run.smithi102.stdout:4240 read 0x1ed976f thru 0x1ee70e5 (0xd977 bytes) 2024-09-21T22:01:42.012 INFO:teuthology.orchestra.run.smithi102.stdout:4242 write 0x19be0e9 thru 0x19c7862 (0x977a bytes) 2024-09-21T22:01:42.014 INFO:teuthology.orchestra.run.smithi102.stdout:4243 read 0x4ace1f8 thru 0x4ad0d98 (0x2ba1 bytes) 2024-09-21T22:01:42.014 INFO:teuthology.orchestra.run.smithi102.stdout:4244 read 0x361e620 thru 0x362b28f (0xcc70 bytes) 2024-09-21T22:01:42.025 INFO:teuthology.orchestra.run.smithi102.stdout:4245 write 0x8e87e7d thru 0x8e885c7 (0x74b bytes) 2024-09-21T22:01:42.028 INFO:teuthology.orchestra.run.smithi102.stdout:4247 writesame 0x1c66ea7 thru 0x1c745e9 data_size 0x27(0xd743 bytes) 2024-09-21T22:01:42.030 INFO:teuthology.orchestra.run.smithi102.stdout:4248 read 0x6beb0fb thru 0x6bf5170 (0xa076 bytes) 2024-09-21T22:01:42.030 INFO:teuthology.orchestra.run.smithi102.stdout:4250 read 0x87d5b13 thru 0x87dbfcc (0x64ba bytes) 2024-09-21T22:01:42.031 INFO:teuthology.orchestra.run.smithi102.stdout:4252 punch from 0x697cfd0 to 0x698c773, (0xf7a3 bytes) 2024-09-21T22:01:42.031 INFO:teuthology.orchestra.run.smithi102.stdout:4253 writesame 0x15b92ed thru 0x15bf718 data_size 0x6(0x642c bytes) 2024-09-21T22:01:42.033 INFO:teuthology.orchestra.run.smithi102.stdout:4254 write 0x5f46486 thru 0x5f4b104 (0x4c7f bytes) 2024-09-21T22:01:42.036 INFO:teuthology.orchestra.run.smithi102.stdout:4255 write 0x7b3f96 thru 0x7b7ddb (0x3e46 bytes) 2024-09-21T22:01:42.043 INFO:teuthology.orchestra.run.smithi102.stdout:4257 trunc from 0x8e885c8 to 0xe4246ee 2024-09-21T22:01:42.050 INFO:teuthology.orchestra.run.smithi102.stdout:4259 write 0x3a9c10b thru 0x3aa2240 (0x6136 bytes) 2024-09-21T22:01:42.052 INFO:teuthology.orchestra.run.smithi102.stdout:4260 write 0xb6bba18 thru 0xb6c759f (0xbb88 bytes) 2024-09-21T22:01:42.060 INFO:teuthology.orchestra.run.smithi102.stdout:4261 write 0xed14327 thru 0xed20e69 (0xcb43 bytes) 2024-09-21T22:01:42.062 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:42.062 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:42.062 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:42.062 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:42.062 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:42.064 INFO:teuthology.orchestra.run.smithi102.stdout:4263 writesame 0xcfd2c66 thru 0xcfd6e5e data_size 0x1(0x41f9 bytes) 2024-09-21T22:01:42.071 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:42.083 INFO:teuthology.orchestra.run.smithi102.stdout:4264 trunc from 0xed20e6a to 0x7e8e414 2024-09-21T22:01:42.090 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:42.089+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:42.102 INFO:teuthology.orchestra.run.smithi102.stdout:4265 trunc from 0x7e8e414 to 0xe1aee69 2024-09-21T22:01:42.108 INFO:teuthology.orchestra.run.smithi102.stdout:4266 write 0x2af3939 thru 0x2af635d (0x2a25 bytes) 2024-09-21T22:01:42.110 INFO:teuthology.orchestra.run.smithi102.stdout:4267 read 0xabf5c09 thru 0xabfc5e8 (0x69e0 bytes) 2024-09-21T22:01:42.110 INFO:teuthology.orchestra.run.smithi102.stdout:4269 punch from 0x9496b00 to 0x949c812, (0x5d12 bytes) 2024-09-21T22:01:42.111 INFO:teuthology.orchestra.run.smithi102.stdout:4270 write 0x1bae10d thru 0x1bb4792 (0x6686 bytes) 2024-09-21T22:01:42.112 INFO:teuthology.orchestra.run.smithi102.stdout:4274 punch from 0x4cb6d40 to 0x4cbf079, (0x8339 bytes) 2024-09-21T22:01:42.112 INFO:teuthology.orchestra.run.smithi102.stdout:4275 read 0x15425cc thru 0x154e855 (0xc28a bytes) 2024-09-21T22:01:42.113 INFO:teuthology.orchestra.run.smithi102.stdout:4276 read 0xb1c3712 thru 0xb1c6f52 (0x3841 bytes) 2024-09-21T22:01:42.113 INFO:teuthology.orchestra.run.smithi102.stdout:4277 write 0x2399df thru 0x2413c6 (0x79e8 bytes) 2024-09-21T22:01:42.114 INFO:teuthology.orchestra.run.smithi102.stdout:4279 read 0x78478b3 thru 0x784c45c (0x4baa bytes) 2024-09-21T22:01:42.114 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:42.114 INFO:teuthology.orchestra.run.smithi102.stdout:4282 writesame 0x218c9e0 thru 0x2191a33 data_size 0x61(0x5054 bytes) 2024-09-21T22:01:42.123 INFO:teuthology.orchestra.run.smithi102.stdout:4283 trunc from 0xe1aee69 to 0x82cf719 2024-09-21T22:01:42.129 INFO:teuthology.orchestra.run.smithi102.stdout:4284 write 0x3791e5b thru 0x379dcb0 (0xbe56 bytes) 2024-09-21T22:01:42.131 INFO:teuthology.orchestra.run.smithi102.stdout:4285 read 0x7d51149 thru 0x7d5a40c (0x92c4 bytes) 2024-09-21T22:01:42.132 INFO:teuthology.orchestra.run.smithi102.stdout:4286 trunc from 0x82cf719 to 0x7f8147b 2024-09-21T22:01:42.138 INFO:teuthology.orchestra.run.smithi102.stdout:4288 read 0x56b60e4 thru 0x56c2072 (0xbf8f bytes) 2024-09-21T22:01:42.138 INFO:teuthology.orchestra.run.smithi102.stdout:4289 punch from 0x19fade6 to 0x1a03a90, (0x8caa bytes) 2024-09-21T22:01:42.138 INFO:teuthology.orchestra.run.smithi102.stdout:4290 write 0x745c2d1 thru 0x7461dc2 (0x5af2 bytes) 2024-09-21T22:01:42.139 INFO:teuthology.orchestra.run.smithi102.stdout:4292 read 0x296c238 thru 0x2977f0c (0xbcd5 bytes) 2024-09-21T22:01:42.140 INFO:teuthology.orchestra.run.smithi102.stdout:4294 write 0x1803b7 thru 0x18d4d2 (0xd11c bytes) 2024-09-21T22:01:42.142 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:42.142 INFO:teuthology.orchestra.run.smithi102.stdout:4296 write 0x6cda31d thru 0x6cdec59 (0x493d bytes) 2024-09-21T22:01:42.149 INFO:teuthology.orchestra.run.smithi102.stdout:4297 trunc from 0x7f8147b to 0x43833f6 2024-09-21T22:01:42.156 INFO:teuthology.orchestra.run.smithi102.stdout:4298 punch from 0x28f4258 to 0x28ff31d, (0xb0c5 bytes) 2024-09-21T22:01:42.163 INFO:teuthology.orchestra.run.smithi102.stdout:4299 write 0x5302f6e thru 0x5308578 (0x560b bytes) 2024-09-21T22:01:42.170 INFO:teuthology.orchestra.run.smithi102.stdout:4301 trunc from 0x5308579 to 0x9f796e2 2024-09-21T22:01:42.176 INFO:teuthology.orchestra.run.smithi102.stdout:4302 read 0x3afb317 thru 0x3b0938c (0xe076 bytes) 2024-09-21T22:01:42.177 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:42.183 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:42.183 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:42.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:42.183 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:42.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.183 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:01:42.183 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 23.337598151000002, 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:01:42.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:01:42.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:01:42.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:01:42.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.338686637999999, 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.190 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:01:42.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:01:42.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:01:42.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:01:42.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:01:42.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.230229881, 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:01:42.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:01:42.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.200 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.230220588000002, 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:01:42.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:01:42.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:01:42.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.204 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.230196842000002, 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:01:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.230186288999999, 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.209 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.230176885999999, 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.213 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.230166096000001, 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.217 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.230132823000002, 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.221 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:01:42.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.230122151, 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.225 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:42.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:01:42.227 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:01:42.228 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.225992659999999, 2024-09-21T22:01:42.229 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:01:42.231 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:01:42.232 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.233 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.225593522, 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.236 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.224638931000001, 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.238 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.224615677999999, 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.242 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:01:42.244 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.245 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.223323008000001, 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.248 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:42.249 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.223303895000001, 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:42.250 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:01:42.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:01:42.252 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.253 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.223284764999999, 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.254 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.257 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.223266426999999, 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.258 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:42.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.223248028, 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.262 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:41899 3.10 3:0bb333a9:::rbd_data.11247a90fb52.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:01:42.266 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 13.426338617000001, 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015085853, 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 41899 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:01:42.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754789+0000", 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.372e-06 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754796+0000", 2024-09-21T22:01:42.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8249999999999999e-06 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754809+0000", 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3662000000000001e-05 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754816+0000", 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7220000000000002e-06 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754866+0000", 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9945999999999999e-05 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754919+0000", 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3329999999999999e-05 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.758040+0000", 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031204869999999999 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769752+0000", 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011712530000000001 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769803+0000", 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.117e-05 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769841+0000", 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7982999999999999e-05 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769873+0000", 2024-09-21T22:01:42.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1826000000000003e-05 2024-09-21T22:01:42.272 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.272 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.272 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.272 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.272 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.272 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:42.273 INFO:teuthology.orchestra.run.smithi102.stdout:4305 writesame 0xd14d537 thru 0xd14e60f data_size 0x1(0x10d9 bytes) 2024-09-21T22:01:42.274 INFO:teuthology.orchestra.run.smithi102.stdout:4306 write 0x236a142 thru 0x236fc50 (0x5b0f bytes) 2024-09-21T22:01:42.274 INFO:teuthology.orchestra.run.smithi102.stdout:4308 write 0x75a6a8b thru 0x75a9a83 (0x2ff9 bytes) 2024-09-21T22:01:42.274 INFO:teuthology.orchestra.run.smithi102.stdout:4309 write 0x1912930 thru 0x191bec3 (0x9594 bytes) 2024-09-21T22:01:42.274 INFO:teuthology.orchestra.run.smithi102.stdout:4311 writesame 0xbb25e2b thru 0xbb2d2fa data_size 0x38(0x74d0 bytes) 2024-09-21T22:01:42.274 INFO:teuthology.orchestra.run.smithi102.stdout:4312 clone 31 order 23 su 131072 sc 9 2024-09-21T22:01:42.274 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:42.275 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:42.272+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:42.374 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:42.372+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:42.377 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:42.377 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:42.377 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:42.377 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:42.385 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:42.475 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:42.474+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:42.529 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:42.529 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:42.529 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:42.529 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:42.529 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:42.537 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:42.576 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:42.575+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:42.641 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:42.642 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:42.642 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:42.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:42.642 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:42.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.642 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:42.642 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:42.642 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.566419527999997, 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:01:42.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:01:42.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:42.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:42.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:42.649 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 37.134383276999998, 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:42.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:01:42.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:42.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28830 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.781624032, 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023121914, 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28830 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:42.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2500000000000001e-07 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858180+0000", 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3939999999999999e-06 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858187+0000", 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7399999999999998e-06 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858192+0000", 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0690000000000001e-06 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881115+0000", 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923756 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881192+0000", 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6867999999999997e-05 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881299+0000", 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000106662 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28831 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1175552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:42.659 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.781603415999999, 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023343084, 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28831 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:42.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2e-07 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858200+0000", 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0430000000000002e-06 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858207+0000", 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6449999999999999e-06 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858212+0000", 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0549999999999999e-06 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881352+0000", 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023140609999999999 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881438+0000", 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5278000000000006e-05 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881541+0000", 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103033 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28832 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.663 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.781583124000001, 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023498735999999999, 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28832 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:42.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3099999999999999e-07 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858220+0000", 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858223+0000", 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.641e-06 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858226+0000", 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9919999999999999e-06 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881570+0000", 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023343632999999999 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881644+0000", 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3645000000000004e-05 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881717+0000", 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3066999999999997e-05 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.667 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28833 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1257472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.781571063000001, 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023709134999999999, 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28833 2024-09-21T22:01:42.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858231+0000", 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.175e-06 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858235+0000", 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4290000000000001e-06 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858239+0000", 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0990000000000001e-06 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881761+0000", 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023522279 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881847+0000", 2024-09-21T22:01:42.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6018000000000002e-05 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881939+0000", 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1910999999999995e-05 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.781556460000001, 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:01:42.672 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:42.676 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.781536997, 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:01:42.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:01:42.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.78150892, 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.781487087999999, 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.781466761000001, 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:01:42.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:01:42.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.781445799, 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:42.694 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.695 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.697 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.781424812000001, 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.698 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.699 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.700 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.701 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29858 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2834432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.746575296, 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023030268999999999, 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.702 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29858 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5900000000000002e-07 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893228+0000", 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1859999999999999e-06 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893235+0000", 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7139999999999996e-06 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.704 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893241+0000", 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7620000000000001e-06 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916157+0000", 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022915819 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916200+0000", 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2898999999999997e-05 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.705 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916256+0000", 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.643e-05 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29859 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2875392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.746553800000001, 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023235025999999999, 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.706 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29859 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.707 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893248+0000", 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.89e-07 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893249+0000", 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4950000000000001e-06 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.708 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893255+0000", 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9410000000000004e-06 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893260+0000", 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1930000000000001e-06 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916285+0000", 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023024203 2024-09-21T22:01:42.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916375+0000", 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0486000000000001e-05 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916482+0000", 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000107219 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29860 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2916352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.746533819, 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023394503000000001, 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29860 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.711 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893268+0000", 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:01:42.712 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893270+0000", 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893282+0000", 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2291e-05 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.713 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893287+0000", 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2480000000000004e-06 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916509+0000", 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023221836999999999 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916567+0000", 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7615999999999999e-05 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.714 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916662+0000", 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.501e-05 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29861 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2957312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.746506546999999, 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023596588000000002, 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.715 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29861 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.716 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893297+0000", 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2539999999999999e-06 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.717 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893304+0000", 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893308+0000", 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4800000000000003e-06 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916697+0000", 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023388720000000002 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.718 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916787+0000", 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9777999999999993e-05 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916891+0000", 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010459900000000001 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.719 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29862 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2998272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.746487171999998, 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023721644, 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29862 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:42.720 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893316+0000", 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.091e-06 2024-09-21T22:01:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893322+0000", 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893328+0000", 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2299999999999999e-06 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916932+0000", 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023603889999999999 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916980+0000", 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8803e-05 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917036+0000", 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5219000000000001e-05 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29863 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 3031040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:42.723 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.746467833000001, 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023866634000000001, 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29863 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.724 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893334+0000", 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893339+0000", 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.725 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893345+0000", 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1469999999999998e-06 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893356+0000", 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0772e-05 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917062+0000", 2024-09-21T22:01:42.726 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023706261999999999 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917108+0000", 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5318000000000002e-05 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917200+0000", 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2238999999999996e-05 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.727 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 1.839978018, 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.728 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.729 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.730 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.731 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:42.732 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:01:42.733 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:01:42.733 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.733 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.733 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.733 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:42.733 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:42.733 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:42.734 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:42.733+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:42.734 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:42.835 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:42.834+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:42.842 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:42.842 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:42.842 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:42.842 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:42.851 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:42.857 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:42.858 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:42.874 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:42.875 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:42.891 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:42.891 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:42.907 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:42.907 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:42.926 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:01:42.929 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:42.929 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:42.936 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:42.935+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:42.950 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:42.951 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:42.968 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:42.968 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:42.968 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:42.969 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:42.978 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:42.986 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:42.987 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:43.030 INFO:teuthology.orchestra.run.smithi102.stdout:flattening image image_client.0-clone30 2024-09-21T22:01:43.036 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:43.035+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:43.099 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:43.099 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:43.109 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:43.151 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:43.150+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:43.222 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-21T22:01:43.238 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:43.237+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:43.277 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:43.277 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:43.287 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:43.318 INFO:teuthology.orchestra.run.smithi102.stdout:4313 read 0x52aac0b thru 0x52ade0f (0x3205 bytes) 2024-09-21T22:01:43.338 INFO:teuthology.orchestra.run.smithi102.stdout:4314 trunc from 0xd14e610 to 0x1613509 2024-09-21T22:01:43.339 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:43.337+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:43.395 INFO:teuthology.orchestra.run.smithi102.stdout:4315 write 0x1782da8 thru 0x1783baa (0xe03 bytes) 2024-09-21T22:01:43.396 INFO:teuthology.orchestra.run.smithi102.stdout:4316 read 0x14a1132 thru 0x14ac87e (0xb74d bytes) 2024-09-21T22:01:43.411 INFO:teuthology.orchestra.run.smithi102.stdout:4319 write 0x88f14f9 thru 0x88fe69f (0xd1a7 bytes) 2024-09-21T22:01:43.414 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:43.414 INFO:teuthology.orchestra.run.smithi102.stdout:4321 write 0x1f3c6f thru 0x2036f4 (0xfa86 bytes) 2024-09-21T22:01:43.415 INFO:teuthology.orchestra.run.smithi102.stdout:4322 read 0x630446e thru 0x6312332 (0xdec5 bytes) 2024-09-21T22:01:43.416 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:43.416 INFO:teuthology.orchestra.run.smithi102.stdout:4324 writesame 0x3d752e5 thru 0x3d7d2da data_size 0xb(0x7ff6 bytes) 2024-09-21T22:01:43.417 INFO:teuthology.orchestra.run.smithi102.stdout:4325 read 0x225636b thru 0x225fda1 (0x9a37 bytes) 2024-09-21T22:01:43.417 INFO:teuthology.orchestra.run.smithi102.stdout:4328 writesame 0x16060b1 thru 0x1608815 data_size 0x1(0x2765 bytes) 2024-09-21T22:01:43.429 INFO:teuthology.orchestra.run.smithi102.stdout:4329 trunc from 0x88fe6a0 to 0x22aecae 2024-09-21T22:01:43.439 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:43.438+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:43.441 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:43.441 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:43.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:43.452 INFO:teuthology.orchestra.run.smithi102.stdout:4330 writesame 0x2ceb9cb thru 0x2cfa434 data_size 0x55(0xea6a bytes) 2024-09-21T22:01:43.471 INFO:teuthology.orchestra.run.smithi102.stdout:4331 write 0xd080109 thru 0xd08f4ab (0xf3a3 bytes) 2024-09-21T22:01:43.487 INFO:teuthology.orchestra.run.smithi102.stdout:4333 trunc from 0xd08f4ac to 0x25ef605 2024-09-21T22:01:43.509 INFO:teuthology.orchestra.run.smithi102.stdout:4339 trunc from 0x25ef605 to 0xa5651d7 2024-09-21T22:01:43.516 INFO:teuthology.orchestra.run.smithi102.stdout:4340 trunc from 0xa5651d7 to 0xae98ade 2024-09-21T22:01:43.522 INFO:teuthology.orchestra.run.smithi102.stdout:4341 writesame 0x9fe1606 thru 0x9fe8eec data_size 0x39(0x78e7 bytes) 2024-09-21T22:01:43.525 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:43.525 INFO:teuthology.orchestra.run.smithi102.stdout:4344 write 0x8baafe9 thru 0x8bb4221 (0x9239 bytes) 2024-09-21T22:01:43.528 INFO:teuthology.orchestra.run.smithi102.stdout:4345 write 0x287138c thru 0x287168f (0x304 bytes) 2024-09-21T22:01:43.530 INFO:teuthology.orchestra.run.smithi102.stdout:4346 clone 32 order 20 su 65536 sc 15 2024-09-21T22:01:43.540 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:43.539+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:43.581 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:43.581 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:43.590 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:43.674 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:43.672+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:43.733 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:43.733 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:43.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:43.782 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:43.780+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:43.843 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:43.842+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:43.883 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:43.883 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:43.892 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:43.921 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:01:43.978 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone31 from 0xae98ade (overlap 0x1613509) to 0x8d486a 2024-09-21T22:01:43.978 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:43.976+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:44.008 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:44.009 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:44.017 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:44.042 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-21T22:01:44.044 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:44.042+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:44.145 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:44.143+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:44.159 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:44.159 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:44.168 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:44.245 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:44.244+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:44.280 INFO:teuthology.orchestra.run.smithi102.stdout:4349 read 0x2e94cb5 thru 0x2e98fec (0x4338 bytes) 2024-09-21T22:01:44.284 INFO:teuthology.orchestra.run.smithi102.stdout:4350 write 0x9626b53 thru 0x962ac36 (0x40e4 bytes) 2024-09-21T22:01:44.290 INFO:teuthology.orchestra.run.smithi102.stdout:4352 write 0x97ae317 thru 0x97b80eb (0x9dd5 bytes) 2024-09-21T22:01:44.297 INFO:teuthology.orchestra.run.smithi102.stdout:4353 read 0x8990d52 thru 0x89972fb (0x65aa bytes) 2024-09-21T22:01:44.301 INFO:teuthology.orchestra.run.smithi102.stdout:4354 trunc from 0xae98ade to 0xebfabe8 2024-09-21T22:01:44.311 INFO:teuthology.orchestra.run.smithi102.stdout:4356 trunc from 0xebfabe8 to 0xaac2165 2024-09-21T22:01:44.321 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:44.321 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:44.333 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:44.333 INFO:teuthology.orchestra.run.smithi102.stdout:4357 punch from 0x1938a59 to 0x1945cc3, (0xd26a bytes) 2024-09-21T22:01:44.333 INFO:teuthology.orchestra.run.smithi102.stdout:4358 read 0x1485677 thru 0x148f3ec (0x9d76 bytes) 2024-09-21T22:01:44.341 INFO:teuthology.orchestra.run.smithi102.stdout:4360 trunc from 0xaac2165 to 0x485c000 2024-09-21T22:01:44.347 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:44.345+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:44.391 INFO:teuthology.orchestra.run.smithi102.stdout:4361 write 0x9da2468 thru 0x9db181f (0xf3b8 bytes) 2024-09-21T22:01:44.397 INFO:teuthology.orchestra.run.smithi102.stdout:4362 read 0x992d7d thru 0x99e632 (0xb8b6 bytes) 2024-09-21T22:01:44.398 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:44.407 INFO:teuthology.orchestra.run.smithi102.stdout:4366 write 0xb3a77bf thru 0xb3aa2e1 (0x2b23 bytes) 2024-09-21T22:01:44.410 INFO:teuthology.orchestra.run.smithi102.stdout:4367 punch from 0x8c6d70a to 0x8c73eb4, (0x67aa bytes) 2024-09-21T22:01:44.410 INFO:teuthology.orchestra.run.smithi102.stdout:4368 write 0x9ef472b thru 0x9f037f3 (0xf0c9 bytes) 2024-09-21T22:01:44.416 INFO:teuthology.orchestra.run.smithi102.stdout:4369 read 0x701f1a0 thru 0x702c872 (0xd6d3 bytes) 2024-09-21T22:01:44.425 INFO:teuthology.orchestra.run.smithi102.stdout:4375 trunc from 0xb3aa2e2 to 0x4455721 2024-09-21T22:01:44.444 INFO:teuthology.orchestra.run.smithi102.stdout:4376 read 0x7216e9 thru 0x72516c (0x3a84 bytes) 2024-09-21T22:01:44.444 INFO:teuthology.orchestra.run.smithi102.stdout:4379 read 0x28ea7a0 thru 0x28edf26 (0x3787 bytes) 2024-09-21T22:01:44.446 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:44.446 INFO:teuthology.orchestra.run.smithi102.stdout:4384 punch from 0x1b7ea5b to 0x1b837cc, (0x4d71 bytes) 2024-09-21T22:01:44.447 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:44.445+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:44.458 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:44.458 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:44.462 INFO:teuthology.orchestra.run.smithi102.stdout:4386 write 0xdbd078a thru 0xdbd0b9a (0x411 bytes) 2024-09-21T22:01:44.467 INFO:teuthology.orchestra.run.smithi102.stdout:4387 writesame 0xa6e2ebf thru 0xa6e553b data_size 0x1(0x267d bytes) 2024-09-21T22:01:44.468 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:44.474 INFO:teuthology.orchestra.run.smithi102.stdout:4389 read 0xbf46b60 thru 0xbf470ab (0x54c bytes) 2024-09-21T22:01:44.474 INFO:teuthology.orchestra.run.smithi102.stdout:4390 read 0x8c5672b thru 0x8c5a8c3 (0x4199 bytes) 2024-09-21T22:01:44.474 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:44.475 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:44.475 INFO:teuthology.orchestra.run.smithi102.stdout:4394 read 0x4f8803d thru 0x4f96a3a (0xe9fe bytes) 2024-09-21T22:01:44.480 INFO:teuthology.orchestra.run.smithi102.stdout:4396 trunc from 0xdbd0b9b to 0x8cdc89e 2024-09-21T22:01:44.491 INFO:teuthology.orchestra.run.smithi102.stdout:4397 write 0x5221de2 thru 0x5222cd8 (0xef7 bytes) 2024-09-21T22:01:44.493 INFO:teuthology.orchestra.run.smithi102.stdout:4398 clone 33 order 20 su 32768 sc 11 2024-09-21T22:01:44.548 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:44.546+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:44.572 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:44.572 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:44.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:44.649 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:44.647+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:44.684 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:44.684 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:44.693 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:44.750 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:44.748+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:44.835 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:44.835 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:44.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:44.888 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:44.886+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:44.950 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:44.950 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:44.951 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:44.949+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:44.959 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:45.000 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:45.001 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone32 from 0x8cdc89e (overlap 0x4455721) to 0x1b5560d 2024-09-21T22:01:45.068 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:45.066+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:45.136 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:45.136 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:45.137 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-21T22:01:45.149 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:45.151 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:45.151 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:45.154 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:45.152+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:45.168 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:45.169 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:45.175 INFO:teuthology.orchestra.run.smithi102.stdout:4400 writesame 0xe514eaf thru 0xe5187ee data_size 0x20(0x3940 bytes) 2024-09-21T22:01:45.176 INFO:teuthology.orchestra.run.smithi102.stdout:4401 write 0x1101382 thru 0x1104001 (0x2c80 bytes) 2024-09-21T22:01:45.185 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:45.185 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:45.196 INFO:teuthology.orchestra.run.smithi102.stdout:4402 trunc from 0xe5187ef to 0x1219bd4 2024-09-21T22:01:45.209 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:45.222 INFO:teuthology.orchestra.run.smithi102.stdout:4403 clone 34 order 22 su 2097152 sc 15 2024-09-21T22:01:45.228 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:45.228 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:45.245 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:45.245 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:45.255 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:45.252+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:45.261 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:45.261 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:45.277 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:45.306 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.251854989000002, 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:45.307 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:01:45.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.312 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29926 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3567616~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.375193727999999, 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028146526000000002, 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.313 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29926 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928550+0000", 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928552+0000", 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928558+0000", 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6690000000000003e-06 2024-09-21T22:01:45.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928562+0000", 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2910000000000001e-06 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956591+0000", 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028029011999999999 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956646+0000", 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5016999999999999e-05 2024-09-21T22:01:45.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956696+0000", 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9920999999999999e-05 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29927 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3002368~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.375175499000001, 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028301160999999998, 2024-09-21T22:01:45.317 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29927 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928569+0000", 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.395e-06 2024-09-21T22:01:45.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928573+0000", 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.225e-06 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928575+0000", 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956723+0000", 2024-09-21T22:01:45.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028148237 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956768+0000", 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4749999999999997e-05 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956869+0000", 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010078599999999999 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29928 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3043328~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.375156798999999, 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028496923, 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29928 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.322 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928587+0000", 2024-09-21T22:01:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4699999999999998e-07 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928588+0000", 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.313e-06 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928591+0000", 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1999999999999999e-06 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928598+0000", 2024-09-21T22:01:45.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0890000000000002e-06 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956939+0000", 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028341261 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957006+0000", 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6704000000000004e-05 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957083+0000", 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7108999999999996e-05 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.375140495, 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.326 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:45.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:01:45.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:01:45.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:01:45.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:01:45.330 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.330 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.330 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.375130545000001, 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:01:45.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.375117142000001, 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.335 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.339 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.375107471, 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:01:45.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:01:45.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29937 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3248128~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.373329828999999, 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028121855000000001, 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.344 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29937 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:01:45.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930414+0000", 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930416+0000", 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-06 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930422+0000", 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930435+0000", 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2404e-05 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958382+0000", 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027947339000000002 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958450+0000", 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7611e-05 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958535+0000", 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5680999999999995e-05 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29939 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3289088~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.348 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.373275100000001, 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028207189000000001, 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29939 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:01:45.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930471+0000", 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930476+0000", 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4410000000000001e-06 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930480+0000", 2024-09-21T22:01:45.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.391e-06 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958565+0000", 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028084392999999999 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958617+0000", 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1706999999999998e-05 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958675+0000", 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8715999999999998e-05 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29941 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3330048~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.373237798000002, 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028386958, 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.353 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29941 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:01:45.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930506+0000", 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930508+0000", 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.782e-06 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930514+0000", 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930518+0000", 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0949999999999998e-06 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958712+0000", 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028194745 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958788+0000", 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5556000000000006e-05 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958892+0000", 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000104304 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.357 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29943 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.373194462000001, 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028512368999999999, 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29943 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-07 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930551+0000", 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930557+0000", 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6799999999999998e-06 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930561+0000", 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5399999999999997e-06 2024-09-21T22:01:45.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958929+0000", 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028367277999999999 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958988+0000", 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8928000000000002e-05 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959061+0000", 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3460000000000005e-05 2024-09-21T22:01:45.361 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29945 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3411968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.373156063, 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028678985000000001, 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.362 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29945 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930588+0000", 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930589+0000", 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.939e-06 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930595+0000", 2024-09-21T22:01:45.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8810000000000001e-06 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930600+0000", 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5539999999999999e-06 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959097+0000", 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028497248999999999 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959184+0000", 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7170999999999996e-05 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959266+0000", 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1769999999999998e-05 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:45.366 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.373111634000001, 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:45.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:01:45.370 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.373065378, 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.371 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:01:45.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:45.375 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.373028043000001, 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:45.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:01:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.379 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.372993862000001, 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.380 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:01:45.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.372953989999999, 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:01:45.384 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:01:45.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:01:45.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.372908705, 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:01:45.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:01:45.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:01:45.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:40935 3.5 3:a2bf362e:::rbd_data.112498fbc780.0000000000000004:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.30739333, 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028536945000000001, 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.393 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 40935 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996352+0000", 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.041e-06 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996362+0000", 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0447e-05 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996382+0000", 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9639e-05 2024-09-21T22:01:45.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996393+0000", 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1358e-05 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996458+0000", 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4649999999999999e-05 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996523+0000", 2024-09-21T22:01:45.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4775000000000002e-05 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.001040+0000", 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045170920000000003 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024702+0000", 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023662336999999999 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:45.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024758+0000", 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6138999999999999e-05 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024825+0000", 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6834000000000004e-05 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024887+0000", 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1632999999999998e-05 2024-09-21T22:01:45.398 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.399 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.399 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.399 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.399 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.399 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:45.400 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:45.401 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:45.399+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:45.503 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:45.501+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:45.544 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:45.544 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:45.544 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:45.544 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:45.553 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:45.601 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:45.600+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:45.695 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:45.695 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:45.695 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:45.695 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:45.695 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:45.702 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:45.701+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:45.703 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:45.803 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:45.801+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:45.848 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:45.848 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:45.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:45.848 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:45.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.848 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:01:45.848 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.002673302000002, 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:01:45.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:01:45.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:01:45.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 26.003761788999999, 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.855 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:01:45.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:01:45.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:01:45.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:01:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.861 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.895305032, 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.862 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:01:45.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.895295739000002, 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.866 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:45.870 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.895271993000001, 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.895261439999999, 2024-09-21T22:01:45.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.875 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:01:45.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.895252036999999, 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.879 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.880 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.895241247000001, 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.883 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.884 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.886 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.895207974000002, 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.887 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.888 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.890 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.895197302, 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.891 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.892 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.893 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.894 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.891067810999999, 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.895 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:01:45.896 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.897 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:01:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:01:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:01:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:01:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.899 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.890668673, 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.900 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:01:45.901 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:01:45.902 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.903 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.889714082000001, 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:01:45.904 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:01:45.905 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.906 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.907 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.889690828999999, 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.908 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.909 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.910 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.911 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.912 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.888398159000001, 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:45.913 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.914 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:01:45.915 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:01:45.916 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.888379046000001, 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.917 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.918 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.919 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:01:45.920 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.921 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.888359915999999, 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.922 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:45.923 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.924 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.925 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.888341577999999, 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:01:45.926 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.927 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:01:45.928 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:01:45.929 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.930 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.930 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.930 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:01:45.930 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:01:45.930 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.930 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.930 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.888323179, 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.931 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:01:45.932 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:01:45.933 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:01:45.934 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:41899 3.10 3:0bb333a9:::rbd_data.11247a90fb52.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 17.091413767999999, 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015085853, 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:45.935 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 41899 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:45.936 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754789+0000", 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.372e-06 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754796+0000", 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8249999999999999e-06 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754809+0000", 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3662000000000001e-05 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.937 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754816+0000", 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7220000000000002e-06 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754866+0000", 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9945999999999999e-05 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:45.938 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754919+0000", 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3329999999999999e-05 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.758040+0000", 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031204869999999999 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769752+0000", 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011712530000000001 2024-09-21T22:01:45.939 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.940 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.940 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:45.940 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769803+0000", 2024-09-21T22:01:45.940 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.117e-05 2024-09-21T22:01:45.940 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.940 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.940 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:45.940 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769841+0000", 2024-09-21T22:01:45.940 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7982999999999999e-05 2024-09-21T22:01:45.940 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:45.941 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:45.941 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:45.941 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769873+0000", 2024-09-21T22:01:45.941 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1826000000000003e-05 2024-09-21T22:01:45.941 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.941 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.941 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.941 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:45.941 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:45.941 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:45.942 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:01:45.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:45.943 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:45.940+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:46.023 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone33 from 0x1219bd4 (overlap 0x1219bd4) to 0xadc3e5 2024-09-21T22:01:46.028 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:01:46.028 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:01:46.028 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:01:46.028 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:01:46.073 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:46.071+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:46.098 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:46.098 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:46.098 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:46.098 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:46.107 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:46.134 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-21T22:01:46.151 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:46.149+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:46.221 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:46.221 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:46.221 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:46.221 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:46.221 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:46.230 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:46.237 INFO:teuthology.orchestra.run.smithi102.stdout:4404 write 0x88ccae9 thru 0x88d7501 (0xaa19 bytes) 2024-09-21T22:01:46.241 INFO:teuthology.orchestra.run.smithi102.stdout:4405 punch from 0x7fa5282 to 0x7fabf29, (0x6ca7 bytes) 2024-09-21T22:01:46.244 INFO:teuthology.orchestra.run.smithi102.stdout:4407 trunc from 0x88d7502 to 0x631908a 2024-09-21T22:01:46.244 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:46.242+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:46.254 INFO:teuthology.orchestra.run.smithi102.stdout:4408 writesame 0x2039969 thru 0x2040b2c data_size 0x12(0x71c4 bytes) 2024-09-21T22:01:46.266 INFO:teuthology.orchestra.run.smithi102.stdout:4410 read 0x5860066 thru 0x586b004 (0xaf9f bytes) 2024-09-21T22:01:46.273 INFO:teuthology.orchestra.run.smithi102.stdout:4411 write 0x6f6ab14 thru 0x6f79ce2 (0xf1cf bytes) 2024-09-21T22:01:46.278 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:46.279 INFO:teuthology.orchestra.run.smithi102.stdout:4414 trunc from 0x6f79ce3 to 0x63aca1f 2024-09-21T22:01:46.302 INFO:teuthology.orchestra.run.smithi102.stdout:4415 write 0xedf6a3e thru 0xee05aa2 (0xf065 bytes) 2024-09-21T22:01:46.306 INFO:teuthology.orchestra.run.smithi102.stdout:4417 read 0x45d07e8 thru 0x45d74a4 (0x6cbd bytes) 2024-09-21T22:01:46.306 INFO:teuthology.orchestra.run.smithi102.stdout:4418 read 0x49ad2e1 thru 0x49b366b (0x638b bytes) 2024-09-21T22:01:46.306 INFO:teuthology.orchestra.run.smithi102.stdout:4419 write 0x11fe532 thru 0x120664a (0x8119 bytes) 2024-09-21T22:01:46.322 INFO:teuthology.orchestra.run.smithi102.stdout:4420 trunc from 0xee05aa3 to 0x53a2968 2024-09-21T22:01:46.340 INFO:teuthology.orchestra.run.smithi102.stdout:4421 write 0x674b894 thru 0x674dd13 (0x2480 bytes) 2024-09-21T22:01:46.343 INFO:teuthology.orchestra.run.smithi102.stdout:4423 write 0x41f32e4 thru 0x41f8f81 (0x5c9e bytes) 2024-09-21T22:01:46.345 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:46.343+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:46.347 INFO:teuthology.orchestra.run.smithi102.stdout:4424 trunc from 0x674dd14 to 0x5c89047 2024-09-21T22:01:46.353 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:46.353 INFO:teuthology.orchestra.run.smithi102.stdout:4427 punch from 0x2bbba4d to 0x2bc647a, (0xaa2d bytes) 2024-09-21T22:01:46.353 INFO:teuthology.orchestra.run.smithi102.stdout:4428 read 0x307acc7 thru 0x3088388 (0xd6c2 bytes) 2024-09-21T22:01:46.354 INFO:teuthology.orchestra.run.smithi102.stdout:4429 read 0x33f46b6 thru 0x33f66cb (0x2016 bytes) 2024-09-21T22:01:46.354 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:46.354 INFO:teuthology.orchestra.run.smithi102.stdout:4432 write 0x11b9d1 thru 0x11bd33 (0x363 bytes) 2024-09-21T22:01:46.363 INFO:teuthology.orchestra.run.smithi102.stdout:4434 read 0x231b17d thru 0x2327169 (0xbfed bytes) 2024-09-21T22:01:46.363 INFO:teuthology.orchestra.run.smithi102.stdout:4435 punch from 0x1a9ca0b to 0x1aa9066, (0xc65b bytes) 2024-09-21T22:01:46.363 INFO:teuthology.orchestra.run.smithi102.stdout:4436 write 0x324930 thru 0x333c91 (0xf362 bytes) 2024-09-21T22:01:46.365 INFO:teuthology.orchestra.run.smithi102.stdout:4437 read 0x58de793 thru 0x58eb1c1 (0xca2f bytes) 2024-09-21T22:01:46.365 INFO:teuthology.orchestra.run.smithi102.stdout:4438 read 0x4847165 thru 0x4850ef3 (0x9d8f bytes) 2024-09-21T22:01:46.365 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:46.365 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:46.366 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:46.366 INFO:teuthology.orchestra.run.smithi102.stdout:4443 write 0x12cb93a thru 0x12d72c0 (0xb987 bytes) 2024-09-21T22:01:46.367 INFO:teuthology.orchestra.run.smithi102.stdout:4444 read 0x21b7068 thru 0x21be754 (0x76ed bytes) 2024-09-21T22:01:46.367 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:46.368 INFO:teuthology.orchestra.run.smithi102.stdout:4446 write 0x42beda3 thru 0x42ca36e (0xb5cc bytes) 2024-09-21T22:01:46.371 INFO:teuthology.orchestra.run.smithi102.stdout:4448 write 0x513baf9 thru 0x513bf55 (0x45d bytes) 2024-09-21T22:01:46.381 INFO:teuthology.orchestra.run.smithi102.stdout:4450 write 0x7122421 thru 0x712c31d (0x9efd bytes) 2024-09-21T22:01:46.382 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:46.382 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:46.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:46.382 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:46.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.382 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 68.306191765999998, 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:01:46.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.389 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 40.874155514999998, 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.390 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.395 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28830 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.52139627, 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023121914, 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28830 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2500000000000001e-07 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858180+0000", 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3939999999999999e-06 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858187+0000", 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7399999999999998e-06 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858192+0000", 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0690000000000001e-06 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881115+0000", 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923756 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881192+0000", 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6867999999999997e-05 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881299+0000", 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000106662 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28831 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1175552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.521375654, 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023343084, 2024-09-21T22:01:46.400 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28831 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2e-07 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858200+0000", 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0430000000000002e-06 2024-09-21T22:01:46.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858207+0000", 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6449999999999999e-06 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858212+0000", 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0549999999999999e-06 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881352+0000", 2024-09-21T22:01:46.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023140609999999999 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881438+0000", 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5278000000000006e-05 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881541+0000", 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103033 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28832 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.521355362000001, 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023498735999999999, 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28832 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.405 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:46.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3099999999999999e-07 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858220+0000", 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858223+0000", 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.641e-06 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858226+0000", 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9919999999999999e-06 2024-09-21T22:01:46.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881570+0000", 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023343632999999999 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881644+0000", 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3645000000000004e-05 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881717+0000", 2024-09-21T22:01:46.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3066999999999997e-05 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28833 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1257472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.521343301000002, 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023709134999999999, 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.409 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28833 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858231+0000", 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.175e-06 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858235+0000", 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4290000000000001e-06 2024-09-21T22:01:46.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858239+0000", 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0990000000000001e-06 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881761+0000", 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023522279 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881847+0000", 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6018000000000002e-05 2024-09-21T22:01:46.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881939+0000", 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1910999999999995e-05 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.521328698000001, 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.413 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.414 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:01:46.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.417 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.521309235, 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.418 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.521281158000001, 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.422 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:01:46.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:01:46.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:01:46.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.521259325999999, 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.426 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:01:46.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:01:46.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.521238999000001, 2024-09-21T22:01:46.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:01:46.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:01:46.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.434 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.521218037000001, 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.435 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:01:46.438 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.521197050000001, 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.439 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:01:46.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29858 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2834432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.486347534, 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023030268999999999, 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.443 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29858 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5900000000000002e-07 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893228+0000", 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1859999999999999e-06 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893235+0000", 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7139999999999996e-06 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.445 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893241+0000", 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7620000000000001e-06 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916157+0000", 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022915819 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916200+0000", 2024-09-21T22:01:46.446 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2898999999999997e-05 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916256+0000", 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.643e-05 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.447 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29859 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2875392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.448 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:46.448 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.486326038000001, 2024-09-21T22:01:46.448 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023235025999999999, 2024-09-21T22:01:46.448 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.448 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.448 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.448 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.449 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.449 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.449 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29859 2024-09-21T22:01:46.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.449 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.449 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.449 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:46.449 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893248+0000", 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.89e-07 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.450 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893249+0000", 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4950000000000001e-06 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893255+0000", 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9410000000000004e-06 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893260+0000", 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1930000000000001e-06 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.451 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916285+0000", 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023024203 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916375+0000", 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0486000000000001e-05 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916482+0000", 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000107219 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.452 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29860 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2916352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.486306057, 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023394503000000001, 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29860 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.453 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893268+0000", 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:01:46.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893270+0000", 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893282+0000", 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2291e-05 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893287+0000", 2024-09-21T22:01:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2480000000000004e-06 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916509+0000", 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023221836999999999 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916567+0000", 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7615999999999999e-05 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.456 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916662+0000", 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.501e-05 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29861 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2957312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.486278785, 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023596588000000002, 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.457 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29861 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.458 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893297+0000", 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2539999999999999e-06 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893304+0000", 2024-09-21T22:01:46.459 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:01:46.460 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.460 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.460 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.460 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893308+0000", 2024-09-21T22:01:46.460 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4800000000000003e-06 2024-09-21T22:01:46.460 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.460 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.460 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.460 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916697+0000", 2024-09-21T22:01:46.460 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023388720000000002 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916787+0000", 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9777999999999993e-05 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916891+0000", 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010459900000000001 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.461 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29862 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2998272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.486259409999999, 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023721644, 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29862 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:46.462 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893316+0000", 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.091e-06 2024-09-21T22:01:46.463 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893322+0000", 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893328+0000", 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2299999999999999e-06 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.464 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916932+0000", 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023603889999999999 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916980+0000", 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8803e-05 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917036+0000", 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5219000000000001e-05 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.465 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29863 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 3031040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.486240071000001, 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023866634000000001, 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29863 2024-09-21T22:01:46.466 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893334+0000", 2024-09-21T22:01:46.467 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:46.468 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.468 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.468 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.468 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893339+0000", 2024-09-21T22:01:46.468 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:01:46.468 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.468 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.468 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.468 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893345+0000", 2024-09-21T22:01:46.468 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1469999999999998e-06 2024-09-21T22:01:46.469 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.469 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.469 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.469 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893356+0000", 2024-09-21T22:01:46.469 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0772e-05 2024-09-21T22:01:46.469 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.469 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.469 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.469 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917062+0000", 2024-09-21T22:01:46.470 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023706261999999999 2024-09-21T22:01:46.470 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.470 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.470 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.470 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917108+0000", 2024-09-21T22:01:46.470 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5318000000000002e-05 2024-09-21T22:01:46.470 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.470 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.470 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.471 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917200+0000", 2024-09-21T22:01:46.471 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2238999999999996e-05 2024-09-21T22:01:46.471 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.471 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.471 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.471 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.471 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.471 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:01:46.471 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:01:46.472 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 5.5797502559999996, 2024-09-21T22:01:46.472 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:01:46.472 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:46.472 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:46.472 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:46.472 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:46.472 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:46.472 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.472 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:01:46.473 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.473 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:46.473 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.473 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:46.473 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:01:46.473 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.473 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.473 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.473 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:46.473 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:01:46.474 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:46.474 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.474 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.474 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:46.474 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:01:46.474 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:01:46.474 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.474 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.474 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:46.475 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:01:46.475 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:01:46.475 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.475 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.475 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:46.475 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:01:46.475 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:01:46.475 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.475 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:01:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:01:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:01:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:01:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:01:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:01:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:01:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:01:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:01:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:01:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:01:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:01:46.479 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.479 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.479 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:46.479 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:01:46.479 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:01:46.479 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:46.479 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:46.479 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:46.479 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:01:46.480 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:01:46.480 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.480 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.480 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.480 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:46.480 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:46.480 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:46.481 INFO:teuthology.orchestra.run.smithi102.stdout:4451 clone 35 order 19 su 16384 sc 14 2024-09-21T22:01:46.482 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:01:46.483 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 72, 2024-09-21T22:01:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "014f3ec5-afd0-4b18-9c74-de91f34d0760", 2024-09-21T22:01:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-09-21T22:00:24.916784+0000", 2024-09-21T22:01:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-09-21T22:01:45.936462+0000", 2024-09-21T22:01:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-09-21T22:00:36.060631+0000", 2024-09-21T22:01:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-09-21T22:01:35.858445+0000", 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5806080, 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "nodeep-scrub", 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "noscrub", 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 5, 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:01:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 3, 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 8, 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "jewel", 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:37.034134+0000", 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:01:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:01:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "17", 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:01:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:01:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-09-21T22:01:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 8, 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 8, 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.25, 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:01:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:42.753049+0000", 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:01:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:01:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "21", 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 2, 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 21, 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:01:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:01:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:01:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.9900000095367432, 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.9900000095367432, 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2.630000114440918, 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2.630000114440918, 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "pool_client.0", 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:52.269263+0000", 2024-09-21T22:01:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-09-21T22:01:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "72", 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:01:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 36, 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 72, 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:01:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:01:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:01:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.7400000095367432, 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.7400000095367432, 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "ebc4f0b9-33fc-4301-b1c0-ac843b19095b", 2024-09-21T22:01:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 13, 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 66, 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6808", 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6809", 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6810", 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6811", 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6814", 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6815", 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6812", 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6813", 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6809/3559797623", 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6811/3559797623", 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6815/3559797623", 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6813/3559797623", 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "1c8f54fe-439f-486e-8b8b-fe892332ada3", 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 0.1484527587890625, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6824", 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6825", 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6826", 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6827", 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6830", 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6831", 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6828", 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6829", 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6825/428384344", 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6827/428384344", 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6831/428384344", 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6829/428384344", 2024-09-21T22:01:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "b202159c-804c-4d22-9aa3-8f590dce8faa", 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6816", 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6817", 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6818", 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6819", 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6822", 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6823", 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.516 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6820", 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6821", 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6817/4237051748", 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6819/4237051748", 2024-09-21T22:01:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6823/4237051748", 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6821/4237051748", 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "28a8c407-a445-4c76-8d7c-d5a249d13e03", 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 66, 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6800", 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6801", 2024-09-21T22:01:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6802", 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6803", 2024-09-21T22:01:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6806", 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6807", 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:46.521 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6804", 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6805", 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6801/3004236595", 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6803/3004236595", 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6807/3004236595", 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6805/3004236595", 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605", 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:46.523 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 66, 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6824", 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:46.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6825", 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6826", 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.525 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6827", 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6830", 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.526 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6831", 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6828", 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6829", 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:46.527 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6825/743062291", 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6827/743062291", 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6831/743062291", 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6829/743062291", 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7a0cc26e-a543-4647-bc53-fbecb69b2326", 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:46.528 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6808", 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:46.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6809", 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6810", 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6811", 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6814", 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6815", 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6812", 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.532 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6813", 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6809/2410886219", 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6811/2410886219", 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6815/2410886219", 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6813/2410886219", 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7768eeb7-c6d0-47d8-a400-c47a2154c590", 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 0, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 0, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 48, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:46.534 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6800", 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6801", 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6802", 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6803", 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6806", 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6807", 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.537 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6804", 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6805", 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6801/2491178498", 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6803/2491178498", 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6807/2491178498", 2024-09-21T22:01:46.538 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6805/2491178498", 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "30ed992b-2e99-4523-9fdd-8389f75940af", 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:46.539 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 63, 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6816", 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6817", 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.540 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6818", 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6819", 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.541 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6822", 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6823", 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6820", 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6821", 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6817/1580142875", 2024-09-21T22:01:46.543 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6819/1580142875", 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6823/1580142875", 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6821/1580142875", 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:46.544 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.652871+0000", 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.866866+0000", 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.859757+0000", 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:46.546 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:34.082180+0000", 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.844484+0000", 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.547 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.746321+0000", 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:46.548 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 65536, 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.324821+0000", 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.093833+0000", 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.549 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [], 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [], 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [], 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.551 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:46.552 INFO:tasks.thrashosds.thrasher:j is {'epoch': 72, 'fsid': '014f3ec5-afd0-4b18-9c74-de91f34d0760', 'created': '2024-09-21T22:00:24.916784+0000', 'modified': '2024-09-21T22:01:45.936462+0000', 'last_up_change': '2024-09-21T22:00:36.060631+0000', 'last_in_change': '2024-09-21T22:01:35.858445+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:00:37.034134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:00:42.753049+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:00:52.269263+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 36, 'snap_epoch': 72, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}], 'osds': [{'osd': 0, 'uuid': 'ebc4f0b9-33fc-4301-b1c0-ac843b19095b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6808', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6809', 'nonce': 3559797623}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6810', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6811', 'nonce': 3559797623}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6814', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6815', 'nonce': 3559797623}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6812', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6813', 'nonce': 3559797623}]}, 'public_addr': '172.21.15.102:6809/3559797623', 'cluster_addr': '172.21.15.102:6811/3559797623', 'heartbeat_back_addr': '172.21.15.102:6815/3559797623', 'heartbeat_front_addr': '172.21.15.102:6813/3559797623', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1c8f54fe-439f-486e-8b8b-fe892332ada3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1484527587890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6824', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6825', 'nonce': 428384344}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6826', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6827', 'nonce': 428384344}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6830', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6831', 'nonce': 428384344}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6828', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6829', 'nonce': 428384344}]}, 'public_addr': '172.21.15.102:6825/428384344', 'cluster_addr': '172.21.15.102:6827/428384344', 'heartbeat_back_addr': '172.21.15.102:6831/428384344', 'heartbeat_front_addr': '172.21.15.102:6829/428384344', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'b202159c-804c-4d22-9aa3-8f590dce8faa', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6816', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6817', 'nonce': 4237051748}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6818', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6819', 'nonce': 4237051748}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6822', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6823', 'nonce': 4237051748}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6820', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6821', 'nonce': 4237051748}]}, 'public_addr': '172.21.15.102:6817/4237051748', 'cluster_addr': '172.21.15.102:6819/4237051748', 'heartbeat_back_addr': '172.21.15.102:6823/4237051748', 'heartbeat_front_addr': '172.21.15.102:6821/4237051748', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '28a8c407-a445-4c76-8d7c-d5a249d13e03', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 3004236595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 3004236595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 3004236595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 3004236595}]}, 'public_addr': '172.21.15.102:6801/3004236595', 'cluster_addr': '172.21.15.102:6803/3004236595', 'heartbeat_back_addr': '172.21.15.102:6807/3004236595', 'heartbeat_front_addr': '172.21.15.102:6805/3004236595', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6824', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6825', 'nonce': 743062291}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6826', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6827', 'nonce': 743062291}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6830', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6831', 'nonce': 743062291}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6828', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6829', 'nonce': 743062291}]}, 'public_addr': '172.21.15.184:6825/743062291', 'cluster_addr': '172.21.15.184:6827/743062291', 'heartbeat_back_addr': '172.21.15.184:6831/743062291', 'heartbeat_front_addr': '172.21.15.184:6829/743062291', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '7a0cc26e-a543-4647-bc53-fbecb69b2326', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6808', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6809', 'nonce': 2410886219}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6810', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6811', 'nonce': 2410886219}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6814', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6815', 'nonce': 2410886219}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6812', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6813', 'nonce': 2410886219}]}, 'public_addr': '172.21.15.184:6809/2410886219', 'cluster_addr': '172.21.15.184:6811/2410886219', 'heartbeat_back_addr': '172.21.15.184:6815/2410886219', 'heartbeat_front_addr': '172.21.15.184:6813/2410886219', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '7768eeb7-c6d0-47d8-a400-c47a2154c590', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6800', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6801', 'nonce': 2491178498}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6802', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6803', 'nonce': 2491178498}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6806', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6807', 'nonce': 2491178498}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6804', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6805', 'nonce': 2491178498}]}, 'public_addr': '172.21.15.184:6801/2491178498', 'cluster_addr': '172.21.15.184:6803/2491178498', 'heartbeat_back_addr': '172.21.15.184:6807/2491178498', 'heartbeat_front_addr': '172.21.15.184:6805/2491178498', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '30ed992b-2e99-4523-9fdd-8389f75940af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6816', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6817', 'nonce': 1580142875}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6818', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6819', 'nonce': 1580142875}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6822', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6823', 'nonce': 1580142875}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6820', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6821', 'nonce': 1580142875}]}, 'public_addr': '172.21.15.184:6817/1580142875', 'cluster_addr': '172.21.15.184:6819/1580142875', 'heartbeat_back_addr': '172.21.15.184:6823/1580142875', 'heartbeat_front_addr': '172.21.15.184:6821/1580142875', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.652871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.866866+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.859757+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:34.082180+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.844484+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.746321+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.324821+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.093833+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:01:46.552 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-21T22:01:46.552 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:46.480+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:46.582 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:46.581+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:46.655 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:46.655 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:46.655 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:46.655 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:46.663 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:46.706 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:46.704+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:46.765 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:46.765 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:46.765 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:46.765 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:46.765 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:46.773 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:46.814 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:46.812+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:46.884 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:46.882+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:46.917 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676378729, 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:01:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:46.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:01:46.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:01:46.921 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.67635671, 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.922 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:01:46.925 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676336128999999, 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.926 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:01:46.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:01:46.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.929 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676307530999999, 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:01:46.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676285126, 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.934 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:46.938 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676265110999999, 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:46.942 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676244908000001, 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676225648999999, 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:46.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:01:46.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.950 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676199581999999, 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:01:46.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:46.954 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676178930999999, 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:46.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.958 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676120751999999, 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.959 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676065973, 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:01:46.963 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:01:46.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:01:46.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:01:46.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:01:46.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:01:46.967 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676031516999998, 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.676010186999999, 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.972 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.976 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.675989026, 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:01:46.980 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.675958502, 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.982 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:01:46.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.982 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:46.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:46.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.675934142999999, 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.986 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:01:46.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:01:46.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:01:46.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:01:46.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:01:46.990 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.675912837999999, 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.991 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:46.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:46.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.675891448000002, 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:01:46.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:46.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.675870080999999, 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:01:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:01:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:47.005 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:47.007 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:01:47.008 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:47.004+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:47.029 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone34 from 0x712c31e (overlap 0x1219bd4) to 0x0 2024-09-21T22:01:47.107 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:47.105+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:47.140 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-21T22:01:47.145 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:47.145 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:47.145 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:47.145 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:47.161 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:47.185 INFO:teuthology.orchestra.run.smithi102.stdout:4452 read 0x6ce28e1 thru 0x6ce8342 (0x5a62 bytes) 2024-09-21T22:01:47.204 INFO:teuthology.orchestra.run.smithi102.stdout:4453 write 0xe59b867 thru 0xe5a259e (0x6d38 bytes) 2024-09-21T22:01:47.208 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:47.206+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:47.212 INFO:teuthology.orchestra.run.smithi102.stdout:4454 trunc from 0xe5a259f to 0xe33c67c 2024-09-21T22:01:47.218 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.218 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.238 INFO:teuthology.orchestra.run.smithi102.stdout:4457 trunc from 0xe33c67c to 0x27fd13 2024-09-21T22:01:47.289 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:47.302 INFO:teuthology.orchestra.run.smithi102.stdout:4458 read 0x1f7789 thru 0x20383c (0xc0b4 bytes) 2024-09-21T22:01:47.303 INFO:teuthology.orchestra.run.smithi102.stdout:4460 punch from 0x27fa9d to 0x27fd13, (0x276 bytes) 2024-09-21T22:01:47.303 INFO:teuthology.orchestra.run.smithi102.stdout:4463 punch from 0x1f331c to 0x1f6aca, (0x37ae bytes) 2024-09-21T22:01:47.308 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:47.306+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:47.315 INFO:teuthology.orchestra.run.smithi102.stdout:4464 write 0x46cd030 thru 0x46d8137 (0xb108 bytes) 2024-09-21T22:01:47.321 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.321 INFO:teuthology.orchestra.run.smithi102.stdout:4467 writesame 0x417734c thru 0x41866d8 data_size 0x7(0xf38d bytes) 2024-09-21T22:01:47.329 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:47.329 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:47.329 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:47.329 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:47.329 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:47.341 INFO:teuthology.orchestra.run.smithi102.stdout:4469 trunc from 0x46d8138 to 0xcd1260f 2024-09-21T22:01:47.343 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:47.347 INFO:teuthology.orchestra.run.smithi102.stdout:4470 trunc from 0xcd1260f to 0xc76fd16 2024-09-21T22:01:47.353 INFO:teuthology.orchestra.run.smithi102.stdout:4471 writesame 0x49c62f7 thru 0x49cef7b data_size 0x15(0x8c85 bytes) 2024-09-21T22:01:47.367 INFO:teuthology.orchestra.run.smithi102.stdout:4474 write 0xeba2532 thru 0xebabf42 (0x9a11 bytes) 2024-09-21T22:01:47.372 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.372 INFO:teuthology.orchestra.run.smithi102.stdout:4476 punch from 0x1cfbb2b to 0x1cfce80, (0x1355 bytes) 2024-09-21T22:01:47.373 INFO:teuthology.orchestra.run.smithi102.stdout:4477 write 0x7ea3baa thru 0x7eb3a2a (0xfe81 bytes) 2024-09-21T22:01:47.380 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.380 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.380 INFO:teuthology.orchestra.run.smithi102.stdout:4480 write 0xa5ff8cd thru 0xa609efb (0xa62f bytes) 2024-09-21T22:01:47.386 INFO:teuthology.orchestra.run.smithi102.stdout:4481 write 0xfb4132 thru 0xfb8ee6 (0x4db5 bytes) 2024-09-21T22:01:47.390 INFO:teuthology.orchestra.run.smithi102.stdout:4482 write 0x4f2290a thru 0x4f2926d (0x6964 bytes) 2024-09-21T22:01:47.395 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.395 INFO:teuthology.orchestra.run.smithi102.stdout:4484 read 0x4f5d202 thru 0x4f61a72 (0x4871 bytes) 2024-09-21T22:01:47.395 INFO:teuthology.orchestra.run.smithi102.stdout:4486 write 0x3191b86 thru 0x3198266 (0x66e1 bytes) 2024-09-21T22:01:47.402 INFO:teuthology.orchestra.run.smithi102.stdout:4489 writesame 0x984bb88 thru 0x985b7e5 data_size 0x1(0xfc5e bytes) 2024-09-21T22:01:47.409 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:47.407+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:47.426 INFO:teuthology.orchestra.run.smithi102.stdout:4491 read 0x6d256a7 thru 0x6d34b1e (0xf478 bytes) 2024-09-21T22:01:47.426 INFO:teuthology.orchestra.run.smithi102.stdout:4494 read 0x6441b7e thru 0x644421d (0x26a0 bytes) 2024-09-21T22:01:47.426 INFO:teuthology.orchestra.run.smithi102.stdout:4495 read 0xe33d88a thru 0xe34188a (0x4001 bytes) 2024-09-21T22:01:47.431 INFO:teuthology.orchestra.run.smithi102.stdout:4497 trunc from 0xebabf43 to 0xa8463ae 2024-09-21T22:01:47.440 INFO:teuthology.orchestra.run.smithi102.stdout:4498 write 0xb392aa thru 0xb4218d (0x8ee4 bytes) 2024-09-21T22:01:47.445 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:47.455 INFO:teuthology.orchestra.run.smithi102.stdout:4499 writesame 0xd635bda thru 0xd6389e8 data_size 0x1(0x2e0f bytes) 2024-09-21T22:01:47.455 INFO:teuthology.orchestra.run.smithi102.stdout:4500 writesame 0x782ede9 thru 0x783ae57 data_size 0x1(0xc06f bytes) 2024-09-21T22:01:47.470 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:47.470 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:47.474 INFO:teuthology.orchestra.run.smithi102.stdout:4501 read 0xc409995 thru 0xc418f1d (0xf589 bytes) 2024-09-21T22:01:47.474 INFO:teuthology.orchestra.run.smithi102.stdout:4502 read 0xa59e33 thru 0xa5a09a (0x268 bytes) 2024-09-21T22:01:47.480 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:47.480 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:47.486 INFO:teuthology.orchestra.run.smithi102.stdout:4504 trunc from 0xd6389e9 to 0x3f06f4e 2024-09-21T22:01:47.488 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:47.488 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:47.495 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:47.509 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:47.507+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:47.511 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:47.511 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:47.521 INFO:teuthology.orchestra.run.smithi102.stdout:4506 writesame 0x43733b2 thru 0x437e3b1 data_size 0x80(0xb000 bytes) 2024-09-21T22:01:47.521 INFO:teuthology.orchestra.run.smithi102.stdout:4507 read 0x167a342 thru 0x1687b20 (0xd7df bytes) 2024-09-21T22:01:47.521 INFO:teuthology.orchestra.run.smithi102.stdout:4510 read 0x2cbaa3b thru 0x2cbcb61 (0x2127 bytes) 2024-09-21T22:01:47.530 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:47.532 INFO:teuthology.orchestra.run.smithi102.stdout:4512 trunc from 0x437e3b2 to 0xd8668a9 2024-09-21T22:01:47.538 INFO:teuthology.orchestra.run.smithi102.stdout:4515 read 0xa492c1d thru 0xa49bca6 (0x908a bytes) 2024-09-21T22:01:47.538 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.538 INFO:teuthology.orchestra.run.smithi102.stdout:4517 write 0x1985419 thru 0x198d86b (0x8453 bytes) 2024-09-21T22:01:47.546 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.546 INFO:teuthology.orchestra.run.smithi102.stdout:4519 read 0xe4bb97 thru 0xe590fd (0xd567 bytes) 2024-09-21T22:01:47.546 INFO:teuthology.orchestra.run.smithi102.stdout:4520 punch from 0x1a8a550 to 0x1a8f68a, (0x513a bytes) 2024-09-21T22:01:47.546 INFO:teuthology.orchestra.run.smithi102.stdout:4521 write 0x1043c82 thru 0x1045149 (0x14c8 bytes) 2024-09-21T22:01:47.549 INFO:teuthology.orchestra.run.smithi102.stdout:4523 writesame 0x2648cd0 thru 0x2653127 data_size 0xc(0xa458 bytes) 2024-09-21T22:01:47.551 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:47.554 INFO:teuthology.orchestra.run.smithi102.stdout:4524 punch from 0xc773814 to 0xc77c485, (0x8c71 bytes) 2024-09-21T22:01:47.555 INFO:teuthology.orchestra.run.smithi102.stdout:4525 writesame 0x8c5f929 thru 0x8c6e84b data_size 0x1(0xef23 bytes) 2024-09-21T22:01:47.571 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:47.577 INFO:teuthology.orchestra.run.smithi102.stdout:4526 write 0x63eff22 thru 0x63f7763 (0x7842 bytes) 2024-09-21T22:01:47.582 INFO:teuthology.orchestra.run.smithi102.stdout:4528 punch from 0x30858d1 to 0x3089475, (0x3ba4 bytes) 2024-09-21T22:01:47.582 INFO:teuthology.orchestra.run.smithi102.stdout:4529 read 0x2a377e1 thru 0x2a3b6e1 (0x3f01 bytes) 2024-09-21T22:01:47.586 INFO:teuthology.orchestra.run.smithi102.stdout:4532 trunc from 0xd8668a9 to 0xa6e6115 2024-09-21T22:01:47.591 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:47.591 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:47.596 INFO:teuthology.orchestra.run.smithi102.stdout:4533 trunc from 0xa6e6115 to 0xd25d208 2024-09-21T22:01:47.609 INFO:teuthology.orchestra.run.smithi102.stdout:4534 writesame 0xe89edfc thru 0xe8aa1f1 data_size 0x55(0xb3f6 bytes) 2024-09-21T22:01:47.609 INFO:teuthology.orchestra.run.smithi102.stdout:4536 punch from 0xbfb9c31 to 0xbfc2f9e, (0x936d bytes) 2024-09-21T22:01:47.609 INFO:teuthology.orchestra.run.smithi102.stdout:4537 write 0x412445f thru 0x41319b7 (0xd559 bytes) 2024-09-21T22:01:47.610 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:47.608+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:47.615 INFO:teuthology.orchestra.run.smithi102.stdout:4538 read 0x4c14865 thru 0x4c1b1d0 (0x696c bytes) 2024-09-21T22:01:47.615 INFO:teuthology.orchestra.run.smithi102.stdout:4540 writesame 0xd99d387 thru 0xd9a941f data_size 0x5f(0xc099 bytes) 2024-09-21T22:01:47.625 INFO:teuthology.orchestra.run.smithi102.stdout:4541 writesame 0xee5b0b1 thru 0xee5fd05 data_size 0x1(0x4c55 bytes) 2024-09-21T22:01:47.625 INFO:teuthology.orchestra.run.smithi102.stdout:4543 read 0xda889a5 thru 0xda8cb71 (0x41cd bytes) 2024-09-21T22:01:47.626 INFO:teuthology.orchestra.run.smithi102.stdout:4546 writesame 0x1639179 thru 0x1639cab data_size 0x1(0xb33 bytes) 2024-09-21T22:01:47.629 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.629 INFO:teuthology.orchestra.run.smithi102.stdout:4549 write 0x4e216b2 thru 0x4e25fb1 (0x4900 bytes) 2024-09-21T22:01:47.634 INFO:teuthology.orchestra.run.smithi102.stdout:4550 writesame 0x99e242b thru 0x99ec6f0 data_size 0x2d(0xa2c6 bytes) 2024-09-21T22:01:47.638 INFO:teuthology.orchestra.run.smithi102.stdout:4551 punch from 0x13a58fc to 0x13aca6c, (0x7170 bytes) 2024-09-21T22:01:47.638 INFO:teuthology.orchestra.run.smithi102.stdout:4552 write 0xd290634 thru 0xd29c710 (0xc0dd bytes) 2024-09-21T22:01:47.639 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:47.639 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:47.645 INFO:teuthology.orchestra.run.smithi102.stdout:4553 punch from 0x9865eb1 to 0x986f593, (0x96e2 bytes) 2024-09-21T22:01:47.645 INFO:teuthology.orchestra.run.smithi102.stdout:4554 read 0xc7a6b2c thru 0xc7b28fc (0xbdd1 bytes) 2024-09-21T22:01:47.645 INFO:teuthology.orchestra.run.smithi102.stdout:4555 write 0x9a05817 thru 0x9a08617 (0x2e01 bytes) 2024-09-21T22:01:47.649 INFO:teuthology.orchestra.run.smithi102.stdout:4556 write 0x89ba835 thru 0x89c35c1 (0x8d8d bytes) 2024-09-21T22:01:47.650 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:47.659 INFO:teuthology.orchestra.run.smithi102.stdout:4557 punch from 0xa87579e to 0xa8822d1, (0xcb33 bytes) 2024-09-21T22:01:47.660 INFO:teuthology.orchestra.run.smithi102.stdout:4559 writesame 0x69541c7 thru 0x6961f2e data_size 0x6d(0xdd68 bytes) 2024-09-21T22:01:47.669 INFO:teuthology.orchestra.run.smithi102.stdout:4560 read 0x9a80913 thru 0x9a8c339 (0xba27 bytes) 2024-09-21T22:01:47.669 INFO:teuthology.orchestra.run.smithi102.stdout:4561 punch from 0x20ca86a to 0x20d99a3, (0xf139 bytes) 2024-09-21T22:01:47.669 INFO:teuthology.orchestra.run.smithi102.stdout:4562 punch from 0x79f52d to 0x7a5555, (0x6028 bytes) 2024-09-21T22:01:47.681 INFO:teuthology.orchestra.run.smithi102.stdout:4563 trunc from 0xee5fd06 to 0x48acfdd 2024-09-21T22:01:47.698 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.698 INFO:teuthology.orchestra.run.smithi102.stdout:4566 writesame 0xca71f0 thru 0xcb0077 data_size 0x4(0x8e88 bytes) 2024-09-21T22:01:47.705 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.709 INFO:teuthology.orchestra.run.smithi102.stdout:4569 trunc from 0x48acfdd to 0x8024f6f 2024-09-21T22:01:47.711 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:47.709+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:47.715 INFO:teuthology.orchestra.run.smithi102.stdout:4571 read 0x3f23039 thru 0x3f29fe8 (0x6fb0 bytes) 2024-09-21T22:01:47.715 INFO:teuthology.orchestra.run.smithi102.stdout:4572 read 0x3b88c42 thru 0x3b89064 (0x423 bytes) 2024-09-21T22:01:47.715 INFO:teuthology.orchestra.run.smithi102.stdout:4573 read 0x9f21da thru 0xa0212e (0xff55 bytes) 2024-09-21T22:01:47.716 INFO:teuthology.orchestra.run.smithi102.stdout:4574 writesame 0x49fc38c thru 0x4a00bb0 data_size 0x17(0x4825 bytes) 2024-09-21T22:01:47.721 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.721 INFO:teuthology.orchestra.run.smithi102.stdout:4576 punch from 0x5dbf1f1 to 0x5dc6342, (0x7151 bytes) 2024-09-21T22:01:47.721 INFO:teuthology.orchestra.run.smithi102.stdout:4577 punch from 0x79305b3 to 0x7930735, (0x182 bytes) 2024-09-21T22:01:47.721 INFO:teuthology.orchestra.run.smithi102.stdout:4578 read 0x7760dae thru 0x776ab23 (0x9d76 bytes) 2024-09-21T22:01:47.721 INFO:teuthology.orchestra.run.smithi102.stdout:4579 read 0x56b543c thru 0x56b7902 (0x24c7 bytes) 2024-09-21T22:01:47.722 INFO:teuthology.orchestra.run.smithi102.stdout:4582 read 0x77acd7e thru 0x77ad87b (0xafe bytes) 2024-09-21T22:01:47.722 INFO:teuthology.orchestra.run.smithi102.stdout:4584 writesame 0x5348e63 thru 0x5351051 data_size 0x1f(0x81ef bytes) 2024-09-21T22:01:47.727 INFO:teuthology.orchestra.run.smithi102.stdout:4587 punch from 0x7d84dce to 0x7d8860e, (0x3840 bytes) 2024-09-21T22:01:47.727 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.727 INFO:teuthology.orchestra.run.smithi102.stdout:4590 read 0x172dac5 thru 0x173a4b2 (0xc9ee bytes) 2024-09-21T22:01:47.734 INFO:teuthology.orchestra.run.smithi102.stdout:4591 write 0x9eec299 thru 0x9ef666a (0xa3d2 bytes) 2024-09-21T22:01:47.739 INFO:teuthology.orchestra.run.smithi102.stdout:4592 writesame 0x5b34d9a thru 0x5b3ac7f data_size 0x3(0x5ee6 bytes) 2024-09-21T22:01:47.745 INFO:teuthology.orchestra.run.smithi102.stdout:4595 write 0x3f860f3 thru 0x3f93099 (0xcfa7 bytes) 2024-09-21T22:01:47.760 INFO:teuthology.orchestra.run.smithi102.stdout:4596 writesame 0xc78e9a4 thru 0xc791b1a data_size 0x3(0x3177 bytes) 2024-09-21T22:01:47.760 INFO:teuthology.orchestra.run.smithi102.stdout:4598 punch from 0x2630358 to 0x263cf52, (0xcbfa bytes) 2024-09-21T22:01:47.760 INFO:teuthology.orchestra.run.smithi102.stdout:4600 read 0x4c2a64f thru 0x4c39a83 (0xf435 bytes) 2024-09-21T22:01:47.760 INFO:teuthology.orchestra.run.smithi102.stdout:4603 read 0x5467cb7 thru 0x54710eb (0x9435 bytes) 2024-09-21T22:01:47.761 INFO:teuthology.orchestra.run.smithi102.stdout:4604 writesame 0x55e5419 thru 0x55f53f4 data_size 0x32(0xffdc bytes) 2024-09-21T22:01:47.768 INFO:teuthology.orchestra.run.smithi102.stdout:4606 read 0xc46c125 thru 0xc46f89c (0x3778 bytes) 2024-09-21T22:01:47.768 INFO:teuthology.orchestra.run.smithi102.stdout:4607 read 0x56847b6 thru 0x5692929 (0xe174 bytes) 2024-09-21T22:01:47.768 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.768 INFO:teuthology.orchestra.run.smithi102.stdout:4609 trunc from 0xc791b1b to 0xcc7c6bd 2024-09-21T22:01:47.785 INFO:teuthology.orchestra.run.smithi102.stdout:4610 trunc from 0xcc7c6bd to 0x2bd7d27 2024-09-21T22:01:47.787 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:47.787 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:47.798 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:47.812 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:47.811+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:47.817 INFO:teuthology.orchestra.run.smithi102.stdout:4611 write 0x319ddba thru 0x31ac14d (0xe394 bytes) 2024-09-21T22:01:47.844 INFO:teuthology.orchestra.run.smithi102.stdout:4615 write 0xbc7982d thru 0xbc7c4f4 (0x2cc8 bytes) 2024-09-21T22:01:47.853 INFO:teuthology.orchestra.run.smithi102.stdout:4616 read 0x3da2f53 thru 0x3da4f26 (0x1fd4 bytes) 2024-09-21T22:01:47.855 INFO:teuthology.orchestra.run.smithi102.stdout:4617 trunc from 0xbc7c4f5 to 0xa07f2f1 2024-09-21T22:01:47.867 INFO:teuthology.orchestra.run.smithi102.stdout:4618 trunc from 0xa07f2f1 to 0xb95cee4 2024-09-21T22:01:47.872 INFO:teuthology.orchestra.run.smithi102.stdout:4620 write 0x94c13b0 thru 0x94c5927 (0x4578 bytes) 2024-09-21T22:01:47.875 INFO:teuthology.orchestra.run.smithi102.stdout:4621 read 0x26523b2 thru 0x265309e (0xced bytes) 2024-09-21T22:01:47.876 INFO:teuthology.orchestra.run.smithi102.stdout:4622 write 0x7ed20ee thru 0x7ee1345 (0xf258 bytes) 2024-09-21T22:01:47.884 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.884 INFO:teuthology.orchestra.run.smithi102.stdout:4624 punch from 0x836092a to 0x8363cef, (0x33c5 bytes) 2024-09-21T22:01:47.885 INFO:teuthology.orchestra.run.smithi102.stdout:4625 write 0x97aabf7 thru 0x97b6b37 (0xbf41 bytes) 2024-09-21T22:01:47.894 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.894 INFO:teuthology.orchestra.run.smithi102.stdout:4627 read 0x8e8e61a thru 0x8e9de6a (0xf851 bytes) 2024-09-21T22:01:47.894 INFO:teuthology.orchestra.run.smithi102.stdout:4628 write 0x8cc215c thru 0x8cce818 (0xc6bd bytes) 2024-09-21T22:01:47.908 INFO:teuthology.orchestra.run.smithi102.stdout:4630 write 0xc3ec312 thru 0xc3fb85c (0xf54b bytes) 2024-09-21T22:01:47.913 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:47.912+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:47.918 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.918 INFO:teuthology.orchestra.run.smithi102.stdout:4632 read 0x131a6be thru 0x1329ebf (0xf802 bytes) 2024-09-21T22:01:47.918 INFO:teuthology.orchestra.run.smithi102.stdout:4633 read 0x3ce70f thru 0x3daa73 (0xc365 bytes) 2024-09-21T22:01:47.919 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.919 INFO:teuthology.orchestra.run.smithi102.stdout:4635 read 0x4818d87 thru 0x4821147 (0x83c1 bytes) 2024-09-21T22:01:47.919 INFO:teuthology.orchestra.run.smithi102.stdout:4638 punch from 0x77bbd9 to 0x78a84a, (0xec71 bytes) 2024-09-21T22:01:47.919 INFO:teuthology.orchestra.run.smithi102.stdout:4639 punch from 0x801886a to 0x8027008, (0xe79e bytes) 2024-09-21T22:01:47.921 INFO:teuthology.orchestra.run.smithi102.stdout:4641 trunc from 0xc3fb85d to 0xa57e0b1 2024-09-21T22:01:47.938 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:47.938 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:47.939 INFO:teuthology.orchestra.run.smithi102.stdout:4643 write 0xd1897a0 thru 0xd198ff4 (0xf855 bytes) 2024-09-21T22:01:47.949 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:47.950 INFO:teuthology.orchestra.run.smithi102.stdout:4644 write 0x655ae92 thru 0x6560615 (0x5784 bytes) 2024-09-21T22:01:47.961 INFO:teuthology.orchestra.run.smithi102.stdout:4645 read 0x61ae379 thru 0x61b4b38 (0x67c0 bytes) 2024-09-21T22:01:47.961 INFO:teuthology.orchestra.run.smithi102.stdout:4646 write 0x2db059d thru 0x2db968a (0x90ee bytes) 2024-09-21T22:01:47.968 INFO:teuthology.orchestra.run.smithi102.stdout:4647 write 0x27e9370 thru 0x27ec111 (0x2da2 bytes) 2024-09-21T22:01:47.972 INFO:teuthology.orchestra.run.smithi102.stdout:4648 read 0x8d47c4 thru 0x8e221f (0xda5c bytes) 2024-09-21T22:01:47.972 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:47.988 INFO:teuthology.orchestra.run.smithi102.stdout:4652 trunc from 0xd198ff5 to 0x2caf66 2024-09-21T22:01:48.014 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:48.012+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:48.043 INFO:teuthology.orchestra.run.smithi102.stdout:4653 write 0xb8fd9f7 thru 0xb9077d4 (0x9dde bytes) 2024-09-21T22:01:48.048 INFO:teuthology.orchestra.run.smithi102.stdout:4654 read 0x355fad6 thru 0x356a4d0 (0xa9fb bytes) 2024-09-21T22:01:48.048 INFO:teuthology.orchestra.run.smithi102.stdout:4655 write 0x5113df0 thru 0x511689e (0x2aaf bytes) 2024-09-21T22:01:48.054 INFO:teuthology.orchestra.run.smithi102.stdout:4656 trunc from 0xb9077d5 to 0xd9c549c 2024-09-21T22:01:48.059 INFO:teuthology.orchestra.run.smithi102.stdout:4657 punch from 0xd93d897 to 0xd93f1e3, (0x194c bytes) 2024-09-21T22:01:48.059 INFO:teuthology.orchestra.run.smithi102.stdout:4658 write 0xdc5e54 thru 0xdc78c4 (0x1a71 bytes) 2024-09-21T22:01:48.072 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:48.073 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:48.074 INFO:teuthology.orchestra.run.smithi102.stdout:4660 trunc from 0xd9c549c to 0x396cab8 2024-09-21T22:01:48.083 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:48.086 INFO:teuthology.orchestra.run.smithi102.stdout:4661 read 0x1c3a757 thru 0x1c3c4b1 (0x1d5b bytes) 2024-09-21T22:01:48.086 INFO:teuthology.orchestra.run.smithi102.stdout:4662 read 0x2cb641d thru 0x2cbf709 (0x92ed bytes) 2024-09-21T22:01:48.086 INFO:teuthology.orchestra.run.smithi102.stdout:4663 read 0xe5ca06 thru 0xe6225d (0x5858 bytes) 2024-09-21T22:01:48.086 INFO:teuthology.orchestra.run.smithi102.stdout:4664 punch from 0x2d4a490 to 0x2d4d809, (0x3379 bytes) 2024-09-21T22:01:48.099 INFO:teuthology.orchestra.run.smithi102.stdout:4665 write 0xb2315ac thru 0xb23ce64 (0xb8b9 bytes) 2024-09-21T22:01:48.107 INFO:teuthology.orchestra.run.smithi102.stdout:4666 write 0x7c0215a thru 0x7c065d6 (0x447d bytes) 2024-09-21T22:01:48.111 INFO:teuthology.orchestra.run.smithi102.stdout:4667 read 0xbfe816 thru 0xbfea45 (0x230 bytes) 2024-09-21T22:01:48.115 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:48.113+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:48.120 INFO:teuthology.orchestra.run.smithi102.stdout:4669 write 0xe091a1a thru 0xe099cc0 (0x82a7 bytes) 2024-09-21T22:01:48.124 INFO:teuthology.orchestra.run.smithi102.stdout:4671 punch from 0x96f2803 to 0x96ff72c, (0xcf29 bytes) 2024-09-21T22:01:48.124 INFO:teuthology.orchestra.run.smithi102.stdout:4673 read 0x3a86028 thru 0x3a888fc (0x28d5 bytes) 2024-09-21T22:01:48.124 INFO:teuthology.orchestra.run.smithi102.stdout:4674 punch from 0x59c755c to 0x59d3517, (0xbfbb bytes) 2024-09-21T22:01:48.125 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.125 INFO:teuthology.orchestra.run.smithi102.stdout:4677 punch from 0x33c0328 to 0x33c59aa, (0x5682 bytes) 2024-09-21T22:01:48.125 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.125 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.125 INFO:teuthology.orchestra.run.smithi102.stdout:4680 read 0x465111 thru 0x46c139 (0x7029 bytes) 2024-09-21T22:01:48.125 INFO:teuthology.orchestra.run.smithi102.stdout:4682 read 0xcaa013 thru 0xcb29b3 (0x89a1 bytes) 2024-09-21T22:01:48.125 INFO:teuthology.orchestra.run.smithi102.stdout:4683 write 0x6e427af thru 0x6e4fe40 (0xd692 bytes) 2024-09-21T22:01:48.134 INFO:teuthology.orchestra.run.smithi102.stdout:4684 writesame 0xaedf556 thru 0xaee2aaa data_size 0x1(0x3555 bytes) 2024-09-21T22:01:48.153 INFO:teuthology.orchestra.run.smithi102.stdout:4686 trunc from 0xe099cc1 to 0x5400109 2024-09-21T22:01:48.173 INFO:teuthology.orchestra.run.smithi102.stdout:4687 trunc from 0x5400109 to 0xab2cb0c 2024-09-21T22:01:48.178 INFO:teuthology.orchestra.run.smithi102.stdout:4688 write 0x23931e3 thru 0x23a0419 (0xd237 bytes) 2024-09-21T22:01:48.189 INFO:teuthology.orchestra.run.smithi102.stdout:4689 read 0x628959c thru 0x628cfb8 (0x3a1d bytes) 2024-09-21T22:01:48.189 INFO:teuthology.orchestra.run.smithi102.stdout:4690 punch from 0x87c0b04 to 0x87cc367, (0xb863 bytes) 2024-09-21T22:01:48.189 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.189 INFO:teuthology.orchestra.run.smithi102.stdout:4692 write 0x18e813f thru 0x18eaa1b (0x28dd bytes) 2024-09-21T22:01:48.192 INFO:teuthology.orchestra.run.smithi102.stdout:4693 punch from 0x125217b to 0x1259dbf, (0x7c44 bytes) 2024-09-21T22:01:48.192 INFO:teuthology.orchestra.run.smithi102.stdout:4694 read 0x796e6e5 thru 0x7977930 (0x924c bytes) 2024-09-21T22:01:48.192 INFO:teuthology.orchestra.run.smithi102.stdout:4695 write 0x9d8c030 thru 0x9d9716f (0xb140 bytes) 2024-09-21T22:01:48.202 INFO:teuthology.orchestra.run.smithi102.stdout:4696 read 0x445f494 thru 0x446bf7b (0xcae8 bytes) 2024-09-21T22:01:48.209 INFO:teuthology.orchestra.run.smithi102.stdout:4697 write 0xbedeb80 thru 0xbee4d4e (0x61cf bytes) 2024-09-21T22:01:48.210 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:48.210 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:48.216 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:48.214+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:48.219 INFO:teuthology.orchestra.run.smithi102.stdout:4699 writesame 0xacf2f18 thru 0xacfd804 data_size 0x2d(0xa8ed bytes) 2024-09-21T22:01:48.220 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:48.229 INFO:teuthology.orchestra.run.smithi102.stdout:4700 trunc from 0xbee4d4f to 0xead86b0 2024-09-21T22:01:48.235 INFO:teuthology.orchestra.run.smithi102.stdout:4701 write 0x31aa8e6 thru 0x31b681f (0xbf3a bytes) 2024-09-21T22:01:48.244 INFO:teuthology.orchestra.run.smithi102.stdout:4704 read 0x10b7c5a thru 0x10c0eaa (0x9251 bytes) 2024-09-21T22:01:48.245 INFO:teuthology.orchestra.run.smithi102.stdout:4706 flatten 2024-09-21T22:01:48.265 INFO:teuthology.orchestra.run.smithi102.stdout:4707 trunc from 0xead86b0 to 0x2828b6c 2024-09-21T22:01:48.279 INFO:teuthology.orchestra.run.smithi102.stdout:4708 write 0x13b3be4 thru 0x13bb263 (0x7680 bytes) 2024-09-21T22:01:48.287 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.287 INFO:teuthology.orchestra.run.smithi102.stdout:4711 punch from 0x1b30164 to 0x1b3ecb9, (0xeb55 bytes) 2024-09-21T22:01:48.295 INFO:teuthology.orchestra.run.smithi102.stdout:4712 trunc from 0x2828b6c to 0x9505d5d 2024-09-21T22:01:48.301 INFO:teuthology.orchestra.run.smithi102.stdout:4713 read 0x6174124 thru 0x617f1a0 (0xb07d bytes) 2024-09-21T22:01:48.304 INFO:teuthology.orchestra.run.smithi102.stdout:4714 trunc from 0x9505d5d to 0xc4cf5f1 2024-09-21T22:01:48.316 INFO:teuthology.orchestra.run.smithi102.stdout:4715 trunc from 0xc4cf5f1 to 0x709a600 2024-09-21T22:01:48.317 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:48.315+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:48.321 INFO:teuthology.orchestra.run.smithi102.stdout:4716 punch from 0x58e15d2 to 0x58e4dae, (0x37dc bytes) 2024-09-21T22:01:48.335 INFO:teuthology.orchestra.run.smithi102.stdout:4719 write 0xde0fcfd thru 0xde17fba (0x82be bytes) 2024-09-21T22:01:48.341 INFO:teuthology.orchestra.run.smithi102.stdout:4720 punch from 0x729ffa0 to 0x72ab26a, (0xb2ca bytes) 2024-09-21T22:01:48.341 INFO:teuthology.orchestra.run.smithi102.stdout:4722 write 0x1373723 thru 0x137c092 (0x8970 bytes) 2024-09-21T22:01:48.345 INFO:teuthology.orchestra.run.smithi102.stdout:4723 write 0x41457c3 thru 0x414ddfd (0x863b bytes) 2024-09-21T22:01:48.350 INFO:teuthology.orchestra.run.smithi102.stdout:4724 read 0xac303a0 thru 0xac3b2fa (0xaf5b bytes) 2024-09-21T22:01:48.350 INFO:teuthology.orchestra.run.smithi102.stdout:4726 writesame 0x9a1b476 thru 0x9a1c3b6 data_size 0xb(0xf41 bytes) 2024-09-21T22:01:48.353 INFO:teuthology.orchestra.run.smithi102.stdout:4727 trunc from 0xde17fbb to 0xde7b934 2024-09-21T22:01:48.355 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:48.355 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:48.358 INFO:teuthology.orchestra.run.smithi102.stdout:4729 write 0x7cfdc3a thru 0x7d02923 (0x4cea bytes) 2024-09-21T22:01:48.362 INFO:teuthology.orchestra.run.smithi102.stdout:4730 write 0xad0390e thru 0xad1360e (0xfd01 bytes) 2024-09-21T22:01:48.365 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:48.369 INFO:teuthology.orchestra.run.smithi102.stdout:4731 write 0xd5f4f81 thru 0xd5f946f (0x44ef bytes) 2024-09-21T22:01:48.373 INFO:teuthology.orchestra.run.smithi102.stdout:4735 write 0x59f317c thru 0x59f978d (0x6612 bytes) 2024-09-21T22:01:48.378 INFO:teuthology.orchestra.run.smithi102.stdout:4737 write 0x75db55f thru 0x75df057 (0x3af9 bytes) 2024-09-21T22:01:48.394 INFO:teuthology.orchestra.run.smithi102.stdout:4738 trunc from 0xde7b934 to 0x36d3e9b 2024-09-21T22:01:48.417 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:48.415+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:48.418 INFO:teuthology.orchestra.run.smithi102.stdout:4739 write 0x4c51541 thru 0x4c5672b (0x51eb bytes) 2024-09-21T22:01:48.421 INFO:teuthology.orchestra.run.smithi102.stdout:4740 read 0x11b4d59 thru 0x11bb2b0 (0x6558 bytes) 2024-09-21T22:01:48.426 INFO:teuthology.orchestra.run.smithi102.stdout:4741 writesame 0x4f4cc06 thru 0x4f59e58 data_size 0x1(0xd253 bytes) 2024-09-21T22:01:48.437 INFO:teuthology.orchestra.run.smithi102.stdout:4743 writesame 0x93b3a38 thru 0x93bc2a6 data_size 0x1(0x886f bytes) 2024-09-21T22:01:48.437 INFO:teuthology.orchestra.run.smithi102.stdout:4745 read 0x56cd5f9 thru 0x56d57d8 (0x81e0 bytes) 2024-09-21T22:01:48.437 INFO:teuthology.orchestra.run.smithi102.stdout:4746 writesame 0x18dabb8 thru 0x18e66ac data_size 0x13(0xbaf5 bytes) 2024-09-21T22:01:48.450 INFO:teuthology.orchestra.run.smithi102.stdout:4747 write 0x9854dce thru 0x985e6cb (0x98fe bytes) 2024-09-21T22:01:48.459 INFO:teuthology.orchestra.run.smithi102.stdout:4750 read 0x94c237c thru 0x94ca24a (0x7ecf bytes) 2024-09-21T22:01:48.468 INFO:teuthology.orchestra.run.smithi102.stdout:4751 write 0xc8d8057 thru 0xc8db803 (0x37ad bytes) 2024-09-21T22:01:48.470 INFO:teuthology.orchestra.run.smithi102.stdout:4753 writesame 0xc5eac9f thru 0xc5ec3c7 data_size 0xb(0x1729 bytes) 2024-09-21T22:01:48.474 INFO:teuthology.orchestra.run.smithi102.stdout:4754 punch from 0x625f0d4 to 0x626b60f, (0xc53b bytes) 2024-09-21T22:01:48.474 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.474 INFO:teuthology.orchestra.run.smithi102.stdout:4756 write 0x47d3ba9 thru 0x47dd584 (0x99dc bytes) 2024-09-21T22:01:48.476 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:48.476 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:48.485 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:48.490 INFO:teuthology.orchestra.run.smithi102.stdout:4757 punch from 0x95d90e5 to 0x95daf53, (0x1e6e bytes) 2024-09-21T22:01:48.490 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.496 INFO:teuthology.orchestra.run.smithi102.stdout:4760 write 0xd47c2b7 thru 0xd488ea1 (0xcbeb bytes) 2024-09-21T22:01:48.506 INFO:teuthology.orchestra.run.smithi102.stdout:4761 write 0x11d4c34 thru 0x11d8b5b (0x3f28 bytes) 2024-09-21T22:01:48.512 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.512 INFO:teuthology.orchestra.run.smithi102.stdout:4764 read 0x743f9bc thru 0x7446eaa (0x74ef bytes) 2024-09-21T22:01:48.512 INFO:teuthology.orchestra.run.smithi102.stdout:4766 writesame 0x5ab2198 thru 0x5abb1cb data_size 0x16(0x9034 bytes) 2024-09-21T22:01:48.521 INFO:teuthology.orchestra.run.smithi102.stdout:4767 writesame 0x2f7c6c thru 0x2f8b88 data_size 0x1(0xf1d bytes) 2024-09-21T22:01:48.525 INFO:teuthology.orchestra.run.smithi102.stdout:4770 read 0x3cfec40 thru 0x3d07f74 (0x9335 bytes) 2024-09-21T22:01:48.525 INFO:teuthology.orchestra.run.smithi102.stdout:4771 read 0x3aa44ba thru 0x3aa4548 (0x8f bytes) 2024-09-21T22:01:48.529 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:48.527+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:48.532 INFO:teuthology.orchestra.run.smithi102.stdout:4772 trunc from 0xd488ea2 to 0x78ace13 2024-09-21T22:01:48.545 INFO:teuthology.orchestra.run.smithi102.stdout:4774 read 0x53351ce thru 0x53388a5 (0x36d8 bytes) 2024-09-21T22:01:48.545 INFO:teuthology.orchestra.run.smithi102.stdout:4777 read 0x3d0b301 thru 0x3d0cd70 (0x1a70 bytes) 2024-09-21T22:01:48.554 INFO:teuthology.orchestra.run.smithi102.stdout:4778 writesame 0x9e6af67 thru 0x9e717a2 data_size 0xe(0x683c bytes) 2024-09-21T22:01:48.554 INFO:teuthology.orchestra.run.smithi102.stdout:4779 punch from 0x80f2997 to 0x80fe0f4, (0xb75d bytes) 2024-09-21T22:01:48.554 INFO:teuthology.orchestra.run.smithi102.stdout:4780 read 0x327afb0 thru 0x327daa7 (0x2af8 bytes) 2024-09-21T22:01:48.554 INFO:teuthology.orchestra.run.smithi102.stdout:4782 punch from 0x9448931 to 0x94502ff, (0x79ce bytes) 2024-09-21T22:01:48.554 INFO:teuthology.orchestra.run.smithi102.stdout:4784 write 0x4b11f8f thru 0x4b17650 (0x56c2 bytes) 2024-09-21T22:01:48.561 INFO:teuthology.orchestra.run.smithi102.stdout:4785 writesame 0x9852d7d thru 0x985abee data_size 0x3(0x7e72 bytes) 2024-09-21T22:01:48.578 INFO:teuthology.orchestra.run.smithi102.stdout:4786 write 0xd97cb67 thru 0xd98459a (0x7a34 bytes) 2024-09-21T22:01:48.586 INFO:teuthology.orchestra.run.smithi102.stdout:4790 write 0xc6fa485 thru 0xc6fbbf6 (0x1772 bytes) 2024-09-21T22:01:48.590 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.591 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.591 INFO:teuthology.orchestra.run.smithi102.stdout:4795 writesame 0xd5fa611 thru 0xd6011d4 data_size 0x79(0x6bc4 bytes) 2024-09-21T22:01:48.592 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:48.592 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:48.599 INFO:teuthology.orchestra.run.smithi102.stdout:4796 punch from 0xac50a3e to 0xac55946, (0x4f08 bytes) 2024-09-21T22:01:48.599 INFO:teuthology.orchestra.run.smithi102.stdout:4799 writesame 0x94a41b5 thru 0x94ae306 data_size 0x3(0xa152 bytes) 2024-09-21T22:01:48.602 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:48.606 INFO:teuthology.orchestra.run.smithi102.stdout:4800 writesame 0x1ddab94 thru 0x1dde75f data_size 0x4(0x3bcc bytes) 2024-09-21T22:01:48.610 INFO:teuthology.orchestra.run.smithi102.stdout:4802 read 0x19c6b77 thru 0x19d02cc (0x9756 bytes) 2024-09-21T22:01:48.611 INFO:teuthology.orchestra.run.smithi102.stdout:4803 write 0x6bf6b18 thru 0x6bf8d10 (0x21f9 bytes) 2024-09-21T22:01:48.615 INFO:teuthology.orchestra.run.smithi102.stdout:4806 writesame 0xb9df537 thru 0xb9e2730 data_size 0x1(0x31fa bytes) 2024-09-21T22:01:48.619 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:48.617+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:48.623 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.623 INFO:teuthology.orchestra.run.smithi102.stdout:4808 write 0x321d557 thru 0x32236e0 (0x618a bytes) 2024-09-21T22:01:48.627 INFO:teuthology.orchestra.run.smithi102.stdout:4809 write 0x65d4fad thru 0x65d87a1 (0x37f5 bytes) 2024-09-21T22:01:48.630 INFO:teuthology.orchestra.run.smithi102.stdout:4812 write 0x1f432de thru 0x1f5097d (0xd6a0 bytes) 2024-09-21T22:01:48.639 INFO:teuthology.orchestra.run.smithi102.stdout:4814 write 0xd0c37b1 thru 0xd0cd978 (0xa1c8 bytes) 2024-09-21T22:01:48.647 INFO:teuthology.orchestra.run.smithi102.stdout:4815 write 0xf6014d thru 0xf64b01 (0x49b5 bytes) 2024-09-21T22:01:48.650 INFO:teuthology.orchestra.run.smithi102.stdout:4817 punch from 0xa3fc1f2 to 0xa4020c3, (0x5ed1 bytes) 2024-09-21T22:01:48.650 INFO:teuthology.orchestra.run.smithi102.stdout:4818 read 0xc873ba7 thru 0xc87ebee (0xb048 bytes) 2024-09-21T22:01:48.650 INFO:teuthology.orchestra.run.smithi102.stdout:4820 write 0xc5d3e69 thru 0xc5d651e (0x26b6 bytes) 2024-09-21T22:01:48.654 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.654 INFO:teuthology.orchestra.run.smithi102.stdout:4825 write 0x9806f66 thru 0x980f5be (0x8659 bytes) 2024-09-21T22:01:48.671 INFO:teuthology.orchestra.run.smithi102.stdout:4826 trunc from 0xd98459b to 0x2513189 2024-09-21T22:01:48.704 INFO:teuthology.orchestra.run.smithi102.stdout:4829 write 0x391acb2 thru 0x39261f3 (0xb542 bytes) 2024-09-21T22:01:48.709 INFO:teuthology.orchestra.run.smithi102.stdout:4830 punch from 0x1d0254e to 0x1d0d644, (0xb0f6 bytes) 2024-09-21T22:01:48.719 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:48.718+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:48.722 INFO:teuthology.orchestra.run.smithi102.stdout:4831 writesame 0x960fbff thru 0x96170c3 data_size 0x1(0x74c5 bytes) 2024-09-21T22:01:48.729 INFO:teuthology.orchestra.run.smithi102.stdout:4832 write 0xa7a33df thru 0xa7a3a32 (0x654 bytes) 2024-09-21T22:01:48.731 INFO:teuthology.orchestra.run.smithi102.stdout:4833 read 0x4a85828 thru 0x4a937c3 (0xdf9c bytes) 2024-09-21T22:01:48.731 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.731 INFO:teuthology.orchestra.run.smithi102.stdout:4835 read 0x9d1fca1 thru 0x9d24a8f (0x4def bytes) 2024-09-21T22:01:48.731 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.741 INFO:teuthology.orchestra.run.smithi102.stdout:4839 write 0xdd1c51c thru 0xdd1f69c (0x3181 bytes) 2024-09-21T22:01:48.752 INFO:teuthology.orchestra.run.smithi102.stdout:4840 trunc from 0xdd1f69d to 0x68b814a 2024-09-21T22:01:48.752 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:48.752 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:48.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:48.763 INFO:teuthology.orchestra.run.smithi102.stdout:4841 writesame 0x4a8bede thru 0x4a93282 data_size 0x5(0x73a5 bytes) 2024-09-21T22:01:48.772 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:48.772 INFO:teuthology.orchestra.run.smithi102.stdout:4845 write 0x53e4db thru 0x540943 (0x2469 bytes) 2024-09-21T22:01:48.775 INFO:teuthology.orchestra.run.smithi102.stdout:4846 write 0x115391b thru 0x1162559 (0xec3f bytes) 2024-09-21T22:01:48.789 INFO:teuthology.orchestra.run.smithi102.stdout:4847 write 0x8a26b44 thru 0x8a2c46e (0x592b bytes) 2024-09-21T22:01:48.797 INFO:teuthology.orchestra.run.smithi102.stdout:4848 write 0x1593f4e thru 0x159d4a6 (0x9559 bytes) 2024-09-21T22:01:48.802 INFO:teuthology.orchestra.run.smithi102.stdout:4851 punch from 0x4d1ca3d to 0x4d24f81, (0x8544 bytes) 2024-09-21T22:01:48.802 INFO:teuthology.orchestra.run.smithi102.stdout:4852 punch from 0x379f0d5 to 0x37ad08d, (0xdfb8 bytes) 2024-09-21T22:01:48.808 INFO:teuthology.orchestra.run.smithi102.stdout:4853 write 0x8dc424a thru 0x8dd210f (0xdec6 bytes) 2024-09-21T22:01:48.817 INFO:teuthology.orchestra.run.smithi102.stdout:4854 punch from 0x7add661 to 0x7ae41e7, (0x6b86 bytes) 2024-09-21T22:01:48.817 INFO:teuthology.orchestra.run.smithi102.stdout:4856 punch from 0x4d5dfbc to 0x4d5f980, (0x19c4 bytes) 2024-09-21T22:01:48.817 INFO:teuthology.orchestra.run.smithi102.stdout:4858 punch from 0x390f6e5 to 0x391b50e, (0xbe29 bytes) 2024-09-21T22:01:48.817 INFO:teuthology.orchestra.run.smithi102.stdout:4859 punch from 0x5bc11b0 to 0x5bced30, (0xdb80 bytes) 2024-09-21T22:01:48.820 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:48.818+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:48.828 INFO:teuthology.orchestra.run.smithi102.stdout:4861 writesame 0xe22d2c9 thru 0xe23c101 data_size 0x1(0xee39 bytes) 2024-09-21T22:01:48.828 INFO:teuthology.orchestra.run.smithi102.stdout:4862 write 0xa5649f2 thru 0xa572e72 (0xe481 bytes) 2024-09-21T22:01:48.835 INFO:teuthology.orchestra.run.smithi102.stdout:4864 punch from 0x7c9f3e0 to 0x7ca1f27, (0x2b47 bytes) 2024-09-21T22:01:48.836 INFO:teuthology.orchestra.run.smithi102.stdout:4865 punch from 0x28505b9 to 0x2856e4d, (0x6894 bytes) 2024-09-21T22:01:48.840 INFO:teuthology.orchestra.run.smithi102.stdout:4866 trunc from 0xe23c102 to 0xa40cb83 2024-09-21T22:01:48.858 INFO:teuthology.orchestra.run.smithi102.stdout:4867 write 0xdddd30b thru 0xdde4402 (0x70f8 bytes) 2024-09-21T22:01:48.864 INFO:teuthology.orchestra.run.smithi102.stdout:4868 read 0x1df73fc thru 0x1dfe4e8 (0x70ed bytes) 2024-09-21T22:01:48.864 INFO:teuthology.orchestra.run.smithi102.stdout:4869 write 0x446a573 thru 0x4472231 (0x7cbf bytes) 2024-09-21T22:01:48.870 INFO:teuthology.orchestra.run.smithi102.stdout:4870 punch from 0x8a9eb1a to 0x8aadea3, (0xf389 bytes) 2024-09-21T22:01:48.870 INFO:teuthology.orchestra.run.smithi102.stdout:4872 write 0xd1f138d thru 0xd200197 (0xee0b bytes) 2024-09-21T22:01:48.884 INFO:teuthology.orchestra.run.smithi102.stdout:4873 write 0xc77047f thru 0xc7799ae (0x9530 bytes) 2024-09-21T22:01:48.891 INFO:teuthology.orchestra.run.smithi102.stdout:4874 write 0xcd0412 thru 0xcd61e2 (0x5dd1 bytes) 2024-09-21T22:01:48.895 INFO:teuthology.orchestra.run.smithi102.stdout:4875 write 0x38bc7dc thru 0x38c5f52 (0x9777 bytes) 2024-09-21T22:01:48.912 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:48.912 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:48.915 INFO:teuthology.orchestra.run.smithi102.stdout:4876 trunc from 0xdde4403 to 0x126ae94 2024-09-21T22:01:48.921 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:48.919+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:48.922 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:48.959 INFO:teuthology.orchestra.run.smithi102.stdout:4877 write 0x39b9be0 thru 0x39c8c3e (0xf05f bytes) 2024-09-21T22:01:48.972 INFO:teuthology.orchestra.run.smithi102.stdout:4880 trunc from 0x39c8c3f to 0x5a74a42 2024-09-21T22:01:48.977 INFO:teuthology.orchestra.run.smithi102.stdout:4883 writesame 0x4790dda thru 0x47a02b1 data_size 0x14(0xf4d8 bytes) 2024-09-21T22:01:49.000 INFO:teuthology.orchestra.run.smithi102.stdout:4885 write 0xb6fc209 thru 0xb6ff760 (0x3558 bytes) 2024-09-21T22:01:49.004 INFO:teuthology.orchestra.run.smithi102.stdout:4888 writesame 0xa493484 thru 0xa499e10 data_size 0x1(0x698d bytes) 2024-09-21T22:01:49.008 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:01:49.030 INFO:teuthology.orchestra.run.smithi102.stdout:4889 write 0xe29d7e3 thru 0xe2a73c6 (0x9be4 bytes) 2024-09-21T22:01:49.030 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:49.028+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:49.031 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:49.031 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:49.040 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:49.041 INFO:teuthology.orchestra.run.smithi102.stdout:4890 write 0x5491628 thru 0x5497913 (0x62ec bytes) 2024-09-21T22:01:49.046 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:49.063 INFO:teuthology.orchestra.run.smithi102.stdout:4894 trunc from 0xe2a73c7 to 0x45f9eb 2024-09-21T22:01:49.081 INFO:teuthology.orchestra.run.smithi102.stdout:4895 read 0x5aad0 thru 0x6470e (0x9c3f bytes) 2024-09-21T22:01:49.082 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:49.091 INFO:teuthology.orchestra.run.smithi102.stdout:4899 write 0x30235d4 thru 0x302ae3b (0x7868 bytes) 2024-09-21T22:01:49.105 INFO:teuthology.orchestra.run.smithi102.stdout:4900 trunc from 0x302ae3c to 0x974ecc3 2024-09-21T22:01:49.111 INFO:teuthology.orchestra.run.smithi102.stdout:4902 punch from 0x8f82fc8 to 0x8f84a0f, (0x1a47 bytes) 2024-09-21T22:01:49.111 INFO:teuthology.orchestra.run.smithi102.stdout:4903 writesame 0x5300dc7 thru 0x5303a40 data_size 0x1(0x2c7a bytes) 2024-09-21T22:01:49.117 INFO:teuthology.orchestra.run.smithi102.stdout:4904 read 0x666cef7 thru 0x667a328 (0xd432 bytes) 2024-09-21T22:01:49.117 INFO:teuthology.orchestra.run.smithi102.stdout:4906 write 0x13d71d6 thru 0x13de8b7 (0x76e2 bytes) 2024-09-21T22:01:49.122 INFO:teuthology.orchestra.run.smithi102.stdout:4907 read 0x916ef24 thru 0x917e39f (0xf47c bytes) 2024-09-21T22:01:49.123 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:49.120+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:49.123 INFO:teuthology.orchestra.run.smithi102.stdout:4908 write 0x8781ae6 thru 0x8791880 (0xfd9b bytes) 2024-09-21T22:01:49.133 INFO:teuthology.orchestra.run.smithi102.stdout:4910 write 0x4a311e4 thru 0x4a38020 (0x6e3d bytes) 2024-09-21T22:01:49.143 INFO:teuthology.orchestra.run.smithi102.stdout:4911 write 0x780aafc thru 0x780c810 (0x1d15 bytes) 2024-09-21T22:01:49.147 INFO:teuthology.orchestra.run.smithi102.stdout:4912 read 0x5cb141c thru 0x5cbe195 (0xcd7a bytes) 2024-09-21T22:01:49.147 INFO:teuthology.orchestra.run.smithi102.stdout:4913 read 0x6e1b047 thru 0x6e24c7f (0x9c39 bytes) 2024-09-21T22:01:49.150 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:49.150 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:49.154 INFO:teuthology.orchestra.run.smithi102.stdout:4915 trunc from 0x974ecc3 to 0x319364f 2024-09-21T22:01:49.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:49.189 INFO:teuthology.orchestra.run.smithi102.stdout:4919 write 0xe82c8dc thru 0xe835189 (0x88ae bytes) 2024-09-21T22:01:49.194 INFO:teuthology.orchestra.run.smithi102.stdout:4922 read 0xc5a1382 thru 0xc5aacf8 (0x9977 bytes) 2024-09-21T22:01:49.194 INFO:teuthology.orchestra.run.smithi102.stdout:4923 write 0xe6b868 thru 0xe76ed2 (0xb66b bytes) 2024-09-21T22:01:49.200 INFO:teuthology.orchestra.run.smithi102.stdout:4925 write 0xcaad23f thru 0xcabb270 (0xe032 bytes) 2024-09-21T22:01:49.206 INFO:teuthology.orchestra.run.smithi102.stdout:4926 write 0x510806 thru 0x517a63 (0x725e bytes) 2024-09-21T22:01:49.208 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:49.208 INFO:teuthology.orchestra.run.smithi102.stdout:4928 writesame 0x4dd698f thru 0x4de578d data_size 0x17(0xedff bytes) 2024-09-21T22:01:49.215 INFO:teuthology.orchestra.run.smithi102.stdout:4932 writesame 0x3065766 thru 0x30743c5 data_size 0x20(0xec60 bytes) 2024-09-21T22:01:49.223 INFO:teuthology.orchestra.run.smithi102.stdout:4934 read 0xcf55649 thru 0xcf6535d (0xfd15 bytes) 2024-09-21T22:01:49.223 INFO:teuthology.orchestra.run.smithi102.stdout:4935 writesame 0xb00e472 thru 0xb013da2 data_size 0x9(0x5931 bytes) 2024-09-21T22:01:49.223 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:49.221+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:49.227 INFO:teuthology.orchestra.run.smithi102.stdout:4936 punch from 0x2555016 to 0x25622f9, (0xd2e3 bytes) 2024-09-21T22:01:49.227 INFO:teuthology.orchestra.run.smithi102.stdout:4937 write 0x5cd178 thru 0x5d9269 (0xc0f2 bytes) 2024-09-21T22:01:49.229 INFO:teuthology.orchestra.run.smithi102.stdout:4938 read 0x95a0898 thru 0x95ae22c (0xd995 bytes) 2024-09-21T22:01:49.229 INFO:teuthology.orchestra.run.smithi102.stdout:4939 read 0xc00656d thru 0xc00d1ee (0x6c82 bytes) 2024-09-21T22:01:49.229 INFO:teuthology.orchestra.run.smithi102.stdout:4940 write 0x534368b thru 0x534ad32 (0x76a8 bytes) 2024-09-21T22:01:49.234 INFO:teuthology.orchestra.run.smithi102.stdout:4942 write 0x301057c thru 0x301ef44 (0xe9c9 bytes) 2024-09-21T22:01:49.240 INFO:teuthology.orchestra.run.smithi102.stdout:4943 read 0x8724be5 thru 0x8725170 (0x58c bytes) 2024-09-21T22:01:49.240 INFO:teuthology.orchestra.run.smithi102.stdout:4944 read 0xb1d1ea1 thru 0xb1d5532 (0x3692 bytes) 2024-09-21T22:01:49.240 INFO:teuthology.orchestra.run.smithi102.stdout:4945 writesame 0xcc34b8 thru 0xcce778 data_size 0x1(0xb2c1 bytes) 2024-09-21T22:01:49.255 INFO:teuthology.orchestra.run.smithi102.stdout:4947 read 0x1c2b11c thru 0x1c2f64d (0x4532 bytes) 2024-09-21T22:01:49.255 INFO:teuthology.orchestra.run.smithi102.stdout:4948 read 0xab82bf7 thru 0xab8dc4e (0xb058 bytes) 2024-09-21T22:01:49.255 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:49.255 INFO:teuthology.orchestra.run.smithi102.stdout:4951 punch from 0xd7aa0c1 to 0xd7b9b30, (0xfa6f bytes) 2024-09-21T22:01:49.255 INFO:teuthology.orchestra.run.smithi102.stdout:4952 write 0x27e0810 thru 0x27ed52e (0xcd1f bytes) 2024-09-21T22:01:49.264 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:49.265 INFO:teuthology.orchestra.run.smithi102.stdout:4956 punch from 0xbdf8d56 to 0xbdfb782, (0x2a2c bytes) 2024-09-21T22:01:49.265 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:49.265 INFO:teuthology.orchestra.run.smithi102.stdout:4959 read 0x614c46 thru 0x6159e5 (0xda0 bytes) 2024-09-21T22:01:49.265 INFO:teuthology.orchestra.run.smithi102.stdout:4960 punch from 0xbefe56b to 0xbf090f0, (0xab85 bytes) 2024-09-21T22:01:49.279 INFO:teuthology.orchestra.run.smithi102.stdout:4962 trunc from 0xe83518a to 0x2f477b4 2024-09-21T22:01:49.313 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:49.313 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:49.314 INFO:teuthology.orchestra.run.smithi102.stdout:4963 write 0xbb57364 thru 0xbb666ed (0xf38a bytes) 2024-09-21T22:01:49.321 INFO:teuthology.orchestra.run.smithi102.stdout:4965 write 0xb2ee126 thru 0xb2fca08 (0xe8e3 bytes) 2024-09-21T22:01:49.323 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:49.324 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:49.322+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:49.334 INFO:teuthology.orchestra.run.smithi102.stdout:4966 trunc from 0xbb666ee to 0x69a2405 2024-09-21T22:01:49.352 INFO:teuthology.orchestra.run.smithi102.stdout:4967 write 0x8757777 thru 0x8763a48 (0xc2d2 bytes) 2024-09-21T22:01:49.359 INFO:teuthology.orchestra.run.smithi102.stdout:4968 trunc from 0x8763a49 to 0x89389ab 2024-09-21T22:01:49.364 INFO:teuthology.orchestra.run.smithi102.stdout:4970 read 0x86ade7b thru 0x86ba30d (0xc493 bytes) 2024-09-21T22:01:49.365 INFO:teuthology.orchestra.run.smithi102.stdout:4971 write 0x2a0365f thru 0x2a04f14 (0x18b6 bytes) 2024-09-21T22:01:49.369 INFO:teuthology.orchestra.run.smithi102.stdout:4972 trunc from 0x89389ab to 0x6bfe936 2024-09-21T22:01:49.386 INFO:teuthology.orchestra.run.smithi102.stdout:4973 writesame 0x78847ff thru 0x788eb4f data_size 0x1(0xa351 bytes) 2024-09-21T22:01:49.398 INFO:teuthology.orchestra.run.smithi102.stdout:4974 writesame 0xcb63129 thru 0xcb6f9e5 data_size 0x3b(0xc8bd bytes) 2024-09-21T22:01:49.398 INFO:teuthology.orchestra.run.smithi102.stdout:4975 read 0x18d56eb thru 0x18dbe35 (0x674b bytes) 2024-09-21T22:01:49.398 INFO:teuthology.orchestra.run.smithi102.stdout:4976 read 0x6724deb thru 0x6726749 (0x195f bytes) 2024-09-21T22:01:49.405 INFO:teuthology.orchestra.run.smithi102.stdout:4980 writesame 0xdefbff1 thru 0xdefe77b data_size 0x1(0x278b bytes) 2024-09-21T22:01:49.405 INFO:teuthology.orchestra.run.smithi102.stdout:4983 write 0xd51f646 thru 0xd5227fc (0x31b7 bytes) 2024-09-21T22:01:49.408 INFO:teuthology.orchestra.run.smithi102.stdout:4984 write 0x6f366c9 thru 0x6f3ff22 (0x985a bytes) 2024-09-21T22:01:49.413 INFO:teuthology.orchestra.run.smithi102.stdout:4986 write 0xced58fd thru 0xced8b8c (0x3290 bytes) 2024-09-21T22:01:49.417 INFO:teuthology.orchestra.run.smithi102.stdout:4987 punch from 0x19c0565 to 0x19c788f, (0x732a bytes) 2024-09-21T22:01:49.417 INFO:teuthology.orchestra.run.smithi102.stdout:4991 write 0xcd9a99f thru 0xcda9cc3 (0xf325 bytes) 2024-09-21T22:01:49.425 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:49.423+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:49.425 INFO:teuthology.orchestra.run.smithi102.stdout:4992 writesame 0xc6aee2d thru 0xc6b2a2b data_size 0x1(0x3bff bytes) 2024-09-21T22:01:49.432 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:49.432 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:49.434 INFO:teuthology.orchestra.run.smithi102.stdout:4995 read 0xc97b730 thru 0xc984b09 (0x93da bytes) 2024-09-21T22:01:49.435 INFO:teuthology.orchestra.run.smithi102.stdout:4996 writesame 0x1dac407 thru 0x1dae42d data_size 0x1(0x2027 bytes) 2024-09-21T22:01:49.441 INFO:teuthology.orchestra.run.smithi102.stdout:4997 read 0xa10610e thru 0xa112971 (0xc864 bytes) 2024-09-21T22:01:49.441 INFO:teuthology.orchestra.run.smithi102.stdout:5000 punch from 0x6958380 to 0x695aa4f, (0x26cf bytes) 2024-09-21T22:01:49.441 INFO:teuthology.orchestra.run.smithi102.stdout:5004 read 0x7521ed1 thru 0x7528096 (0x61c6 bytes) 2024-09-21T22:01:49.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:49.444 INFO:teuthology.orchestra.run.smithi102.stdout:5005 trunc from 0xdefe77c to 0xb2ec282 2024-09-21T22:01:49.456 INFO:teuthology.orchestra.run.smithi102.stdout:5006 read 0x200f1aa thru 0x2016611 (0x7468 bytes) 2024-09-21T22:01:49.456 INFO:teuthology.orchestra.run.smithi102.stdout:5007 write 0x378054a thru 0x3788555 (0x800c bytes) 2024-09-21T22:01:49.460 INFO:teuthology.orchestra.run.smithi102.stdout:5008 clone 36 order 22 su 131072 sc 12 2024-09-21T22:01:49.525 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:49.523+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:49.546 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:49.546 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:49.555 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:49.606 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:49.640 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:49.638+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:49.698 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:49.698 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:49.706 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:49.725 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:49.726 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:49.724+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:49.742 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:49.742 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:49.758 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:49.758 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:49.774 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:49.774 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:49.791 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:49.792 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:49.809 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:49.809 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:49.825 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:49.828 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:49.826+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:49.842 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:49.842 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:49.853 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:49.853 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:49.853 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:49.853 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:49.853 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:49.862 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:49.946 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:49.944+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:49.963 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 71.936169325999998, 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.012 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.013 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:01:50.014 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:01:50.015 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:01:50.016 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:01:50.017 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.018 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.504133074999999, 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:50.019 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:01:50.020 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:01:50.021 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.022 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:50.023 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.024 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28830 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151373829999997, 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023121914, 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28830 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.025 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858177+0000", 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2500000000000001e-07 2024-09-21T22:01:50.026 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858180+0000", 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3939999999999999e-06 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858187+0000", 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7399999999999998e-06 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858192+0000", 2024-09-21T22:01:50.027 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0690000000000001e-06 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881115+0000", 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923756 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881192+0000", 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6867999999999997e-05 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881299+0000", 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000106662 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28831 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1175552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151353213999997, 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023343084, 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.029 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28831 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.030 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858198+0000", 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2e-07 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858200+0000", 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0430000000000002e-06 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858207+0000", 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6449999999999999e-06 2024-09-21T22:01:50.031 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858212+0000", 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0549999999999999e-06 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881352+0000", 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023140609999999999 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881438+0000", 2024-09-21T22:01:50.032 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5278000000000006e-05 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881541+0000", 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103033 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28832 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151332922000002, 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023498735999999999, 2024-09-21T22:01:50.033 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28832 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.034 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858218+0000", 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3099999999999999e-07 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858220+0000", 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4270000000000001e-06 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.035 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858223+0000", 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.641e-06 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858226+0000", 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9919999999999999e-06 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881570+0000", 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023343632999999999 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881644+0000", 2024-09-21T22:01:50.036 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3645000000000004e-05 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881717+0000", 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3066999999999997e-05 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28833 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1257472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151320861000002, 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023709134999999999, 2024-09-21T22:01:50.037 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28833 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.038 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858230+0000", 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858231+0000", 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.175e-06 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858235+0000", 2024-09-21T22:01:50.039 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4290000000000001e-06 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858239+0000", 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0990000000000001e-06 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881761+0000", 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023522279 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881847+0000", 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6018000000000002e-05 2024-09-21T22:01:50.040 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881939+0000", 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1910999999999995e-05 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151306257999998, 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.041 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.042 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.043 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:01:50.044 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151286794999997, 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:01:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.048 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151258718000001, 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.049 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.050 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.051 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.052 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151236886, 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.053 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.054 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.056 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151216558999998, 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.057 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.059 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:01:50.060 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151195596999997, 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.061 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:01:50.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.063 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.064 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:01:50.064 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:01:50.064 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.064 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.064 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.064 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:01:50.064 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:01:50.065 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.066 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.066 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:01:50.066 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:01:50.066 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.066 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.066 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.066 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:01:50.066 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:01:50.066 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.067 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.067 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.067 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.067 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.067 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.067 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:50.067 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.151174609999998, 2024-09-21T22:01:50.067 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:01:50.067 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.067 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:50.068 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:01:50.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:01:50.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29858 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2834432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.072 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.116325093999997, 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023030268999999999, 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29858 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.074 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893226+0000", 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5900000000000002e-07 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893228+0000", 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1859999999999999e-06 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893235+0000", 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7139999999999996e-06 2024-09-21T22:01:50.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893241+0000", 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7620000000000001e-06 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916157+0000", 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022915819 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916200+0000", 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2898999999999997e-05 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916256+0000", 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.643e-05 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29859 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2875392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.116303598000002, 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023235025999999999, 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29859 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.078 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893247+0000", 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893248+0000", 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.89e-07 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893249+0000", 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4950000000000001e-06 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893255+0000", 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9410000000000004e-06 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893260+0000", 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1930000000000001e-06 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916285+0000", 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023024203 2024-09-21T22:01:50.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916375+0000", 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0486000000000001e-05 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916482+0000", 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000107219 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.082 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29860 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2916352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.116283617000001, 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023394503000000001, 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.083 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29860 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893267+0000", 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893268+0000", 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9299999999999999e-07 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893270+0000", 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893282+0000", 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2291e-05 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893287+0000", 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2480000000000004e-06 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916509+0000", 2024-09-21T22:01:50.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023221836999999999 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916567+0000", 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7615999999999999e-05 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916662+0000", 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.501e-05 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.087 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29861 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2957312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.116256344999996, 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023596588000000002, 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29861 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:50.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893295+0000", 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2199999999999999e-07 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893297+0000", 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2539999999999999e-06 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893304+0000", 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3350000000000003e-06 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893308+0000", 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4800000000000003e-06 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916697+0000", 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023388720000000002 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916787+0000", 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9777999999999993e-05 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916891+0000", 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010459900000000001 2024-09-21T22:01:50.092 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29862 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 2998272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.116236970000003, 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023721644, 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.093 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29862 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893314+0000", 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893316+0000", 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.091e-06 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893322+0000", 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893328+0000", 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2299999999999999e-06 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916932+0000", 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023603889999999999 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.916980+0000", 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8803e-05 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917036+0000", 2024-09-21T22:01:50.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5219000000000001e-05 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29863 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 3031040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.116217630999998, 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023866634000000001, 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.098 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29863 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893334+0000", 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893339+0000", 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893345+0000", 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1469999999999998e-06 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893356+0000", 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0772e-05 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917062+0000", 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023706261999999999 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917108+0000", 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5318000000000002e-05 2024-09-21T22:01:50.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917200+0000", 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2238999999999996e-05 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:01:50.103 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.2097278160000009, 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:01:50.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:01:50.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:01:50.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:01:50.109 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.110 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.110 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.110 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:50.110 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:50.110 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:50.111 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:50.109+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:50.112 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:50.133 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-21T22:01:50.143 INFO:teuthology.orchestra.run.smithi102.stdout:5009 read 0x57871d9 thru 0x5794cd1 (0xdaf9 bytes) 2024-09-21T22:01:50.147 INFO:teuthology.orchestra.run.smithi102.stdout:5010 punch from 0x4ec9f88 to 0x4ed4e63, (0xaedb bytes) 2024-09-21T22:01:50.147 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:50.147 INFO:teuthology.orchestra.run.smithi102.stdout:5012 punch from 0x427bb65 to 0x4286db7, (0xb252 bytes) 2024-09-21T22:01:50.147 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:50.147 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:50.148 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:50.150 INFO:teuthology.orchestra.run.smithi102.stdout:5017 trunc from 0xb2ec282 to 0xdd68031 2024-09-21T22:01:50.156 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:50.159 INFO:teuthology.orchestra.run.smithi102.stdout:5019 trunc from 0xdd68031 to 0xafe2ff9 2024-09-21T22:01:50.187 INFO:teuthology.orchestra.run.smithi102.stdout:5021 write 0x4bbf9d8 thru 0x4bcc5ee (0xcc17 bytes) 2024-09-21T22:01:50.196 INFO:teuthology.orchestra.run.smithi102.stdout:5022 read 0x973a760 thru 0x9746da4 (0xc645 bytes) 2024-09-21T22:01:50.196 INFO:teuthology.orchestra.run.smithi102.stdout:5023 write 0x87ec896 thru 0x87ed541 (0xcac bytes) 2024-09-21T22:01:50.200 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:50.200 INFO:teuthology.orchestra.run.smithi102.stdout:5025 punch from 0x8f70320 to 0x8f789b7, (0x8697 bytes) 2024-09-21T22:01:50.200 INFO:teuthology.orchestra.run.smithi102.stdout:5026 write 0x44866e2 thru 0x448ad26 (0x4645 bytes) 2024-09-21T22:01:50.211 INFO:teuthology.orchestra.run.smithi102.stdout:5027 trunc from 0xafe2ff9 to 0x54b261f 2024-09-21T22:01:50.211 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:50.209+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:59638 3.6 3:6642cd12:::rbd_data.11247b96bed5.0000000000000015:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 3145728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:50.233514+0000", 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00037538399999999998, 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000403762, 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2024-09-21T22:01:50.235 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 59638 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:50.233514+0000", 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:50.233514+0000", 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:50.233516+0000", 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2079999999999999e-06 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:50.233520+0000", 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.549e-06 2024-09-21T22:01:50.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:50.233531+0000", 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.059e-05 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:50.233536+0000", 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.843e-06 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:50.233587+0000", 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1709000000000002e-05 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:50.233724+0000", 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000136475 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 1", 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:50.233911+0000", 2024-09-21T22:01:50.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00018762800000000001 2024-09-21T22:01:50.240 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.240 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.240 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.240 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.240 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:50.240 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 1 2024-09-21T22:01:50.240 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:50.244 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:50.246 INFO:teuthology.orchestra.run.smithi102.stdout:5029 write 0x153a8f1 thru 0x1541ced (0x73fd bytes) 2024-09-21T22:01:50.272 INFO:teuthology.orchestra.run.smithi102.stdout:5030 write 0x7199b58 thru 0x719b5b0 (0x1a59 bytes) 2024-09-21T22:01:50.275 INFO:teuthology.orchestra.run.smithi102.stdout:5031 clone 37 order 21 su 16384 sc 9 2024-09-21T22:01:50.312 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:50.311+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:50.353 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:50.353 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:50.353 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:50.353 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:50.353 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:50.362 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:50.446 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:50.444+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:50.505 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264491178999997, 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.506 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:01:50.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:01:50.510 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.511 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.511 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.513 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.513 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264469159999997, 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.517 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264448579000003, 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:01:50.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:01:50.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:01:50.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:01:50.521 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264419981000003, 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.522 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:01:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:01:50.525 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264397576, 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.526 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:01:50.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:01:50.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264377561000003, 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.530 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264357357999998, 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.534 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:01:50.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:01:50.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264338099, 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:01:50.538 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:01:50.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:01:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264312031999999, 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:01:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:01:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264291381, 2024-09-21T22:01:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264233202, 2024-09-21T22:01:50.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.554 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264178422999997, 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264143967000003, 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.559 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:01:50.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:01:50.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:01:50.562 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264122637, 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.563 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:01:50.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:01:50.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:01:50.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264101476, 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.567 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:01:50.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264070951999997, 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.571 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:50.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:01:50.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:01:50.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264046593000003, 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.575 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:01:50.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:01:50.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:01:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264025287999999, 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.579 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.583 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.264003897999999, 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.587 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.263982531000003, 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.588 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.591 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.592 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.592 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:50.592 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:50.592 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:50.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:50.593 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:50.591+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:50.694 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:50.692+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:50.736 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:50.736 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:50.736 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:50.736 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:50.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:50.829 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:50.827+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:50.888 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:50.888 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:50.888 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:50.888 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:50.888 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:50.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:50.897 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:50.894+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:50.997 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:50.996+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:51.032 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone36 from 0x719b5b1 (overlap 0x54b261f) to 0x43c1e7f 2024-09-21T22:01:51.051 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086272565999998, 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.052 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:01:51.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:01:51.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.056 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086251324999999, 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:51.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:01:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.060 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086230096999998, 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.061 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:01:51.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086206490999999, 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:01:51.065 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.069 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086187201000001, 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086154954999998, 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:01:51.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.077 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086130986000001, 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:01:51.081 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086111422000002, 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.082 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:01:51.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086090990000002, 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:01:51.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:01:51.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086069866999999, 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.090 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086050651000001, 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086030178999998, 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.099 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.102 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.086009464, 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:01:51.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.085989708, 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.107 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:51.111 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.085969992999999, 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:51.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:01:51.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.085950083, 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:01:51.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.119 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.085929100000001, 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.120 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:01:51.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:01:51.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:01:51.123 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.085908416000002, 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:01:51.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:01:51.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:01:51.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:01:51.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.085882511999998, 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.128 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.085861594999997, 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.132 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:51.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:01:51.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:01:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:01:51.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:01:51.136 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.136 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.136 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.136 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.136 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.136 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:51.137 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:51.138 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-21T22:01:51.138 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:51.135+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:51.238 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:51.236+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:51.252 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:51.253 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:51.253 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:51.253 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:51.262 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:51.333 INFO:teuthology.orchestra.run.smithi102.stdout:5032 read 0x48b9e8c thru 0x48c9a06 (0xfb7b bytes) 2024-09-21T22:01:51.341 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:51.339+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:51.346 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.379 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:51.380 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:51.388 INFO:teuthology.orchestra.run.smithi102.stdout:5034 write 0xa4346c7 thru 0xa43b35c (0x6c96 bytes) 2024-09-21T22:01:51.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:51.398 INFO:teuthology.orchestra.run.smithi102.stdout:5036 write 0xb0486b4 thru 0xb04fc21 (0x756e bytes) 2024-09-21T22:01:51.412 INFO:teuthology.orchestra.run.smithi102.stdout:5037 trunc from 0xb04fc22 to 0x1d96ee1 2024-09-21T22:01:51.439 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:51.437+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:51.455 INFO:teuthology.orchestra.run.smithi102.stdout:5038 read 0x2de4c3 thru 0x2dea80 (0x5be bytes) 2024-09-21T22:01:51.470 INFO:teuthology.orchestra.run.smithi102.stdout:5040 trunc from 0x1d96ee1 to 0xd983c72 2024-09-21T22:01:51.479 INFO:teuthology.orchestra.run.smithi102.stdout:5041 punch from 0x70b2d9a to 0x70b6709, (0x396f bytes) 2024-09-21T22:01:51.479 INFO:teuthology.orchestra.run.smithi102.stdout:5043 read 0x31a0fa3 thru 0x31a729d (0x62fb bytes) 2024-09-21T22:01:51.479 INFO:teuthology.orchestra.run.smithi102.stdout:5045 write 0x14ce40d thru 0x14cfb3b (0x172f bytes) 2024-09-21T22:01:51.480 INFO:teuthology.orchestra.run.smithi102.stdout:5047 write 0x7991b79 thru 0x799e229 (0xc6b1 bytes) 2024-09-21T22:01:51.490 INFO:teuthology.orchestra.run.smithi102.stdout:5049 write 0xa34650f thru 0xa34b9f5 (0x54e7 bytes) 2024-09-21T22:01:51.498 INFO:teuthology.orchestra.run.smithi102.stdout:5050 write 0x872707c thru 0x87367bd (0xf742 bytes) 2024-09-21T22:01:51.508 INFO:teuthology.orchestra.run.smithi102.stdout:5052 write 0x6b7066c thru 0x6b78289 (0x7c1e bytes) 2024-09-21T22:01:51.517 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.524 INFO:teuthology.orchestra.run.smithi102.stdout:5054 trunc from 0xd983c72 to 0x7468e8c 2024-09-21T22:01:51.525 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:51.525 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653799388000003, 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:01:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:01:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653779395000001, 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:01:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:01:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653659959999999, 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653393254000001, 2024-09-21T22:01:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653363091999999, 2024-09-21T22:01:51.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653337555999997, 2024-09-21T22:01:51.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:01:51.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653315028000002, 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.550 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:51.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:01:51.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:01:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653291408000001, 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:01:51.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653271058999998, 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.558 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:01:51.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653248644999998, 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.562 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653072578, 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.566 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:51.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:01:51.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653043570000001, 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.570 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.653021739000003, 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.574 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:01:51.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.652864594, 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:01:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:01:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:01:51.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.652832124, 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:01:51.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:01:51.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.585 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.652810592999998, 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.586 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:01:51.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:01:51.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.589 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.652789276, 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:01:51.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:01:51.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:01:51.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.593 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.652763833999998, 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.594 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.652743135000001, 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.598 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:01:51.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.652722503, 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:51.602 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:01:51.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:01:51.605 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.606 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.606 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.606 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:51.606 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:51.606 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:51.606 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:01:51.606 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:01:51.606 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-21T22:01:51.606 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-21T22:01:51.607 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:51.605+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:51.608 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:51.609 INFO:teuthology.orchestra.run.smithi102.stdout:5055 read 0x6533b2 thru 0x659cee (0x693d bytes) 2024-09-21T22:01:51.609 INFO:teuthology.orchestra.run.smithi102.stdout:5056 read 0x36d35a9 thru 0x36df45a (0xbeb2 bytes) 2024-09-21T22:01:51.609 INFO:teuthology.orchestra.run.smithi102.stdout:5057 write 0x27ec052 thru 0x27f6b32 (0xaae1 bytes) 2024-09-21T22:01:51.609 INFO:teuthology.orchestra.run.smithi102.stdout:5058 read 0x39d4abb thru 0x39df386 (0xa8cc bytes) 2024-09-21T22:01:51.609 INFO:teuthology.orchestra.run.smithi102.stdout:5059 trunc from 0x7468e8c to 0xaaca8eb 2024-09-21T22:01:51.609 INFO:teuthology.orchestra.run.smithi102.stdout:5060 punch from 0x52c5c3b to 0x52c8d7e, (0x3143 bytes) 2024-09-21T22:01:51.609 INFO:teuthology.orchestra.run.smithi102.stdout:5061 writesame 0x7038d63 thru 0x70415a3 data_size 0x4d(0x8841 bytes) 2024-09-21T22:01:51.609 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.610 INFO:teuthology.orchestra.run.smithi102.stdout:5063 trunc from 0xaaca8eb to 0x38b1510 2024-09-21T22:01:51.610 INFO:teuthology.orchestra.run.smithi102.stdout:5064 trunc from 0x38b1510 to 0x5b2c48a 2024-09-21T22:01:51.616 INFO:teuthology.orchestra.run.smithi102.stdout:5065 read 0x27746fd thru 0x27802a2 (0xbba6 bytes) 2024-09-21T22:01:51.630 INFO:teuthology.orchestra.run.smithi102.stdout:5066 writesame 0xc4c10ba thru 0xc4cefd8 data_size 0x1(0xdf1f bytes) 2024-09-21T22:01:51.630 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.630 INFO:teuthology.orchestra.run.smithi102.stdout:5069 write 0xd97b85 thru 0xd9a3e3 (0x285f bytes) 2024-09-21T22:01:51.657 INFO:teuthology.orchestra.run.smithi102.stdout:5070 write 0xc7409a1 thru 0xc74c282 (0xb8e2 bytes) 2024-09-21T22:01:51.663 INFO:teuthology.orchestra.run.smithi102.stdout:5071 read 0x3b75cf7 thru 0x3b77ce3 (0x1fed bytes) 2024-09-21T22:01:51.663 INFO:teuthology.orchestra.run.smithi102.stdout:5072 writesame 0x3d4e40e thru 0x3d55fb3 data_size 0x62(0x7ba6 bytes) 2024-09-21T22:01:51.668 INFO:teuthology.orchestra.run.smithi102.stdout:5073 punch from 0xc5233ff to 0xc527ec3, (0x4ac4 bytes) 2024-09-21T22:01:51.669 INFO:teuthology.orchestra.run.smithi102.stdout:5074 trunc from 0xc74c283 to 0xb46a012 2024-09-21T22:01:51.686 INFO:teuthology.orchestra.run.smithi102.stdout:5075 write 0xcd85399 thru 0xcd94593 (0xf1fb bytes) 2024-09-21T22:01:51.694 INFO:teuthology.orchestra.run.smithi102.stdout:5076 trunc from 0xcd94594 to 0xb8cf2bc 2024-09-21T22:01:51.704 INFO:teuthology.orchestra.run.smithi102.stdout:5077 read 0x48ff2e5 thru 0x490eaa6 (0xf7c2 bytes) 2024-09-21T22:01:51.704 INFO:teuthology.orchestra.run.smithi102.stdout:5078 write 0xccbd1f thru 0xccc96b (0xc4d bytes) 2024-09-21T22:01:51.706 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.706 INFO:teuthology.orchestra.run.smithi102.stdout:5081 write 0x179c72e thru 0x17a4335 (0x7c08 bytes) 2024-09-21T22:01:51.708 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:51.706+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:51.709 INFO:teuthology.orchestra.run.smithi102.stdout:5082 trunc from 0xb8cf2bc to 0xa8d9eaf 2024-09-21T22:01:51.713 INFO:teuthology.orchestra.run.smithi102.stdout:5083 write 0xb04467 thru 0xb04973 (0x50d bytes) 2024-09-21T22:01:51.715 INFO:teuthology.orchestra.run.smithi102.stdout:5084 read 0x4c73092 thru 0x4c7cfbb (0x9f2a bytes) 2024-09-21T22:01:51.715 INFO:teuthology.orchestra.run.smithi102.stdout:5085 read 0x815f280 thru 0x816e0d3 (0xee54 bytes) 2024-09-21T22:01:51.719 INFO:teuthology.orchestra.run.smithi102.stdout:5086 trunc from 0xa8d9eaf to 0xd820a7e 2024-09-21T22:01:51.723 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.723 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.724 INFO:teuthology.orchestra.run.smithi102.stdout:5090 punch from 0xcc222f7 to 0xcc2ae31, (0x8b3a bytes) 2024-09-21T22:01:51.724 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.724 INFO:teuthology.orchestra.run.smithi102.stdout:5093 read 0x598b707 thru 0x598cc63 (0x155d bytes) 2024-09-21T22:01:51.724 INFO:teuthology.orchestra.run.smithi102.stdout:5094 read 0xaa00a5f thru 0xaa0b120 (0xa6c2 bytes) 2024-09-21T22:01:51.724 INFO:teuthology.orchestra.run.smithi102.stdout:5096 read 0xa2ad3b5 thru 0xa2bca90 (0xf6dc bytes) 2024-09-21T22:01:51.724 INFO:teuthology.orchestra.run.smithi102.stdout:5097 read 0x5480224 thru 0x5480c5b (0xa38 bytes) 2024-09-21T22:01:51.724 INFO:teuthology.orchestra.run.smithi102.stdout:5098 write 0xa913d75 thru 0xa920d7b (0xd007 bytes) 2024-09-21T22:01:51.731 INFO:teuthology.orchestra.run.smithi102.stdout:5100 read 0x353e38a thru 0x353eeb2 (0xb29 bytes) 2024-09-21T22:01:51.731 INFO:teuthology.orchestra.run.smithi102.stdout:5104 read 0x84f7d65 thru 0x84f9379 (0x1615 bytes) 2024-09-21T22:01:51.733 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:51.733 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:51.733 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:51.733 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:51.743 INFO:teuthology.orchestra.run.smithi102.stdout:5105 trunc from 0xd820a7e to 0x3bd766f 2024-09-21T22:01:51.748 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:01:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:01:51.764 INFO:teuthology.orchestra.run.smithi102.stdout:5106 read 0x2e642d2 thru 0x2e6d1b5 (0x8ee4 bytes) 2024-09-21T22:01:51.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:01:51.766 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:01:51.766 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-21T22:01:51.771 INFO:teuthology.orchestra.run.smithi102.stdout:5107 write 0x4626043 thru 0x4632b78 (0xcb36 bytes) 2024-09-21T22:01:51.777 INFO:teuthology.orchestra.run.smithi102.stdout:5109 punch from 0x3ed43f to 0x3fc526, (0xf0e7 bytes) 2024-09-21T22:01:51.777 INFO:teuthology.orchestra.run.smithi102.stdout:5111 write 0x2381545 thru 0x23896e7 (0x81a3 bytes) 2024-09-21T22:01:51.779 INFO:teuthology.orchestra.run.smithi102.stdout:5112 read 0x3f49b12 thru 0x3f4d33b (0x382a bytes) 2024-09-21T22:01:51.792 INFO:teuthology.orchestra.run.smithi102.stdout:5114 write 0xb419b93 thru 0xb41ad03 (0x1171 bytes) 2024-09-21T22:01:51.795 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.800 INFO:teuthology.orchestra.run.smithi102.stdout:5116 write 0xb699dde thru 0xb6a693a (0xcb5d bytes) 2024-09-21T22:01:51.809 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:51.807+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:51.810 INFO:teuthology.orchestra.run.smithi102.stdout:5117 punch from 0xa982eef to 0xa9912cf, (0xe3e0 bytes) 2024-09-21T22:01:51.810 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.810 INFO:teuthology.orchestra.run.smithi102.stdout:5121 read 0x6560997 thru 0x656510b (0x4775 bytes) 2024-09-21T22:01:51.810 INFO:teuthology.orchestra.run.smithi102.stdout:5122 writesame 0x57829f thru 0x578e04 data_size 0x1(0xb66 bytes) 2024-09-21T22:01:51.812 INFO:teuthology.orchestra.run.smithi102.stdout:5123 read 0xa35cd6a thru 0xa365cd5 (0x8f6c bytes) 2024-09-21T22:01:51.812 INFO:teuthology.orchestra.run.smithi102.stdout:5125 read 0x6364285 thru 0x637337e (0xf0fa bytes) 2024-09-21T22:01:51.823 INFO:teuthology.orchestra.run.smithi102.stdout:5127 write 0xe8f1913 thru 0xe8fa424 (0x8b12 bytes) 2024-09-21T22:01:51.831 INFO:teuthology.orchestra.run.smithi102.stdout:5129 read 0xc6220f8 thru 0xc629dbc (0x7cc5 bytes) 2024-09-21T22:01:51.831 INFO:teuthology.orchestra.run.smithi102.stdout:5130 read 0x45b3ad9 thru 0x45be688 (0xabb0 bytes) 2024-09-21T22:01:51.832 INFO:teuthology.orchestra.run.smithi102.stdout:5131 read 0x94d9e0a thru 0x94e6319 (0xc510 bytes) 2024-09-21T22:01:51.832 INFO:teuthology.orchestra.run.smithi102.stdout:5132 write 0x41b7d50 thru 0x41c7541 (0xf7f2 bytes) 2024-09-21T22:01:51.839 INFO:teuthology.orchestra.run.smithi102.stdout:5133 read 0x169139b thru 0x169db3d (0xc7a3 bytes) 2024-09-21T22:01:51.839 INFO:teuthology.orchestra.run.smithi102.stdout:5136 read 0xd5cf5d5 thru 0xd5d5395 (0x5dc1 bytes) 2024-09-21T22:01:51.839 INFO:teuthology.orchestra.run.smithi102.stdout:5137 read 0x42b0a8a thru 0x42b9970 (0x8ee7 bytes) 2024-09-21T22:01:51.854 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:51.859 INFO:teuthology.orchestra.run.smithi102.stdout:5138 trunc from 0xe8fa425 to 0xdb4dc4 2024-09-21T22:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:51.910 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:51.908+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:51.916 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:51.924 INFO:teuthology.orchestra.run.smithi102.stdout:5139 write 0xd3ea85b thru 0xd3f07b2 (0x5f58 bytes) 2024-09-21T22:01:51.929 INFO:teuthology.orchestra.run.smithi102.stdout:5140 punch from 0xb9f1f4c to 0xb9f24a5, (0x559 bytes) 2024-09-21T22:01:51.929 INFO:teuthology.orchestra.run.smithi102.stdout:5143 punch from 0x9f9a9d7 to 0x9fa423c, (0x9865 bytes) 2024-09-21T22:01:51.929 INFO:teuthology.orchestra.run.smithi102.stdout:5144 read 0xcd38df6 thru 0xcd48afb (0xfd06 bytes) 2024-09-21T22:01:51.929 INFO:teuthology.orchestra.run.smithi102.stdout:5145 write 0x6a543fd thru 0x6a63a0b (0xf60f bytes) 2024-09-21T22:01:51.935 INFO:teuthology.orchestra.run.smithi102.stdout:5146 writesame 0x62f1572 thru 0x6300ab1 data_size 0x6(0xf540 bytes) 2024-09-21T22:01:51.944 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:51.944 INFO:teuthology.orchestra.run.smithi102.stdout:5148 punch from 0x535cc90 to 0x536a66b, (0xd9db bytes) 2024-09-21T22:01:51.945 INFO:teuthology.orchestra.run.smithi102.stdout:5150 writesame 0x108c14 thru 0x117877 data_size 0x29(0xec64 bytes) 2024-09-21T22:01:51.947 INFO:teuthology.orchestra.run.smithi102.stdout:5152 write 0xa751ca0 thru 0xa75aef8 (0x9259 bytes) 2024-09-21T22:01:51.953 INFO:teuthology.orchestra.run.smithi102.stdout:5153 write 0xb9d803a thru 0xb9e1cfa (0x9cc1 bytes) 2024-09-21T22:01:51.958 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:01:51.958 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:01:51.958 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:01:51.958 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:01:51.958 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:01:51.959 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:01:51.959 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:01:51.959 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:01:51.959 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:01:51.959 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:01:51.959 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:01:51.959 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:01:51.959 INFO:teuthology.orchestra.run.smithi102.stdout:5154 write 0xa0406a0 thru 0xa04e66a (0xdfcb bytes) 2024-09-21T22:01:51.962 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:01:51.962 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:01:51.962 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-21T22:01:51.973 INFO:teuthology.orchestra.run.smithi102.stdout:5155 trunc from 0xd3f07b3 to 0xa24d066 2024-09-21T22:01:51.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:01:51.989 INFO:teuthology.orchestra.run.smithi102.stdout:5156 read 0x253e92f thru 0x25451f8 (0x68ca bytes) 2024-09-21T22:01:51.989 INFO:teuthology.orchestra.run.smithi102.stdout:5158 write 0xa11e730 thru 0xa124ab0 (0x6381 bytes) 2024-09-21T22:01:51.995 INFO:teuthology.orchestra.run.smithi102.stdout:5161 trunc from 0xa24d066 to 0x77b2d52 2024-09-21T22:01:52.010 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:52.008+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:52.019 INFO:teuthology.orchestra.run.smithi102.stdout:5163 write 0xd797fa4 thru 0xd7a0ab4 (0x8b11 bytes) 2024-09-21T22:01:52.026 INFO:teuthology.orchestra.run.smithi102.stdout:5164 punch from 0x576f08 to 0x585544, (0xe63c bytes) 2024-09-21T22:01:52.032 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:52.032 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:52.037 INFO:teuthology.orchestra.run.smithi102.stdout:5165 trunc from 0xd7a0ab5 to 0x49a2ce9 2024-09-21T22:01:52.053 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56953 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 425984~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7963728740000002, 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031605451, 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.054 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56953 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.15e-07 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254979+0000", 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6399999999999999e-06 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254984+0000", 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4099999999999999e-06 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254987+0000", 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.729e-06 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286387+0000", 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031400008 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286479+0000", 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1768999999999995e-05 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286580+0000", 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010148 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56954 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 655360~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7963573449999997, 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031833193000000003, 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.058 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56954 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254992+0000", 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1400000000000001e-06 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254995+0000", 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9629999999999998e-06 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254997+0000", 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3970000000000001e-06 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286623+0000", 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031626354000000002 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286715+0000", 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2120999999999994e-05 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286823+0000", 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107997 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.062 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56955 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 884736~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7963479710000003, 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032037574999999999, 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56955 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-07 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255001+0000", 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0419999999999999e-06 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255006+0000", 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255010+0000", 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8700000000000002e-06 2024-09-21T22:01:52.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286860+0000", 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031850695999999998 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286941+0000", 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0419000000000004e-05 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287037+0000", 2024-09-21T22:01:52.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6424999999999999e-05 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56956 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1114112~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255014+0000", 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7963332369999998, 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032238259999999998, 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56956 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255014+0000", 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255014+0000", 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255015+0000", 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255016+0000", 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.313e-06 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255019+0000", 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3239999999999999e-06 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255022+0000", 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.729e-06 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287082+0000", 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032060403000000001 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287159+0000", 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6859000000000004e-05 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287253+0000", 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3399000000000005e-05 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56957 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1343488~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:52.071 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7963229490000003, 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032466460000000003, 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56957 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0100000000000001e-07 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255026+0000", 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0690000000000001e-06 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255029+0000", 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8890000000000002e-06 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255031+0000", 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5359999999999999e-06 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287293+0000", 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032262093999999998 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287377+0000", 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3341e-05 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287491+0000", 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011433 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56958 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255034+0000", 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7963133710000001, 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032659301000000002, 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56958 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255034+0000", 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255034+0000", 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255035+0000", 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0199999999999998e-07 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255036+0000", 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.612e-06 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255041+0000", 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0220000000000004e-06 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255044+0000", 2024-09-21T22:01:52.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4729999999999999e-06 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287523+0000", 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032478928999999997 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287598+0000", 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5904999999999999e-05 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287694+0000", 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5057999999999997e-05 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56959 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1802240~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7963003969999995, 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032794619999999997, 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.080 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56959 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255049+0000", 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.15e-06 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255052+0000", 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5449999999999999e-06 2024-09-21T22:01:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255055+0000", 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5349999999999999e-06 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287722+0000", 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032667285999999997 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287784+0000", 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2235000000000003e-05 2024-09-21T22:01:52.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287842+0000", 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7648000000000001e-05 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56960 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7962903380000004, 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033013893000000002, 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.084 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56960 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:52.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255059+0000", 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.048e-06 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255062+0000", 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0189999999999998e-06 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255064+0000", 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.61e-06 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287888+0000", 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032823475999999997 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287968+0000", 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0339000000000004e-05 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288071+0000", 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000103199 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56975 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 212992~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255067+0000", 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7962803120000004, 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033221667000000003, 2024-09-21T22:01:52.088 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56975 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255067+0000", 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255067+0000", 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255068+0000", 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.65e-07 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255072+0000", 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7770000000000002e-06 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255078+0000", 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1500000000000004e-06 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255083+0000", 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7299999999999996e-06 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288111+0000", 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033027687999999999 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288190+0000", 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9065000000000003e-05 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288289+0000", 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8992000000000004e-05 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56976 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.092 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255089+0000", 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7962581479999997, 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033409467999999998, 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56976 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255089+0000", 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255089+0000", 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255090+0000", 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7700000000000004e-07 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255093+0000", 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3189999999999999e-06 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255100+0000", 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1589999999999998e-06 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255104+0000", 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6410000000000001e-06 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288327+0000", 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033222584999999999 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288404+0000", 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7646999999999997e-05 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288499+0000", 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4539999999999999e-05 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.096 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56977 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255112+0000", 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7962351820000002, 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033612184000000003, 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.097 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56977 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255112+0000", 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255112+0000", 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255113+0000", 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000004e-07 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255115+0000", 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1730000000000002e-06 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255122+0000", 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4710000000000004e-06 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255127+0000", 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7379999999999999e-06 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288540+0000", 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033412301999999998 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288622+0000", 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2194000000000006e-05 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288725+0000", 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102777 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56978 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255134+0000", 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7962133810000003, 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033806969999999999, 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.101 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56978 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255134+0000", 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255134+0000", 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255135+0000", 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255137+0000", 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3700000000000002e-06 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255143+0000", 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1190000000000002e-06 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255148+0000", 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4700000000000004e-06 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288785+0000", 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033637453999999997 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288854+0000", 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8898000000000003e-05 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288941+0000", 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7247e-05 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56979 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1130496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7961937710000004, 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033955731000000003, 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.105 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56979 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:52.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255157+0000", 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.356e-06 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255163+0000", 2024-09-21T22:01:52.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255168+0000", 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9130000000000002e-06 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288980+0000", 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033811255999999998 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289050+0000", 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0691999999999993e-05 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289110+0000", 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9271999999999998e-05 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56980 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:52.109 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7961698019999996, 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034096952, 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56980 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4999999999999998e-07 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255181+0000", 2024-09-21T22:01:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3099999999999999e-06 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255188+0000", 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1250000000000004e-06 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255193+0000", 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9060000000000001e-06 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289144+0000", 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033950928999999998 2024-09-21T22:01:52.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289204+0000", 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0544000000000002e-05 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289275+0000", 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0687999999999998e-05 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.113 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56981 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1589248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.796148638, 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034304860999999999, 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56981 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255202+0000", 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1639999999999999e-06 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255207+0000", 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9410000000000004e-06 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255212+0000", 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289317+0000", 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034105115999999998 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289399+0000", 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2094000000000004e-05 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289504+0000", 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010464299999999999 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56982 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7961305049999998, 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034446705000000001, 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56982 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255219+0000", 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4190000000000001e-06 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255222+0000", 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.281e-06 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255225+0000", 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5289999999999998e-06 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289536+0000", 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034311087999999997 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289597+0000", 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1359999999999995e-05 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289664+0000", 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6653e-05 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.121 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56983 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 2048000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255227+0000", 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7961202429999998, 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034580627000000003, 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.122 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56983 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255227+0000", 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255227+0000", 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255228+0000", 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1299999999999999e-07 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255229+0000", 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0759999999999999e-06 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255232+0000", 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.881e-06 2024-09-21T22:01:52.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255234+0000", 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3290000000000001e-06 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289682+0000", 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034448631 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289748+0000", 2024-09-21T22:01:52.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5464999999999997e-05 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289808+0000", 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0031999999999997e-05 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:57002 3.8 3:13575aeb:::rbd_data.112442ffa2ed.0000000000000007:24 [read 393216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.796110541, 2024-09-21T22:01:52.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034726911999999999, 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 57002 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:52.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255239+0000", 2024-09-21T22:01:52.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5650000000000001e-06 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255244+0000", 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1499999999999998e-06 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255248+0000", 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3599999999999998e-06 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289833+0000", 2024-09-21T22:01:52.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034584363999999999 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289891+0000", 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8561999999999999e-05 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289964+0000", 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2619000000000004e-05 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:57006 3.8 3:13575aeb:::rbd_data.112442ffa2ed.0000000000000007:24 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255254+0000", 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7960933739999998, 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034912427000000003, 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 57006 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255254+0000", 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255254+0000", 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255255+0000", 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255259+0000", 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8240000000000001e-06 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255265+0000", 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255269+0000", 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3100000000000002e-06 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289984+0000", 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034715357000000002 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290041+0000", 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7123000000000002e-05 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290167+0000", 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012530700000000001 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.134 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:57010 3.18 3:18405c99:::rbd_data.1124d06a34e4.000000000000000c:23 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255276+0000", 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.7960713330000004, 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034859288000000002, 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 57010 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.135 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255276+0000", 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255276+0000", 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255277+0000", 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255279+0000", 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1940000000000001e-06 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255285+0000", 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9349999999999999e-06 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255289+0000", 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4519999999999999e-06 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290003+0000", 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034713711000000001 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290067+0000", 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3944999999999998e-05 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290136+0000", 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8663000000000003e-05 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.138 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.139 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:52.139 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:52.139 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:52.139 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:52.139 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:52.139 INFO:teuthology.orchestra.run.smithi102.stdout:5167 write 0x57f8f1a thru 0x5806709 (0xd7f0 bytes) 2024-09-21T22:01:52.140 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:52.141 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.141 INFO:teuthology.orchestra.run.smithi102.stdout:5169 trunc from 0x580670a to 0x1c0b396 2024-09-21T22:01:52.141 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:52.142 INFO:teuthology.orchestra.run.smithi102.stdout:5170 read 0xd37cc1 thru 0xd44fbf (0xd2ff bytes) 2024-09-21T22:01:52.142 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.142 INFO:teuthology.orchestra.run.smithi102.stdout:5174 punch from 0xa9eb5e to 0xaa21b7, (0x3659 bytes) 2024-09-21T22:01:52.142 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:52.143 INFO:teuthology.orchestra.run.smithi102.stdout:5175 writesame 0x64fe450 thru 0x6500658 data_size 0x1(0x2209 bytes) 2024-09-21T22:01:52.143 INFO:teuthology.orchestra.run.smithi102.stdout:5176 write 0x27e0a09 thru 0x27ed022 (0xc61a bytes) 2024-09-21T22:01:52.143 INFO:teuthology.orchestra.run.smithi102.stdout:5179 trunc from 0x6500659 to 0x2615223 2024-09-21T22:01:52.145 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:52.146 INFO:teuthology.orchestra.run.smithi102.stdout:5185 writesame 0xaa15ba2 thru 0xaa239d1 data_size 0x9e(0xde30 bytes) 2024-09-21T22:01:52.147 INFO:teuthology.orchestra.run.smithi102.stdout:5186 punch from 0x39509bb to 0x3954ee9, (0x452e bytes) 2024-09-21T22:01:52.147 INFO:teuthology.orchestra.run.smithi102.stdout:5187 writesame 0xd36a827 thru 0xd36dc83 data_size 0x7(0x345d bytes) 2024-09-21T22:01:52.147 INFO:teuthology.orchestra.run.smithi102.stdout:5188 read 0xa45732a thru 0xa45764d (0x324 bytes) 2024-09-21T22:01:52.147 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.147 INFO:teuthology.orchestra.run.smithi102.stdout:5191 write 0x79a2ecc thru 0x79a969a (0x67cf bytes) 2024-09-21T22:01:52.147 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:52.147 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:52.148 INFO:teuthology.orchestra.run.smithi102.stdout:5193 write 0x605f190 thru 0x6062a5b (0x38cc bytes) 2024-09-21T22:01:52.148 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:52.143+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:52.153 INFO:teuthology.orchestra.run.smithi102.stdout:5194 read 0x92d3ccb thru 0x92d7f81 (0x42b7 bytes) 2024-09-21T22:01:52.153 INFO:teuthology.orchestra.run.smithi102.stdout:5195 read 0x6fe85be thru 0x6ff5fe6 (0xda29 bytes) 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:01:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:01:52.170 INFO:teuthology.orchestra.run.smithi102.stdout:5196 trunc from 0xd36dc84 to 0xdd5d7c 2024-09-21T22:01:52.172 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:01:52.172 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:01:52.173 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-21T22:01:52.174 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:52.193 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:52.198 INFO:teuthology.orchestra.run.smithi102.stdout:5197 write 0x21c3a65 thru 0x21cbc19 (0x81b5 bytes) 2024-09-21T22:01:52.204 INFO:teuthology.orchestra.run.smithi102.stdout:5198 read 0x14fd5d6 thru 0x150892c (0xb357 bytes) 2024-09-21T22:01:52.204 INFO:teuthology.orchestra.run.smithi102.stdout:5199 read 0x1f3e81e thru 0x1f4c35b (0xdb3e bytes) 2024-09-21T22:01:52.204 INFO:teuthology.orchestra.run.smithi102.stdout:5200 write 0x1a87b thru 0x2047c (0x5c02 bytes) 2024-09-21T22:01:52.207 INFO:teuthology.orchestra.run.smithi102.stdout:5202 punch from 0x209dac9 to 0x20ac4a4, (0xe9db bytes) 2024-09-21T22:01:52.221 INFO:teuthology.orchestra.run.smithi102.stdout:5203 write 0x8db3e4a thru 0x8db953c (0x56f3 bytes) 2024-09-21T22:01:52.226 INFO:teuthology.orchestra.run.smithi102.stdout:5204 write 0xf2e2b4 thru 0xf3a3ea (0xc137 bytes) 2024-09-21T22:01:52.230 INFO:teuthology.orchestra.run.smithi102.stdout:5205 punch from 0x471d97d to 0x471fc99, (0x231c bytes) 2024-09-21T22:01:52.240 INFO:teuthology.orchestra.run.smithi102.stdout:5206 write 0xd57422d thru 0xd578f55 (0x4d29 bytes) 2024-09-21T22:01:52.244 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:52.243+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:52.251 INFO:teuthology.orchestra.run.smithi102.stdout:5207 write 0x5313e98 thru 0x531902e (0x5197 bytes) 2024-09-21T22:01:52.255 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:52.256 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:52.259 INFO:teuthology.orchestra.run.smithi102.stdout:5208 write 0xe5cdac thru 0xe67540 (0xa795 bytes) 2024-09-21T22:01:52.262 INFO:teuthology.orchestra.run.smithi102.stdout:5211 read 0x8931100 thru 0x893e5f1 (0xd4f2 bytes) 2024-09-21T22:01:52.262 INFO:teuthology.orchestra.run.smithi102.stdout:5212 write 0x869b1be thru 0x869f664 (0x44a7 bytes) 2024-09-21T22:01:52.265 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:52.267 INFO:teuthology.orchestra.run.smithi102.stdout:5213 write 0xcb685ab thru 0xcb69107 (0xb5d bytes) 2024-09-21T22:01:52.270 INFO:teuthology.orchestra.run.smithi102.stdout:5214 read 0xc266969 thru 0xc2762be (0xf956 bytes) 2024-09-21T22:01:52.270 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.271 INFO:teuthology.orchestra.run.smithi102.stdout:5216 read 0xbb6ac51 thru 0xbb772c4 (0xc674 bytes) 2024-09-21T22:01:52.271 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.271 INFO:teuthology.orchestra.run.smithi102.stdout:5220 read 0xd45097e thru 0xd4523f4 (0x1a77 bytes) 2024-09-21T22:01:52.271 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.271 INFO:teuthology.orchestra.run.smithi102.stdout:5222 write 0x3278c6b thru 0x327d64a (0x49e0 bytes) 2024-09-21T22:01:52.274 INFO:teuthology.orchestra.run.smithi102.stdout:5223 read 0xa53e02b thru 0xa53e1e6 (0x1bc bytes) 2024-09-21T22:01:52.274 INFO:teuthology.orchestra.run.smithi102.stdout:5225 write 0x8294834 thru 0x829e8f3 (0xa0c0 bytes) 2024-09-21T22:01:52.275 INFO:teuthology.orchestra.run.smithi102.stdout:5226 read 0x82b0c23 thru 0x82b8635 (0x7a13 bytes) 2024-09-21T22:01:52.276 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.281 INFO:teuthology.orchestra.run.smithi102.stdout:5230 writesame 0xdec37af thru 0xdec59d6 data_size 0x4(0x2228 bytes) 2024-09-21T22:01:52.281 INFO:teuthology.orchestra.run.smithi102.stdout:5231 trunc from 0xdec59d7 to 0xe2939e4 2024-09-21T22:01:52.286 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.286 INFO:teuthology.orchestra.run.smithi102.stdout:5233 read 0x8167b49 thru 0x8173416 (0xb8ce bytes) 2024-09-21T22:01:52.287 INFO:teuthology.orchestra.run.smithi102.stdout:5234 writesame 0x55e5850 thru 0x55e96e8 data_size 0x5(0x3e99 bytes) 2024-09-21T22:01:52.295 INFO:teuthology.orchestra.run.smithi102.stdout:5236 trunc from 0xe2939e4 to 0x9985089 2024-09-21T22:01:52.305 INFO:teuthology.orchestra.run.smithi102.stdout:5238 writesame 0x42629eb thru 0x426d928 data_size 0x3(0xaf3e bytes) 2024-09-21T22:01:52.314 INFO:teuthology.orchestra.run.smithi102.stdout:5240 write 0x6d2126a thru 0x6d27592 (0x6329 bytes) 2024-09-21T22:01:52.322 INFO:teuthology.orchestra.run.smithi102.stdout:5241 write 0x8140104 thru 0x8142fbc (0x2eb9 bytes) 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:01:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:01:52.324 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:01:52.324 INFO:teuthology.orchestra.run.smithi102.stdout:5243 write 0x4c9ebd3 thru 0x4ca941b (0xa849 bytes) 2024-09-21T22:01:52.325 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:01:52.326 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:01:52.326 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-21T22:01:52.338 INFO:teuthology.orchestra.run.smithi102.stdout:5246 write 0xa20e23d thru 0xa20f082 (0xe46 bytes) 2024-09-21T22:01:52.349 INFO:teuthology.orchestra.run.smithi102.stdout:5247 write 0xb7e1938 thru 0xb7e7c96 (0x635f bytes) 2024-09-21T22:01:52.350 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:52.348+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:52.353 INFO:teuthology.orchestra.run.smithi102.stdout:5248 writesame 0x77b12b5 thru 0x77b783b data_size 0x7(0x6587 bytes) 2024-09-21T22:01:52.358 INFO:teuthology.orchestra.run.smithi102.stdout:5252 punch from 0xaeb3f34 to 0xaebe09c, (0xa168 bytes) 2024-09-21T22:01:52.358 INFO:teuthology.orchestra.run.smithi102.stdout:5253 writesame 0xa2798b5 thru 0xa27e2b4 data_size 0x20(0x4a00 bytes) 2024-09-21T22:01:52.361 INFO:teuthology.orchestra.run.smithi102.stdout:5255 read 0xb53e4d0 thru 0xb547ed3 (0x9a04 bytes) 2024-09-21T22:01:52.361 INFO:teuthology.orchestra.run.smithi102.stdout:5256 punch from 0x7e5eb6f to 0x7e6379e, (0x4c2f bytes) 2024-09-21T22:01:52.361 INFO:teuthology.orchestra.run.smithi102.stdout:5257 write 0x300c1c8 thru 0x301089b (0x46d4 bytes) 2024-09-21T22:01:52.364 INFO:teuthology.orchestra.run.smithi102.stdout:5258 read 0x431adac thru 0x43266a5 (0xb8fa bytes) 2024-09-21T22:01:52.373 INFO:teuthology.orchestra.run.smithi102.stdout:5259 write 0xcc0fd87 thru 0xcc16483 (0x66fd bytes) 2024-09-21T22:01:52.383 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.383 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.383 INFO:teuthology.orchestra.run.smithi102.stdout:5264 write 0x535f025 thru 0x5367ea6 (0x8e82 bytes) 2024-09-21T22:01:52.384 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.385 INFO:teuthology.orchestra.run.smithi102.stdout:5266 writesame 0x6b6bf27 thru 0x6b6ecbc data_size 0xf(0x2d96 bytes) 2024-09-21T22:01:52.389 INFO:teuthology.orchestra.run.smithi102.stdout:5270 read 0x54ad267 thru 0x54b5d3e (0x8ad8 bytes) 2024-09-21T22:01:52.390 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.390 INFO:teuthology.orchestra.run.smithi102.stdout:5274 writesame 0x4246387 thru 0x4254fd2 data_size 0xc(0xec4c bytes) 2024-09-21T22:01:52.398 INFO:teuthology.orchestra.run.smithi102.stdout:5275 write 0x5a611c7 thru 0x5a647b0 (0x35ea bytes) 2024-09-21T22:01:52.401 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.401 INFO:teuthology.orchestra.run.smithi102.stdout:5277 writesame 0x72e3290 thru 0x72f325f data_size 0x8(0xffd0 bytes) 2024-09-21T22:01:52.413 INFO:teuthology.orchestra.run.smithi102.stdout:5278 write 0xe9263b0 thru 0xe92a8c0 (0x4511 bytes) 2024-09-21T22:01:52.424 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:52.424 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:52.428 INFO:teuthology.orchestra.run.smithi102.stdout:5279 trunc from 0xe92a8c1 to 0x69f1bb5 2024-09-21T22:01:52.434 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:52.449 INFO:teuthology.orchestra.run.smithi102.stdout:5280 read 0x547175c thru 0x547d1dc (0xba81 bytes) 2024-09-21T22:01:52.457 INFO:teuthology.orchestra.run.smithi102.stdout:5281 trunc from 0x69f1bb5 to 0xcb8b357 2024-09-21T22:01:52.464 INFO:teuthology.orchestra.run.smithi102.stdout:5284 write 0xbfe596a thru 0xbfea981 (0x5018 bytes) 2024-09-21T22:01:52.470 INFO:teuthology.orchestra.run.smithi102.stdout:5290 trunc from 0xcb8b357 to 0xd9989b4 2024-09-21T22:01:52.476 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:52.474+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:52.477 INFO:teuthology.orchestra.run.smithi102.stdout:5291 trunc from 0xd9989b4 to 0xdc820e6 2024-09-21T22:01:52.480 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:01:52.480 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:01:52.480 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:01:52.480 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:01:52.480 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:01:52.480 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:01:52.480 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:01:52.481 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:01:52.481 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:01:52.481 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:01:52.481 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:01:52.481 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:01:52.483 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:01:52.483 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:01:52.483 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-21T22:01:52.484 INFO:teuthology.orchestra.run.smithi102.stdout:5292 read 0x9622338 thru 0x962ece2 (0xc9ab bytes) 2024-09-21T22:01:52.484 INFO:teuthology.orchestra.run.smithi102.stdout:5294 write 0x979a5bd thru 0x979dbf1 (0x3635 bytes) 2024-09-21T22:01:52.488 INFO:teuthology.orchestra.run.smithi102.stdout:5295 read 0x16495eb thru 0x1649b67 (0x57d bytes) 2024-09-21T22:01:52.488 INFO:teuthology.orchestra.run.smithi102.stdout:5296 write 0x180f90e thru 0x1812482 (0x2b75 bytes) 2024-09-21T22:01:52.490 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:52.494 INFO:teuthology.orchestra.run.smithi102.stdout:5299 write 0xde67bea thru 0xde6e914 (0x6d2b bytes) 2024-09-21T22:01:52.500 INFO:teuthology.orchestra.run.smithi102.stdout:5300 read 0xabb1998 thru 0xabb5831 (0x3e9a bytes) 2024-09-21T22:01:52.500 INFO:teuthology.orchestra.run.smithi102.stdout:5302 write 0x12fe43b thru 0x1305248 (0x6e0e bytes) 2024-09-21T22:01:52.508 INFO:teuthology.orchestra.run.smithi102.stdout:5303 write 0xeb519f2 thru 0xeb5afce (0x95dd bytes) 2024-09-21T22:01:52.518 INFO:teuthology.orchestra.run.smithi102.stdout:5304 punch from 0x3edf9bb to 0x3eebedd, (0xc522 bytes) 2024-09-21T22:01:52.518 INFO:teuthology.orchestra.run.smithi102.stdout:5305 write 0x28e2002 thru 0x28e9bb4 (0x7bb3 bytes) 2024-09-21T22:01:52.520 INFO:teuthology.orchestra.run.smithi102.stdout:5306 write 0xc6e0e71 thru 0xc6e5867 (0x49f7 bytes) 2024-09-21T22:01:52.526 INFO:teuthology.orchestra.run.smithi102.stdout:5307 writesame 0x917d87a thru 0x9184cc2 data_size 0x1(0x7449 bytes) 2024-09-21T22:01:52.539 INFO:teuthology.orchestra.run.smithi102.stdout:5308 read 0xb8f0f1a thru 0xb9007b2 (0xf899 bytes) 2024-09-21T22:01:52.540 INFO:teuthology.orchestra.run.smithi102.stdout:5309 punch from 0x51bf336 to 0x51cbce8, (0xc9b2 bytes) 2024-09-21T22:01:52.540 INFO:teuthology.orchestra.run.smithi102.stdout:5310 writesame 0x76c1f98 thru 0x76cf144 data_size 0x1(0xd1ad bytes) 2024-09-21T22:01:52.546 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:52.544+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:52.556 INFO:teuthology.orchestra.run.smithi102.stdout:5311 read 0x62ca2fe thru 0x62d30ee (0x8df1 bytes) 2024-09-21T22:01:52.556 INFO:teuthology.orchestra.run.smithi102.stdout:5314 writesame 0x9ff59a thru 0xa01888 data_size 0xb(0x22ef bytes) 2024-09-21T22:01:52.558 INFO:teuthology.orchestra.run.smithi102.stdout:5317 read 0x5d17777 thru 0x5d1ab47 (0x33d1 bytes) 2024-09-21T22:01:52.559 INFO:teuthology.orchestra.run.smithi102.stdout:5318 write 0xe28fc17 thru 0xe29855b (0x8945 bytes) 2024-09-21T22:01:52.565 INFO:teuthology.orchestra.run.smithi102.stdout:5319 write 0x4b26a2c thru 0x4b2864b (0x1c20 bytes) 2024-09-21T22:01:52.571 INFO:teuthology.orchestra.run.smithi102.stdout:5320 clone 38 order 20 su 131072 sc 10 2024-09-21T22:01:52.590 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:52.591 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:52.599 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:01:52.625 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:01:52.628 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:01:52.628 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:01:52.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-21T22:01:52.684 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:52.682+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:52.743 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:52.743 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:52.748 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:52.746+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:52.751 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:52.798 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:01:52.798 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:01:52.798 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:01:52.799 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:01:52.799 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:01:52.799 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:01:52.799 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:01:52.799 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:01:52.799 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:01:52.799 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:01:52.799 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:01:52.799 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:01:52.801 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:01:52.801 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:01:52.849 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:52.848+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:52.895 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:52.895 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:52.904 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:01:52.989 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:52.987+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:53.049 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone37 from 0xeb5afcf (overlap 0xdb4dc4) to 0x0 2024-09-21T22:01:53.052 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:53.050+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:53.055 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:53.055 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:53.067 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:53.141 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-21T22:01:53.152 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:53.150+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:53.236 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:53.237 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:53.249 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:53.253 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:53.251+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:53.302 INFO:teuthology.orchestra.run.smithi102.stdout:5321 read 0xc2c5f26 thru 0xc2d1bd2 (0xbcad bytes) 2024-09-21T22:01:53.306 INFO:teuthology.orchestra.run.smithi102.stdout:5322 write 0xd28175b thru 0xd286afb (0x53a1 bytes) 2024-09-21T22:01:53.318 INFO:teuthology.orchestra.run.smithi102.stdout:5323 trunc from 0xeb5afcf to 0xafde95c 2024-09-21T22:01:53.348 INFO:teuthology.orchestra.run.smithi102.stdout:5324 writesame 0x4ac09a5 thru 0x4aceb19 data_size 0x35(0xe175 bytes) 2024-09-21T22:01:53.354 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:53.352+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:53.355 INFO:teuthology.orchestra.run.smithi102.stdout:5325 write 0xa8a68c3 thru 0xa8ab3c1 (0x4aff bytes) 2024-09-21T22:01:53.358 INFO:teuthology.orchestra.run.smithi102.stdout:5327 write 0x470941f thru 0x4713e15 (0xa9f7 bytes) 2024-09-21T22:01:53.359 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:53.359 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:53.360 INFO:teuthology.orchestra.run.smithi102.stdout:5328 write 0x6eeac3e thru 0x6eedffd (0x33c0 bytes) 2024-09-21T22:01:53.365 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:53.368 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:53.373 INFO:teuthology.orchestra.run.smithi102.stdout:5331 trunc from 0xafde95c to 0x4b2b32b 2024-09-21T22:01:53.409 INFO:teuthology.orchestra.run.smithi102.stdout:5332 punch from 0x3e5ed6d to 0x3e66243, (0x74d6 bytes) 2024-09-21T22:01:53.418 INFO:teuthology.orchestra.run.smithi102.stdout:5333 writesame 0x855ae09 thru 0x8565fa5 data_size 0x1(0xb19d bytes) 2024-09-21T22:01:53.418 INFO:teuthology.orchestra.run.smithi102.stdout:5334 punch from 0x6b1cd32 to 0x6b201da, (0x34a8 bytes) 2024-09-21T22:01:53.426 INFO:teuthology.orchestra.run.smithi102.stdout:5335 write 0xad771ca thru 0xad848f5 (0xd72c bytes) 2024-09-21T22:01:53.430 INFO:teuthology.orchestra.run.smithi102.stdout:5336 punch from 0x5d48ea9 to 0x5d54b95, (0xbcec bytes) 2024-09-21T22:01:53.430 INFO:teuthology.orchestra.run.smithi102.stdout:5337 punch from 0x22895b2 to 0x228e15d, (0x4bab bytes) 2024-09-21T22:01:53.430 INFO:teuthology.orchestra.run.smithi102.stdout:5338 writesame 0x4bd9915 thru 0x4bdb9c7 data_size 0x1(0x20b3 bytes) 2024-09-21T22:01:53.434 INFO:teuthology.orchestra.run.smithi102.stdout:5340 write 0xa4350cc thru 0xa43575c (0x691 bytes) 2024-09-21T22:01:53.441 INFO:teuthology.orchestra.run.smithi102.stdout:5341 trunc from 0xad848f6 to 0xe92a836 2024-09-21T22:01:53.448 INFO:teuthology.orchestra.run.smithi102.stdout:5343 punch from 0x3dd8934 to 0x3de0ad7, (0x81a3 bytes) 2024-09-21T22:01:53.448 INFO:teuthology.orchestra.run.smithi102.stdout:5344 write 0x845da00 thru 0x845faad (0x20ae bytes) 2024-09-21T22:01:53.451 INFO:teuthology.orchestra.run.smithi102.stdout:5345 write 0x354cbd6 thru 0x355b730 (0xeb5b bytes) 2024-09-21T22:01:53.455 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:53.453+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:53.456 INFO:teuthology.orchestra.run.smithi102.stdout:5348 write 0xfb5676 thru 0xfb88ae (0x3239 bytes) 2024-09-21T22:01:53.466 INFO:teuthology.orchestra.run.smithi102.stdout:5349 write 0xc4268ce thru 0xc42cf34 (0x6667 bytes) 2024-09-21T22:01:53.469 INFO:teuthology.orchestra.run.smithi102.stdout:5351 punch from 0xc8827f to 0xc91252, (0x8fd3 bytes) 2024-09-21T22:01:53.470 INFO:teuthology.orchestra.run.smithi102.stdout:5352 write 0xac69d15 thru 0xac73033 (0x931f bytes) 2024-09-21T22:01:53.472 INFO:teuthology.orchestra.run.smithi102.stdout:5353 punch from 0xa46e97 to 0xa4b138, (0x42a1 bytes) 2024-09-21T22:01:53.473 INFO:teuthology.orchestra.run.smithi102.stdout:5354 read 0xd6a4a90 thru 0xd6a72a2 (0x2813 bytes) 2024-09-21T22:01:53.473 INFO:teuthology.orchestra.run.smithi102.stdout:5355 write 0x9baa196 thru 0x9bb57f5 (0xb660 bytes) 2024-09-21T22:01:53.475 INFO:teuthology.orchestra.run.smithi102.stdout:5356 read 0x2efd57b thru 0x2eff2f3 (0x1d79 bytes) 2024-09-21T22:01:53.476 INFO:teuthology.orchestra.run.smithi102.stdout:5357 write 0x2ce866e thru 0x2cf180f (0x91a2 bytes) 2024-09-21T22:01:53.483 INFO:teuthology.orchestra.run.smithi102.stdout:5359 write 0x2c7b5ae thru 0x2c7b960 (0x3b3 bytes) 2024-09-21T22:01:53.484 INFO:teuthology.orchestra.run.smithi102.stdout:5360 write 0xaf60dcb thru 0xaf64f44 (0x417a bytes) 2024-09-21T22:01:53.487 INFO:teuthology.orchestra.run.smithi102.stdout:5361 read 0x42608b3 thru 0x42654b7 (0x4c05 bytes) 2024-09-21T22:01:53.487 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:53.487 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:53.488 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:53.488 INFO:teuthology.orchestra.run.smithi102.stdout:5363 write 0x979a5a9 thru 0x979b755 (0x11ad bytes) 2024-09-21T22:01:53.492 INFO:teuthology.orchestra.run.smithi102.stdout:5364 writesame 0x187d9dc thru 0x1888829 data_size 0x3(0xae4e bytes) 2024-09-21T22:01:53.499 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:53.501 INFO:teuthology.orchestra.run.smithi102.stdout:5365 read 0xe89f79 thru 0xe8c9b3 (0x2a3b bytes) 2024-09-21T22:01:53.502 INFO:teuthology.orchestra.run.smithi102.stdout:5367 read 0x58fe55f thru 0x5905f4b (0x79ed bytes) 2024-09-21T22:01:53.502 INFO:teuthology.orchestra.run.smithi102.stdout:5368 write 0x75de96d thru 0x75e7f0e (0x95a2 bytes) 2024-09-21T22:01:53.508 INFO:teuthology.orchestra.run.smithi102.stdout:5369 read 0xc0885b0 thru 0xc0932d5 (0xad26 bytes) 2024-09-21T22:01:53.508 INFO:teuthology.orchestra.run.smithi102.stdout:5370 write 0x109ba90 thru 0x109eb63 (0x30d4 bytes) 2024-09-21T22:01:53.516 INFO:teuthology.orchestra.run.smithi102.stdout:5371 write 0xad54b62 thru 0xad6004f (0xb4ee bytes) 2024-09-21T22:01:53.535 INFO:teuthology.orchestra.run.smithi102.stdout:5373 trunc from 0xe92a836 to 0xf80aa6 2024-09-21T22:01:53.555 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:53.553+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:53.587 INFO:teuthology.orchestra.run.smithi102.stdout:5374 trunc from 0xf80aa6 to 0x7a562a4 2024-09-21T22:01:53.592 INFO:teuthology.orchestra.run.smithi102.stdout:5375 read 0x735335a thru 0x735f3ec (0xc093 bytes) 2024-09-21T22:01:53.600 INFO:teuthology.orchestra.run.smithi102.stdout:5376 writesame 0x92b85eb thru 0x92c342c data_size 0xf(0xae42 bytes) 2024-09-21T22:01:53.600 INFO:teuthology.orchestra.run.smithi102.stdout:5377 read 0x46acd2b thru 0x46b06ec (0x39c2 bytes) 2024-09-21T22:01:53.606 INFO:teuthology.orchestra.run.smithi102.stdout:5378 trunc from 0x92c342d to 0x4137c38 2024-09-21T22:01:53.623 INFO:teuthology.orchestra.run.smithi102.stdout:5380 write 0x7706847 thru 0x7707fb3 (0x176d bytes) 2024-09-21T22:01:53.635 INFO:teuthology.orchestra.run.smithi102.stdout:5381 write 0x9513862 thru 0x951b050 (0x77ef bytes) 2024-09-21T22:01:53.643 INFO:teuthology.orchestra.run.smithi102.stdout:5382 trunc from 0x951b051 to 0xc803a2f 2024-09-21T22:01:53.648 INFO:teuthology.orchestra.run.smithi102.stdout:5383 read 0x63d361d thru 0x63d3e27 (0x80b bytes) 2024-09-21T22:01:53.648 INFO:teuthology.orchestra.run.smithi102.stdout:5385 write 0x3004b85 thru 0x3013ca3 (0xf11f bytes) 2024-09-21T22:01:53.652 INFO:teuthology.orchestra.run.smithi102.stdout:5386 read 0x42e8881 thru 0x42ec5e0 (0x3d60 bytes) 2024-09-21T22:01:53.653 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:53.653 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:53.656 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:53.654+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:53.659 INFO:teuthology.orchestra.run.smithi102.stdout:5387 write 0xd23033b thru 0xd232412 (0x20d8 bytes) 2024-09-21T22:01:53.662 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:53.662 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:53.667 INFO:teuthology.orchestra.run.smithi102.stdout:5390 trunc from 0xd232413 to 0x89ac245 2024-09-21T22:01:53.686 INFO:teuthology.orchestra.run.smithi102.stdout:5392 trunc from 0x89ac245 to 0xdd3016 2024-09-21T22:01:53.698 INFO:teuthology.orchestra.run.smithi102.stdout:5394 punch from 0xb2c42b to 0xb30d08, (0x48dd bytes) 2024-09-21T22:01:53.699 INFO:teuthology.orchestra.run.smithi102.stdout:5395 read 0x64ce78 thru 0x64d84a (0x9d3 bytes) 2024-09-21T22:01:53.699 INFO:teuthology.orchestra.run.smithi102.stdout:5398 read 0x9fef7a thru 0xa007f5 (0x187c bytes) 2024-09-21T22:01:53.703 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:53.704 INFO:teuthology.orchestra.run.smithi102.stdout:5400 trunc from 0xdd3016 to 0x16bef32 2024-09-21T22:01:53.727 INFO:teuthology.orchestra.run.smithi102.stdout:5401 trunc from 0x16bef32 to 0x62fe5b6 2024-09-21T22:01:53.733 INFO:teuthology.orchestra.run.smithi102.stdout:5402 writesame 0x2398d54 thru 0x23a746f data_size 0xe(0xe71c bytes) 2024-09-21T22:01:53.737 INFO:teuthology.orchestra.run.smithi102.stdout:5403 read 0x5c44260 thru 0x5c4e997 (0xa738 bytes) 2024-09-21T22:01:53.738 INFO:teuthology.orchestra.run.smithi102.stdout:5404 write 0x501cd3c thru 0x50259b2 (0x8c77 bytes) 2024-09-21T22:01:53.741 INFO:teuthology.orchestra.run.smithi102.stdout:5405 read 0x62a8189 thru 0x62b7260 (0xf0d8 bytes) 2024-09-21T22:01:53.752 INFO:teuthology.orchestra.run.smithi102.stdout:5406 write 0xaabd84f thru 0xaabe7ce (0xf80 bytes) 2024-09-21T22:01:53.755 INFO:teuthology.orchestra.run.smithi102.stdout:5407 read 0x210f6b2 thru 0x211b65b (0xbfaa bytes) 2024-09-21T22:01:53.756 INFO:teuthology.orchestra.run.smithi102.stdout:5408 write 0x5bf21fd thru 0x5bfd1ac (0xafb0 bytes) 2024-09-21T22:01:53.756 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:53.755+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:53.760 INFO:teuthology.orchestra.run.smithi102.stdout:5409 writesame 0x682516e thru 0x683191a data_size 0xb(0xc7ad bytes) 2024-09-21T22:01:53.769 INFO:teuthology.orchestra.run.smithi102.stdout:5410 writesame 0xad170ce thru 0xad221ca data_size 0xb(0xb0fd bytes) 2024-09-21T22:01:53.771 INFO:teuthology.orchestra.run.smithi102.stdout:5412 read 0x6245f0d thru 0x624f2c2 (0x93b6 bytes) 2024-09-21T22:01:53.771 INFO:teuthology.orchestra.run.smithi102.stdout:5414 writesame 0x22b46 thru 0x23987 data_size 0x19(0xe42 bytes) 2024-09-21T22:01:53.779 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:53.779 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:53.781 INFO:teuthology.orchestra.run.smithi102.stdout:5415 punch from 0xb448be to 0xb45516, (0xc58 bytes) 2024-09-21T22:01:53.782 INFO:teuthology.orchestra.run.smithi102.stdout:5416 read 0xa9e5ea2 thru 0xa9edc72 (0x7dd1 bytes) 2024-09-21T22:01:53.782 INFO:teuthology.orchestra.run.smithi102.stdout:5419 clone 39 order 18 su 8192 sc 7 2024-09-21T22:01:53.788 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:53.858 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:53.856+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:53.892 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:53.892 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:53.900 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:53.959 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:53.957+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:54.007 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:54.008 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:54.017 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:54.060 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:54.058+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:54.073 INFO:teuthology.orchestra.run.smithi102.stdout:leaving image image_client.0-clone38 intact 2024-09-21T22:01:54.126 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:54.126 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:54.136 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:54.178 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:54.176+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:54.208 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:54.212 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-21T22:01:54.235 INFO:teuthology.orchestra.run.smithi102.stdout:5420 write 0xe28dba0 thru 0xe290b83 (0x2fe4 bytes) 2024-09-21T22:01:54.243 INFO:teuthology.orchestra.run.smithi102.stdout:5421 read 0x7ab296f thru 0x7ab7826 (0x4eb8 bytes) 2024-09-21T22:01:54.243 INFO:teuthology.orchestra.run.smithi102.stdout:5422 write 0x3c20aa thru 0x3cc465 (0xa3bc bytes) 2024-09-21T22:01:54.261 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:54.259+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:54.268 INFO:teuthology.orchestra.run.smithi102.stdout:5424 writesame 0x399d54f thru 0x39a2569 data_size 0x1(0x501b bytes) 2024-09-21T22:01:54.278 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:54.278 INFO:teuthology.orchestra.run.smithi102.stdout:5426 read 0x40c218b thru 0x40c6e18 (0x4c8e bytes) 2024-09-21T22:01:54.278 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:54.278 INFO:teuthology.orchestra.run.smithi102.stdout:5428 read 0x9de9e3 thru 0x9df904 (0xf22 bytes) 2024-09-21T22:01:54.280 INFO:teuthology.orchestra.run.smithi102.stdout:5430 write 0xd750901 thru 0xd7577c0 (0x6ec0 bytes) 2024-09-21T22:01:54.290 INFO:teuthology.orchestra.run.smithi102.stdout:5432 read 0x6cfa1ce thru 0x6cfe2ef (0x4122 bytes) 2024-09-21T22:01:54.290 INFO:teuthology.orchestra.run.smithi102.stdout:5433 writesame 0x6b6378e thru 0x6b732b9 data_size 0x32(0xfb2c bytes) 2024-09-21T22:01:54.308 INFO:teuthology.orchestra.run.smithi102.stdout:5435 write 0xe2343b9 thru 0xe239077 (0x4cbf bytes) 2024-09-21T22:01:54.309 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:54.309 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:54.316 INFO:teuthology.orchestra.run.smithi102.stdout:5437 write 0x11d8356 thru 0x11dfbba (0x7865 bytes) 2024-09-21T22:01:54.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:54.341 INFO:teuthology.orchestra.run.smithi102.stdout:5438 trunc from 0xe290b84 to 0x60936af 2024-09-21T22:01:54.361 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:54.359+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:54.369 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:54.369 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:54.372 INFO:teuthology.orchestra.run.smithi102.stdout:5439 read 0x2780c5f thru 0x2781941 (0xce3 bytes) 2024-09-21T22:01:54.387 INFO:teuthology.orchestra.run.smithi102.stdout:5440 writesame 0xce3190e thru 0xce35682 data_size 0x1(0x3d75 bytes) 2024-09-21T22:01:54.389 INFO:teuthology.orchestra.run.smithi102.stdout:5441 trunc from 0xce35683 to 0xb388dbf 2024-09-21T22:01:54.389 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:54.389 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:54.394 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:54.395 INFO:teuthology.orchestra.run.smithi102.stdout:5443 writesame 0x93a3ab8 thru 0x93b0861 data_size 0x41(0xcdaa bytes) 2024-09-21T22:01:54.404 INFO:teuthology.orchestra.run.smithi102.stdout:5444 read 0xa519c9 thru 0xa54e6b (0x34a3 bytes) 2024-09-21T22:01:54.414 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:54.415 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:54.422 INFO:teuthology.orchestra.run.smithi102.stdout:5445 write 0xc453ed2 thru 0xc45db5f (0x9c8e bytes) 2024-09-21T22:01:54.435 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:54.439 INFO:teuthology.orchestra.run.smithi102.stdout:5446 writesame 0xd50913f thru 0xd51062e data_size 0x8(0x74f0 bytes) 2024-09-21T22:01:54.439 INFO:teuthology.orchestra.run.smithi102.stdout:5447 writesame 0xa822108 thru 0xa8232fc data_size 0x1(0x11f5 bytes) 2024-09-21T22:01:54.444 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:54.444 INFO:teuthology.orchestra.run.smithi102.stdout:5449 write 0x9baa0bc thru 0x9bb9d16 (0xfc5b bytes) 2024-09-21T22:01:54.458 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:54.462 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:54.460+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:54.471 INFO:teuthology.orchestra.run.smithi102.stdout:5450 trunc from 0xd51062f to 0x219a85c 2024-09-21T22:01:54.477 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:54.477 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:54.482 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:54.482 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:54.482 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:54.482 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:54.494 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:54.501 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:54.501 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:54.510 INFO:teuthology.orchestra.run.smithi102.stdout:5451 read 0x1ff8311 thru 0x1ff973d (0x142d bytes) 2024-09-21T22:01:54.511 INFO:teuthology.orchestra.run.smithi102.stdout:5452 read 0x1fdd5b4 thru 0x1fe927c (0xbcc9 bytes) 2024-09-21T22:01:54.523 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:54.524 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:54.535 INFO:teuthology.orchestra.run.smithi102.stdout:5453 write 0x2304cdd thru 0x230f18a (0xa4ae bytes) 2024-09-21T22:01:54.546 INFO:teuthology.orchestra.run.smithi102.stdout:5454 write 0x1f6c33c thru 0x1f77acb (0xb790 bytes) 2024-09-21T22:01:54.562 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:54.560+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:54.574 INFO:teuthology.orchestra.run.smithi102.stdout:5455 write 0x8df67c7 thru 0x8dfd3a4 (0x6bde bytes) 2024-09-21T22:01:54.583 INFO:teuthology.orchestra.run.smithi102.stdout:5456 trunc from 0x8dfd3a5 to 0x86c052e 2024-09-21T22:01:54.595 INFO:teuthology.orchestra.run.smithi102.stdout:5457 punch from 0xd692b0 to 0xd71e28, (0x8b78 bytes) 2024-09-21T22:01:54.603 INFO:teuthology.orchestra.run.smithi102.stdout:5459 write 0xa1cec62 thru 0xa1d1443 (0x27e2 bytes) 2024-09-21T22:01:54.607 INFO:teuthology.orchestra.run.smithi102.stdout:5462 read 0x2f5f6a2 thru 0x2f67c7d (0x85dc bytes) 2024-09-21T22:01:54.607 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:54.607 INFO:teuthology.orchestra.run.smithi102.stdout:5464 read 0x48de4bf thru 0x48e49f0 (0x6532 bytes) 2024-09-21T22:01:54.607 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:54.607 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:54.607 INFO:teuthology.orchestra.run.smithi102.stdout:5468 read 0x7b6525e thru 0x7b6e8e4 (0x9687 bytes) 2024-09-21T22:01:54.608 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:54.608 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:54.608 INFO:teuthology.orchestra.run.smithi102.stdout:5473 read 0x33dd364 thru 0x33dd6e2 (0x37f bytes) 2024-09-21T22:01:54.608 INFO:teuthology.orchestra.run.smithi102.stdout:5475 write 0x77e341 thru 0x7879a6 (0x9666 bytes) 2024-09-21T22:01:54.620 INFO:teuthology.orchestra.run.smithi102.stdout:5476 read 0x2d11b1a thru 0x2d1b186 (0x966d bytes) 2024-09-21T22:01:54.625 INFO:teuthology.orchestra.run.smithi102.stdout:5477 trunc from 0xa1d1444 to 0x69b7a03 2024-09-21T22:01:54.633 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:54.633 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:54.633 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:54.633 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:54.633 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:54.635 INFO:teuthology.orchestra.run.smithi102.stdout:5478 read 0x1bae115 thru 0x1baff40 (0x1e2c bytes) 2024-09-21T22:01:54.640 INFO:teuthology.orchestra.run.smithi102.stdout:5480 trunc from 0x69b7a03 to 0x322c846 2024-09-21T22:01:54.646 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:54.647 INFO:teuthology.orchestra.run.smithi102.stdout:5481 punch from 0x7e6c6e to 0x7f4267, (0xd5f9 bytes) 2024-09-21T22:01:54.647 INFO:teuthology.orchestra.run.smithi102.stdout:5482 clone 40 order 18 su 65536 sc 12 2024-09-21T22:01:54.664 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:54.662+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:54.751 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:54.751 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785994041000002, 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:01:54.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785972800000003, 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.757 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:01:54.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.761 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785951572000002, 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:01:54.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:01:54.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:01:54.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:01:54.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:01:54.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:01:54.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:01:54.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:01:54.766 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.766 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.766 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.767 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.767 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:54.767 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785927966000003, 2024-09-21T22:01:54.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:01:54.767 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.767 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.767 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.767 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.767 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.767 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.768 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:01:54.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.768 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:54.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:01:54.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.771 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785908675999998, 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:01:54.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:01:54.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:01:54.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.775 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785876430000002, 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.776 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.779 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785852460999998, 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785832896999999, 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785812464999999, 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:01:54.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.792 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785791342000003, 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.793 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:01:54.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.794 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:54.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:01:54.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:01:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:01:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:01:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:01:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:01:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:01:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:54.798 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785772125999998, 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:01:54.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:01:54.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785751654000002, 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.803 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:01:54.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:01:54.806 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785730938999997, 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.807 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:01:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:01:54.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:01:54.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785711182999997, 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.811 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785691468000003, 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:01:54.815 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.819 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785671557999997, 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:01:54.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:01:54.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:01:54.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:01:54.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:01:54.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:01:54.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785650574999998, 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:01:54.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785629890999999, 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.829 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:01:54.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:01:54.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:01:54.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:01:54.833 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.833 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.833 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.834 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.834 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:54.834 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785603987000002, 2024-09-21T22:01:54.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:01:54.834 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.834 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.834 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.834 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.785583070000001, 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:54.838 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:54.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:54.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:01:54.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:01:54.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.842 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:54.842 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:54.842 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:54.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:54.844 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:54.842+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:54.944 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:54.942+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:54.946 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:54.946 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:54.946 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:54.946 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:54.954 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:54.999 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:01:55.044 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:55.042+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:55.067 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:55.067 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:55.067 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:55.067 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:55.067 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:55.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:55.088 INFO:teuthology.orchestra.run.smithi102.stdout:flattening image image_client.0-clone39 2024-09-21T22:01:55.145 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:55.143+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:55.232 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:55.232 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:55.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:55.232 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.360594237000001, 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:01:55.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.360574243999999, 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.237 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.241 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.360454808999997, 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:01:55.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.245 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.360188102999999, 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.360157940999997, 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.250 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:55.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:55.255 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.360132405000002, 2024-09-21T22:01:55.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:01:55.256 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.256 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.256 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.256 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:01:55.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.256 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:01:55.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.260 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:55.261 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.360109876999999, 2024-09-21T22:01:55.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:01:55.261 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.261 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.261 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.261 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.261 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.261 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.261 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:01:55.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.262 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:55.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.265 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.360086256999999, 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.266 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:01:55.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.360065908000003, 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.270 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.274 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.360043494000003, 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:55.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:01:55.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:01:55.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.359867426999998, 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:01:55.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:01:55.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:01:55.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:01:55.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.359838418999999, 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.284 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.284 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.284 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.284 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.284 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:01:55.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.284 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:01:55.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:01:55.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:01:55.288 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.288 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.288 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.288 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.288 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.359816588000001, 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:01:55.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:01:55.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:55.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:01:55.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:01:55.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:01:55.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:01:55.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:01:55.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:01:55.293 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.359659442999998, 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.294 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:55.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.298 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.359626972999997, 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.302 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.359605442000003, 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.303 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:01:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.359584124999998, 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:55.311 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.359558683000003, 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:01:55.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:01:55.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:01:55.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:01:55.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:01:55.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:01:55.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.359537983999999, 2024-09-21T22:01:55.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:01:55.317 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.317 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.317 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.317 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.317 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.317 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.317 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:01:55.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.317 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:01:55.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.321 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.322 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.322 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:55.322 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:55.322 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.359517351999997, 2024-09-21T22:01:55.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:01:55.322 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.322 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.322 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.323 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.323 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.323 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.323 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:01:55.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.323 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:55.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:01:55.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:01:55.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.327 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.327 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.327 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:55.329 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:55.329 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-21T22:01:55.330 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:55.327+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:01:55.429 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:55.427+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:55.488 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:55.489 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:55.489 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:01:55.489 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:55.498 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:55.541 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:55.539+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:55.552 INFO:teuthology.orchestra.run.smithi102.stdout:5483 trunc from 0x322c846 to 0xe142b0b 2024-09-21T22:01:55.561 INFO:teuthology.orchestra.run.smithi102.stdout:5485 punch from 0x26bebae to 0x26c5a19, (0x6e6b bytes) 2024-09-21T22:01:55.561 INFO:teuthology.orchestra.run.smithi102.stdout:5486 write 0x477dbdd thru 0x4782224 (0x4648 bytes) 2024-09-21T22:01:55.570 INFO:teuthology.orchestra.run.smithi102.stdout:5487 write 0xe494a47 thru 0xe49f324 (0xa8de bytes) 2024-09-21T22:01:55.574 INFO:teuthology.orchestra.run.smithi102.stdout:5488 write 0x806d437 thru 0x8074cbc (0x7886 bytes) 2024-09-21T22:01:55.577 INFO:teuthology.orchestra.run.smithi102.stdout:5490 write 0x55f9396 thru 0x55fd59a (0x4205 bytes) 2024-09-21T22:01:55.580 INFO:teuthology.orchestra.run.smithi102.stdout:5491 write 0x7a172ec thru 0x7a198af (0x25c4 bytes) 2024-09-21T22:01:55.583 INFO:teuthology.orchestra.run.smithi102.stdout:5492 write 0x8a97187 thru 0x8aa0082 (0x8efc bytes) 2024-09-21T22:01:55.588 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:55.588 INFO:teuthology.orchestra.run.smithi102.stdout:5494 read 0x90d382 thru 0x91c537 (0xf1b6 bytes) 2024-09-21T22:01:55.589 INFO:teuthology.orchestra.run.smithi102.stdout:5495 write 0xa0440c7 thru 0xa04bda1 (0x7cdb bytes) 2024-09-21T22:01:55.594 INFO:teuthology.orchestra.run.smithi102.stdout:5497 punch from 0xdf80f8a to 0xdf8f5a6, (0xe61c bytes) 2024-09-21T22:01:55.594 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:55.594 INFO:teuthology.orchestra.run.smithi102.stdout:5500 write 0x2ce4fc6 thru 0x2ce82ec (0x3327 bytes) 2024-09-21T22:01:55.598 INFO:teuthology.orchestra.run.smithi102.stdout:5501 clone 41 order 21 su 262144 sc 6 2024-09-21T22:01:55.610 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:55.610 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:55.610 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:55.610 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:55.610 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:55.619 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:55.660 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:55.658+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:55.732 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:55.730+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56953 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 425984~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5058994489999993, 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031605451, 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.763 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56953 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.15e-07 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254979+0000", 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6399999999999999e-06 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254984+0000", 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4099999999999999e-06 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254987+0000", 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.729e-06 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286387+0000", 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031400008 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286479+0000", 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1768999999999995e-05 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286580+0000", 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010148 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56954 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 655360~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5058839200000005, 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031833193000000003, 2024-09-21T22:01:55.767 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56954 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254992+0000", 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1400000000000001e-06 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254995+0000", 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9629999999999998e-06 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254997+0000", 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3970000000000001e-06 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286623+0000", 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031626354000000002 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286715+0000", 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2120999999999994e-05 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286823+0000", 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107997 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56955 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 884736~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5058745459999994, 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032037574999999999, 2024-09-21T22:01:55.771 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56955 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-07 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255001+0000", 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0419999999999999e-06 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255006+0000", 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255010+0000", 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8700000000000002e-06 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286860+0000", 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031850695999999998 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286941+0000", 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0419000000000004e-05 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287037+0000", 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6424999999999999e-05 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56956 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1114112~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255014+0000", 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5058598120000006, 2024-09-21T22:01:55.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032238259999999998, 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56956 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255014+0000", 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255014+0000", 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255015+0000", 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255016+0000", 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.313e-06 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255019+0000", 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3239999999999999e-06 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255022+0000", 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.729e-06 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287082+0000", 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032060403000000001 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287159+0000", 2024-09-21T22:01:55.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6859000000000004e-05 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287253+0000", 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3399000000000005e-05 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56957 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1343488~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5058495240000003, 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032466460000000003, 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.779 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56957 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:55.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:55.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0100000000000001e-07 2024-09-21T22:01:55.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255026+0000", 2024-09-21T22:01:55.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0690000000000001e-06 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255029+0000", 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8890000000000002e-06 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255031+0000", 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5359999999999999e-06 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287293+0000", 2024-09-21T22:01:55.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032262093999999998 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287377+0000", 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3341e-05 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287491+0000", 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011433 2024-09-21T22:01:55.783 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56958 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255034+0000", 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.505839946, 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032659301000000002, 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56958 2024-09-21T22:01:55.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.785 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255034+0000", 2024-09-21T22:01:55.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255034+0000", 2024-09-21T22:01:55.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255035+0000", 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0199999999999998e-07 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255036+0000", 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.612e-06 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255041+0000", 2024-09-21T22:01:55.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0220000000000004e-06 2024-09-21T22:01:55.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255044+0000", 2024-09-21T22:01:55.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4729999999999999e-06 2024-09-21T22:01:55.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287523+0000", 2024-09-21T22:01:55.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032478928999999997 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287598+0000", 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5904999999999999e-05 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287694+0000", 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5057999999999997e-05 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56959 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1802240~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5058269719999995, 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032794619999999997, 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56959 2024-09-21T22:01:55.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.790 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:55.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255049+0000", 2024-09-21T22:01:55.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.15e-06 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255052+0000", 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5449999999999999e-06 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255055+0000", 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5349999999999999e-06 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287722+0000", 2024-09-21T22:01:55.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032667285999999997 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287784+0000", 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2235000000000003e-05 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287842+0000", 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7648000000000001e-05 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56960 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5058169130000003, 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033013893000000002, 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56960 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:55.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:55.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255059+0000", 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.048e-06 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255062+0000", 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0189999999999998e-06 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255064+0000", 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.61e-06 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287888+0000", 2024-09-21T22:01:55.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032823475999999997 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287968+0000", 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0339000000000004e-05 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288071+0000", 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000103199 2024-09-21T22:01:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56975 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 212992~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255067+0000", 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5058068870000003, 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033221667000000003, 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56975 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255067+0000", 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255067+0000", 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255068+0000", 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.65e-07 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255072+0000", 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7770000000000002e-06 2024-09-21T22:01:55.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255078+0000", 2024-09-21T22:01:55.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1500000000000004e-06 2024-09-21T22:01:55.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255083+0000", 2024-09-21T22:01:55.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7299999999999996e-06 2024-09-21T22:01:55.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288111+0000", 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033027687999999999 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288190+0000", 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9065000000000003e-05 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288289+0000", 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8992000000000004e-05 2024-09-21T22:01:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56976 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255089+0000", 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5057847229999997, 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033409467999999998, 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56976 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.804 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255089+0000", 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255089+0000", 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255090+0000", 2024-09-21T22:01:55.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7700000000000004e-07 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255093+0000", 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3189999999999999e-06 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255100+0000", 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1589999999999998e-06 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255104+0000", 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6410000000000001e-06 2024-09-21T22:01:55.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288327+0000", 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033222584999999999 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288404+0000", 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7646999999999997e-05 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288499+0000", 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4539999999999999e-05 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.807 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56977 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255112+0000", 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5057617570000001, 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033612184000000003, 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56977 2024-09-21T22:01:55.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255112+0000", 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255112+0000", 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255113+0000", 2024-09-21T22:01:55.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000004e-07 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255115+0000", 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1730000000000002e-06 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255122+0000", 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4710000000000004e-06 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255127+0000", 2024-09-21T22:01:55.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7379999999999999e-06 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288540+0000", 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033412301999999998 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288622+0000", 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2194000000000006e-05 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288725+0000", 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102777 2024-09-21T22:01:55.811 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56978 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255134+0000", 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5057399559999993, 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033806969999999999, 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.812 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56978 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255134+0000", 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255134+0000", 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255135+0000", 2024-09-21T22:01:55.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255137+0000", 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3700000000000002e-06 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255143+0000", 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1190000000000002e-06 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255148+0000", 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4700000000000004e-06 2024-09-21T22:01:55.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288785+0000", 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033637453999999997 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288854+0000", 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8898000000000003e-05 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288941+0000", 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7247e-05 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.815 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56979 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1130496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5057203460000004, 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033955731000000003, 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56979 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:01:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255157+0000", 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.356e-06 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255163+0000", 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255168+0000", 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9130000000000002e-06 2024-09-21T22:01:55.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288980+0000", 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033811255999999998 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289050+0000", 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0691999999999993e-05 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289110+0000", 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9271999999999998e-05 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.819 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56980 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5056963769999996, 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034096952, 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56980 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.820 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4999999999999998e-07 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255181+0000", 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3099999999999999e-06 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255188+0000", 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1250000000000004e-06 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255193+0000", 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9060000000000001e-06 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289144+0000", 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033950928999999998 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289204+0000", 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0544000000000002e-05 2024-09-21T22:01:55.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289275+0000", 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0687999999999998e-05 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56981 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1589248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:55.824 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.505675213, 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034304860999999999, 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56981 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:55.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255202+0000", 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1639999999999999e-06 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255207+0000", 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9410000000000004e-06 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255212+0000", 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289317+0000", 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034105115999999998 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289399+0000", 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2094000000000004e-05 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289504+0000", 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010464299999999999 2024-09-21T22:01:55.828 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56982 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5056570800000006, 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034446705000000001, 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.829 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56982 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:55.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:01:55.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255219+0000", 2024-09-21T22:01:55.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4190000000000001e-06 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255222+0000", 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.281e-06 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255225+0000", 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5289999999999998e-06 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289536+0000", 2024-09-21T22:01:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034311087999999997 2024-09-21T22:01:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289597+0000", 2024-09-21T22:01:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1359999999999995e-05 2024-09-21T22:01:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289664+0000", 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6653e-05 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56983 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 2048000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255227+0000", 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5056468180000007, 2024-09-21T22:01:55.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034580627000000003, 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56983 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255227+0000", 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255227+0000", 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255228+0000", 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1299999999999999e-07 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255229+0000", 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0759999999999999e-06 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255232+0000", 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.881e-06 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255234+0000", 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3290000000000001e-06 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289682+0000", 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034448631 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289748+0000", 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5464999999999997e-05 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289808+0000", 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0031999999999997e-05 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:57002 3.8 3:13575aeb:::rbd_data.112442ffa2ed.0000000000000007:24 [read 393216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5056371160000008, 2024-09-21T22:01:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034726911999999999, 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 57002 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255239+0000", 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5650000000000001e-06 2024-09-21T22:01:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255244+0000", 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1499999999999998e-06 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255248+0000", 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3599999999999998e-06 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289833+0000", 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034584363999999999 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289891+0000", 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8561999999999999e-05 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289964+0000", 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2619000000000004e-05 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:57006 3.8 3:13575aeb:::rbd_data.112442ffa2ed.0000000000000007:24 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255254+0000", 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5056199489999997, 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034912427000000003, 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 57006 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255254+0000", 2024-09-21T22:01:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255254+0000", 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255255+0000", 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255259+0000", 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8240000000000001e-06 2024-09-21T22:01:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255265+0000", 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255269+0000", 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3100000000000002e-06 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289984+0000", 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034715357000000002 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290041+0000", 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7123000000000002e-05 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290167+0000", 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012530700000000001 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:57010 3.18 3:18405c99:::rbd_data.1124d06a34e4.000000000000000c:23 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255276+0000", 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5055979080000004, 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034859288000000002, 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 57010 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255276+0000", 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255276+0000", 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255277+0000", 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255279+0000", 2024-09-21T22:01:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1940000000000001e-06 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255285+0000", 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9349999999999999e-06 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255289+0000", 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4519999999999999e-06 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290003+0000", 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034713711000000001 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290067+0000", 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3944999999999998e-05 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290136+0000", 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8663000000000003e-05 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:55.851 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:55.851 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:55.852 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:55.852 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:55.850+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:55.952 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:55.951+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:55.956 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:55.956 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:55.956 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:55.956 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:55.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:56.007 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:01:56.053 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:56.051+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:56.065 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone40 from 0xe49f325 (overlap 0x322c846) to 0x28239d1 2024-09-21T22:01:56.123 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:56.123 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:56.123 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:56.123 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:56.124 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:56.132 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:56.173 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:56.171+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:56.173 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-21T22:01:56.243 INFO:teuthology.orchestra.run.smithi102.stdout:5502 clone 42 order 25 su 8388608 sc 10 2024-09-21T22:01:56.255 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:56.253+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:56.281 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:56.281 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:01:56.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:01:56.281 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:01:56.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.281 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:01:56.281 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:56.281 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 57.066939886999997, 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:01:56.286 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56963 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 622592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0248788070000003, 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021343747, 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.287 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56963 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2e-07 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253818+0000", 2024-09-21T22:01:56.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1160000000000002e-06 2024-09-21T22:01:56.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253823+0000", 2024-09-21T22:01:56.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:01:56.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253828+0000", 2024-09-21T22:01:56.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:01:56.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.274987+0000", 2024-09-21T22:01:56.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021158445000000001 2024-09-21T22:01:56.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275065+0000", 2024-09-21T22:01:56.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8407999999999999e-05 2024-09-21T22:01:56.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275159+0000", 2024-09-21T22:01:56.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3497000000000003e-05 2024-09-21T22:01:56.292 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.292 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56964 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0248594900000008, 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021459051999999999, 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.293 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56964 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253835+0000", 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253837+0000", 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253842+0000", 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8080000000000001e-06 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253847+0000", 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6099999999999999e-06 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275188+0000", 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021341057 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275230+0000", 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1941999999999999e-05 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275293+0000", 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3195999999999996e-05 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56965 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0248274889999998, 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021632274, 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56965 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253867+0000", 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253869+0000", 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253875+0000", 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0970000000000002e-06 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253880+0000", 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275329+0000", 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021448292000000001 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275407+0000", 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7946000000000002e-05 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275499+0000", 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1978000000000006e-05 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56966 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1310720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:01:56.301 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0248076420000007, 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021740731999999999, 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56966 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253888+0000", 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0669999999999999e-06 2024-09-21T22:01:56.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253894+0000", 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8980000000000001e-06 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253900+0000", 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275526+0000", 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021625912000000001 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275569+0000", 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3043000000000001e-05 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275627+0000", 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7479000000000003e-05 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56967 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:01:56.305 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0247874699999997, 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021928007999999999, 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56967 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:01:56.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253907+0000", 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.41e-07 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253908+0000", 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.776e-06 2024-09-21T22:01:56.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253914+0000", 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1950000000000002e-06 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253928+0000", 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3974e-05 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275662+0000", 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021734168000000002 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275740+0000", 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7807999999999998e-05 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275834+0000", 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4746000000000004e-05 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56968 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:01:56.309 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.024759328, 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022029615999999998, 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56968 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:01:56.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253935+0000", 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253937+0000", 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253943+0000", 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253948+0000", 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:01:56.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275861+0000", 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021913548000000001 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275905+0000", 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3795000000000003e-05 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275964+0000", 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8739000000000001e-05 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.313 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56969 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0247406590000008, 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022221162999999999, 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.314 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56969 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:01:56.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:01:56.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253955+0000", 2024-09-21T22:01:56.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.874e-06 2024-09-21T22:01:56.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253961+0000", 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999998e-06 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253965+0000", 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5260000000000004e-06 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276000+0000", 2024-09-21T22:01:56.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022034611999999999 2024-09-21T22:01:56.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276078+0000", 2024-09-21T22:01:56.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8311000000000003e-05 2024-09-21T22:01:56.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276174+0000", 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6139999999999998e-05 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56984 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0247230409999997, 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022340279000000001, 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.319 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56984 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253973+0000", 2024-09-21T22:01:56.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.81e-06 2024-09-21T22:01:56.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253979+0000", 2024-09-21T22:01:56.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:01:56.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253983+0000", 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276203+0000", 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022219848 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276248+0000", 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4880999999999999e-05 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276311+0000", 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3047999999999997e-05 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.325 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56985 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.325 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:01:56.325 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0247050689999995, 2024-09-21T22:01:56.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022528538000000001, 2024-09-21T22:01:56.325 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.325 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.325 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.325 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.325 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.326 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.326 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56985 2024-09-21T22:01:56.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.326 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:01:56.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253991+0000", 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1229999999999998e-06 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253997+0000", 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4759999999999997e-06 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254003+0000", 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.896e-06 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276347+0000", 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022344180000000002 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276424+0000", 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7014000000000005e-05 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276517+0000", 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3383999999999999e-05 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.329 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56986 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0246854659999993, 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022636156000000001, 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.330 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56986 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254009+0000", 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254021+0000", 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2075e-05 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254027+0000", 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2910000000000004e-06 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254032+0000", 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0969999999999996e-06 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276545+0000", 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022513014000000001 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276588+0000", 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3183000000000003e-05 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276644+0000", 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6165999999999997e-05 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56987 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 868352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0246549960000007, 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022813353000000001, 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.334 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56987 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:01:56.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254041+0000", 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254047+0000", 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:01:56.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254051+0000", 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6430000000000003e-06 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276680+0000", 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022628945000000001 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276758+0000", 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7775999999999995e-05 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276852+0000", 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4067999999999995e-05 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56988 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1097728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0246375810000004, 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923770999999999, 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.338 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56988 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254058+0000", 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254064+0000", 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2950000000000001e-06 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254068+0000", 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1479999999999999e-06 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276880+0000", 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022812260000000001 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276923+0000", 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3347999999999999e-05 2024-09-21T22:01:56.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276980+0000", 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6496000000000003e-05 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56989 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1327104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0246205750000001, 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023109826999999999, 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.342 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56989 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:01:56.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254075+0000", 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.691e-06 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254081+0000", 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:01:56.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254085+0000", 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.498e-06 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277015+0000", 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929417000000001 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277092+0000", 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6625000000000006e-05 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277183+0000", 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1453999999999995e-05 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.346 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56990 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1556480~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0246024279999997, 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023224305000000001, 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56990 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.347 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254092+0000", 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.22e-07 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254093+0000", 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7099999999999999e-06 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254099+0000", 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:01:56.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254103+0000", 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277211+0000", 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023107593999999999 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277254+0000", 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2762000000000002e-05 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277316+0000", 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1876000000000002e-05 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56991 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0245850819999998, 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023415498999999999, 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56991 2024-09-21T22:01:56.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:01:56.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:01:56.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254111+0000", 2024-09-21T22:01:56.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.813e-06 2024-09-21T22:01:56.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254116+0000", 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254121+0000", 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5730000000000001e-06 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277351+0000", 2024-09-21T22:01:56.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023230621 2024-09-21T22:01:56.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277431+0000", 2024-09-21T22:01:56.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9818e-05 2024-09-21T22:01:56.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277524+0000", 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2986999999999996e-05 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56992 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 2015232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0245675930000004, 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023528238999999999, 2024-09-21T22:01:56.357 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56992 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254128+0000", 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8330000000000001e-06 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254134+0000", 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5729999999999998e-06 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254139+0000", 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4790000000000004e-06 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277553+0000", 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023413607999999999 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277596+0000", 2024-09-21T22:01:56.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3489000000000003e-05 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277654+0000", 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7911999999999997e-05 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57020 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0240705079999994, 2024-09-21T22:01:56.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023243617000000001, 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57020 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254624+0000", 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254632+0000", 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1219999999999995e-06 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254640+0000", 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9370000000000004e-06 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254645+0000", 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3140000000000003e-06 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277690+0000", 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023044477000000001 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277768+0000", 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8594e-05 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277867+0000", 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8560999999999994e-05 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57021 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:01:56.365 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0240416069999991, 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023344055999999998, 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57021 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254653+0000", 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254654+0000", 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:01:56.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254661+0000", 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254666+0000", 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277894+0000", 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023228029000000001 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277936+0000", 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2589000000000002e-05 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277996+0000", 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9967999999999999e-05 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57023 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 704512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:01:56.369 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 9.0240227879999999, 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023525122999999998, 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57023 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.32e-07 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254679+0000", 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7479999999999993e-06 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254686+0000", 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254690+0000", 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7180000000000004e-06 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278021+0000", 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023330391999999998 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:01:56.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278097+0000", 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6464999999999994e-05 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278196+0000", 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8852999999999997e-05 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:01:56.373 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:56.374 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:01:56.375 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:56.373+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:56.475 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:56.473+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:56.519 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:56.519 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:56.519 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:56.519 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:56.527 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:01:56.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:01:56.612 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:56.610+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:56.660 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:56.660 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:56.671 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:56.671 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:56.671 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:56.671 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:56.671 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:56.677 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:56.677 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:56.675+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:56.679 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:01:56.692 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:56.692 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:56.708 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:56.708 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:56.724 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:56.741 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:56.742 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:56.758 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:56.758 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:56.774 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:56.774 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:56.777 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:56.775+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:56.825 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:56.825 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:56.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:01:56.878 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:56.877+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:56.938 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:56.938 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:56.947 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:01:56.979 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:56.977+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:57.053 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:57.054 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:57.063 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:01:57.084 INFO:teuthology.orchestra.run.smithi102.stdout:flattening image image_client.0-clone41 2024-09-21T22:01:57.111 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:57.109+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:57.182 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:57.180+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:57.209 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:57.209 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:57.218 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:01:57.282 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:57.280+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:57.356 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-21T22:01:57.363 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:57.363 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:57.375 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:01:57.382 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:57.380+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:57.484 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:57.481+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:57.554 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:57.554 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:57.568 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:01:57.584 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:57.582+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:57.659 INFO:teuthology.orchestra.run.smithi102.stdout:5504 read 0x4a8167d thru 0x4a8b2e7 (0x9c6b bytes) 2024-09-21T22:01:57.663 INFO:teuthology.orchestra.run.smithi102.stdout:5505 punch from 0xaa86a47 to 0xaa9060c, (0x9bc5 bytes) 2024-09-21T22:01:57.663 INFO:teuthology.orchestra.run.smithi102.stdout:5506 write 0x3e36f44 thru 0x3e40a35 (0x9af2 bytes) 2024-09-21T22:01:57.668 INFO:teuthology.orchestra.run.smithi102.stdout:5507 read 0xc9b1621 thru 0xc9b9bff (0x85df bytes) 2024-09-21T22:01:57.668 INFO:teuthology.orchestra.run.smithi102.stdout:5509 read 0x76e5bc thru 0x773fd0 (0x5a15 bytes) 2024-09-21T22:01:57.669 INFO:teuthology.orchestra.run.smithi102.stdout:5510 read 0xab16a72 thru 0xab1f703 (0x8c92 bytes) 2024-09-21T22:01:57.669 INFO:teuthology.orchestra.run.smithi102.stdout:5511 writesame 0xe099419 thru 0xe09a839 data_size 0x1(0x1421 bytes) 2024-09-21T22:01:57.680 INFO:teuthology.orchestra.run.smithi102.stdout:5512 read 0x78b4c7e thru 0x78bea4a (0x9dcd bytes) 2024-09-21T22:01:57.685 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:57.682+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:57.701 INFO:teuthology.orchestra.run.smithi102.stdout:5513 trunc from 0xe49f325 to 0x513c44 2024-09-21T22:01:57.727 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:57.727 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:57.737 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:01:57.738 INFO:teuthology.orchestra.run.smithi102.stdout:5514 writesame 0x4844a1c thru 0x4847592 data_size 0x1(0x2b77 bytes) 2024-09-21T22:01:57.738 INFO:teuthology.orchestra.run.smithi102.stdout:5515 read 0x15dd246 thru 0x15e607e (0x8e39 bytes) 2024-09-21T22:01:57.753 INFO:teuthology.orchestra.run.smithi102.stdout:5516 write 0xcf5277f thru 0xcf617c6 (0xf048 bytes) 2024-09-21T22:01:57.756 INFO:teuthology.orchestra.run.smithi102.stdout:5517 write 0x4c5520f thru 0x4c63b7c (0xe96e bytes) 2024-09-21T22:01:57.759 INFO:teuthology.orchestra.run.smithi102.stdout:5518 read 0xccb8602 thru 0xccc4691 (0xc090 bytes) 2024-09-21T22:01:57.760 INFO:teuthology.orchestra.run.smithi102.stdout:5521 write 0xc464639 thru 0xc468fad (0x4975 bytes) 2024-09-21T22:01:57.763 INFO:teuthology.orchestra.run.smithi102.stdout:5522 writesame 0x6dc5297 thru 0x6dd4361 data_size 0x1(0xf0cb bytes) 2024-09-21T22:01:57.785 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:57.783+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:57.793 INFO:teuthology.orchestra.run.smithi102.stdout:5523 read 0x5d4e31e thru 0x5d4f04b (0xd2e bytes) 2024-09-21T22:01:57.793 INFO:teuthology.orchestra.run.smithi102.stdout:5525 read 0x7dd2030 thru 0x7dd7612 (0x55e3 bytes) 2024-09-21T22:01:57.794 INFO:teuthology.orchestra.run.smithi102.stdout:5527 read 0x7aed337 thru 0x7aeeb6b (0x1835 bytes) 2024-09-21T22:01:57.794 INFO:teuthology.orchestra.run.smithi102.stdout:5529 writesame 0xc1f2d19 thru 0xc1f6e71 data_size 0x1(0x4159 bytes) 2024-09-21T22:01:57.802 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:01:57.802 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:01:57.802 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:01:57.802 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:01:57.803 INFO:teuthology.orchestra.run.smithi102.stdout:5531 punch from 0xce91e13 to 0xce9895a, (0x6b47 bytes) 2024-09-21T22:01:57.803 INFO:teuthology.orchestra.run.smithi102.stdout:5532 punch from 0x3e90810 to 0x3e98d2c, (0x851c bytes) 2024-09-21T22:01:57.803 INFO:teuthology.orchestra.run.smithi102.stdout:5533 write 0x77cda29 thru 0x77d1407 (0x39df bytes) 2024-09-21T22:01:57.804 INFO:teuthology.orchestra.run.smithi102.stdout:5534 read 0xbde7ef thru 0xbe32bd (0x4acf bytes) 2024-09-21T22:01:57.804 INFO:teuthology.orchestra.run.smithi102.stdout:5535 write 0x6b95737 thru 0x6b97b6c (0x2436 bytes) 2024-09-21T22:01:57.805 INFO:teuthology.orchestra.run.smithi102.stdout:5536 read 0x74dfc30 thru 0x74ea67c (0xaa4d bytes) 2024-09-21T22:01:57.811 INFO:teuthology.orchestra.run.smithi102.stdout:5537 write 0xd3dad3c thru 0xd3e865f (0xd924 bytes) 2024-09-21T22:01:57.815 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:57.815 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:57.815 INFO:teuthology.orchestra.run.smithi102.stdout:5544 punch from 0x26dfefe to 0x26e495c, (0x4a5e bytes) 2024-09-21T22:01:57.815 INFO:teuthology.orchestra.run.smithi102.stdout:5545 write 0xc884917 thru 0xc88b55c (0x6c46 bytes) 2024-09-21T22:01:57.817 INFO:teuthology.orchestra.run.smithi102.stdout:5546 read 0xad95d88 thru 0xada06fe (0xa977 bytes) 2024-09-21T22:01:57.817 INFO:teuthology.orchestra.run.smithi102.stdout:5548 read 0x645d1c4 thru 0x646406f (0x6eac bytes) 2024-09-21T22:01:57.817 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:57.824 INFO:teuthology.orchestra.run.smithi102.stdout:5550 trunc from 0xd3e8660 to 0x7ddaf50 2024-09-21T22:01:57.832 INFO:teuthology.orchestra.run.smithi102.stdout:5552 read 0x68ff916 thru 0x690b77d (0xbe68 bytes) 2024-09-21T22:01:57.832 INFO:teuthology.orchestra.run.smithi102.stdout:5553 read 0x3a25a64 thru 0x3a345f3 (0xeb90 bytes) 2024-09-21T22:01:57.837 INFO:teuthology.orchestra.run.smithi102.stdout:5554 trunc from 0x7ddaf50 to 0x45a8618 2024-09-21T22:01:57.846 INFO:teuthology.orchestra.run.smithi102.stdout:5555 read 0x63d952 thru 0x644825 (0x6ed4 bytes) 2024-09-21T22:01:57.847 INFO:teuthology.orchestra.run.smithi102.stdout:5556 write 0x14c2059 thru 0x14d0671 (0xe619 bytes) 2024-09-21T22:01:57.850 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:57.851 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:57.858 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:57.858 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:57.861 INFO:teuthology.orchestra.run.smithi102.stdout:5561 trunc from 0x45a8618 to 0xd791299 2024-09-21T22:01:57.867 INFO:teuthology.orchestra.run.smithi102.stdout:5562 writesame 0x406f7c1 thru 0x4079946 data_size 0x19(0xa186 bytes) 2024-09-21T22:01:57.870 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:01:57.872 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:57.872 INFO:teuthology.orchestra.run.smithi102.stdout:5565 writesame 0xd734420 thru 0xd734730 data_size 0x1(0x311 bytes) 2024-09-21T22:01:57.874 INFO:teuthology.orchestra.run.smithi102.stdout:5566 writesame 0x6022992 thru 0x602a7af data_size 0x3(0x7e1e bytes) 2024-09-21T22:01:57.879 INFO:teuthology.orchestra.run.smithi102.stdout:5567 write 0x9bde12f thru 0x9be01e0 (0x20b2 bytes) 2024-09-21T22:01:57.883 INFO:teuthology.orchestra.run.smithi102.stdout:5568 writesame 0x65ee2c3 thru 0x65ef961 data_size 0x1(0x169f bytes) 2024-09-21T22:01:57.886 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:57.884+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:57.886 INFO:teuthology.orchestra.run.smithi102.stdout:5571 write 0xce5bf17 thru 0xce66b0f (0xabf9 bytes) 2024-09-21T22:01:57.888 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:57.888 INFO:teuthology.orchestra.run.smithi102.stdout:5573 read 0x85d397 thru 0x85fb2f (0x2799 bytes) 2024-09-21T22:01:57.888 INFO:teuthology.orchestra.run.smithi102.stdout:5574 write 0xd711a8e thru 0xd71a27b (0x87ee bytes) 2024-09-21T22:01:57.898 INFO:teuthology.orchestra.run.smithi102.stdout:5575 trunc from 0xd791299 to 0x89f73c4 2024-09-21T22:01:57.905 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:57.905 INFO:teuthology.orchestra.run.smithi102.stdout:5579 read 0x30f876a thru 0x30fe063 (0x58fa bytes) 2024-09-21T22:01:57.905 INFO:teuthology.orchestra.run.smithi102.stdout:5582 write 0x41c7b6c thru 0x41d778e (0xfc23 bytes) 2024-09-21T22:01:57.907 INFO:teuthology.orchestra.run.smithi102.stdout:5583 write 0x530ae67 thru 0x5312c58 (0x7df2 bytes) 2024-09-21T22:01:57.908 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:57.908 INFO:teuthology.orchestra.run.smithi102.stdout:5587 read 0x601090d thru 0x601b268 (0xa95c bytes) 2024-09-21T22:01:57.909 INFO:teuthology.orchestra.run.smithi102.stdout:5589 write 0xf95a05 thru 0xfa0b1b (0xb117 bytes) 2024-09-21T22:01:57.912 INFO:teuthology.orchestra.run.smithi102.stdout:5590 read 0x43d82cf thru 0x43d8cca (0x9fc bytes) 2024-09-21T22:01:57.913 INFO:teuthology.orchestra.run.smithi102.stdout:5591 read 0x57ea4c3 thru 0x57eaaa1 (0x5df bytes) 2024-09-21T22:01:57.913 INFO:teuthology.orchestra.run.smithi102.stdout:5592 clone 43 order 20 su 65536 sc 10 2024-09-21T22:01:57.988 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:57.985+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:57.997 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:57.997 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:58.006 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:01:58.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:01:58.088 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:58.086+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:58.095 INFO:teuthology.orchestra.run.smithi102.stdout:leaving image image_client.0-clone42 intact 2024-09-21T22:01:58.139 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:01:58.139 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:58.139 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 81, 2024-09-21T22:01:58.139 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "014f3ec5-afd0-4b18-9c74-de91f34d0760", 2024-09-21T22:01:58.139 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-09-21T22:00:24.916784+0000", 2024-09-21T22:01:58.139 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-09-21T22:01:58.016583+0000", 2024-09-21T22:01:58.139 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-09-21T22:00:36.060631+0000", 2024-09-21T22:01:58.139 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-09-21T22:01:35.858445+0000", 2024-09-21T22:01:58.139 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5806080, 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "nodeep-scrub", 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "noscrub", 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 5, 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-09-21T22:01:58.140 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 3, 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 8, 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "jewel", 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:37.034134+0000", 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:01:58.141 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "17", 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:01:58.143 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:01:58.144 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:01:58.145 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 8, 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 8, 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.25, 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:01:58.146 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:42.753049+0000", 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:01:58.147 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:01:58.148 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "21", 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 2, 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 21, 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:01:58.149 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:01:58.150 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:01:58.151 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.9900000095367432, 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.9900000095367432, 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2.630000114440918, 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2.630000114440918, 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.152 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "pool_client.0", 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:52.269263+0000", 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:01:58.153 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "81", 2024-09-21T22:01:58.154 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 45, 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 81, 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:01:58.155 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:01:58.156 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.7400000095367432, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.7400000095367432, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:01:58.157 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "ebc4f0b9-33fc-4301-b1c0-ac843b19095b", 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:58.158 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 13, 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 66, 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6808", 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6809", 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6810", 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6811", 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6814", 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.161 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6815", 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6812", 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6813", 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:01:58.162 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6809/3559797623", 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6811/3559797623", 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6815/3559797623", 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6813/3559797623", 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "1c8f54fe-439f-486e-8b8b-fe892332ada3", 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 0.1484527587890625, 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6824", 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6825", 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6826", 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.165 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6827", 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6830", 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6831", 2024-09-21T22:01:58.166 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6828", 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6829", 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6825/428384344", 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6827/428384344", 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6831/428384344", 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6829/428384344", 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "b202159c-804c-4d22-9aa3-8f590dce8faa", 2024-09-21T22:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.169 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6816", 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6817", 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.170 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6818", 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6819", 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6822", 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:58.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6823", 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6820", 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6821", 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6817/4237051748", 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6819/4237051748", 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6823/4237051748", 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6821/4237051748", 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "28a8c407-a445-4c76-8d7c-d5a249d13e03", 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 66, 2024-09-21T22:01:58.174 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6800", 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6801", 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.175 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6802", 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6803", 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:58.176 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6806", 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6807", 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6804", 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6805", 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6801/3004236595", 2024-09-21T22:01:58.178 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6803/3004236595", 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6807/3004236595", 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6805/3004236595", 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605", 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:58.179 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 66, 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6824", 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.180 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6825", 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6826", 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6827", 2024-09-21T22:01:58.181 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6830", 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6831", 2024-09-21T22:01:58.182 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6828", 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6829", 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.183 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6825/743062291", 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6827/743062291", 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6831/743062291", 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6829/743062291", 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7a0cc26e-a543-4647-bc53-fbecb69b2326", 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:58.184 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6808", 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6809", 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6810", 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6811", 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6814", 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6815", 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6812", 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6813", 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:01:58.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6809/2410886219", 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6811/2410886219", 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6815/2410886219", 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6813/2410886219", 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7768eeb7-c6d0-47d8-a400-c47a2154c590", 2024-09-21T22:01:58.189 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 0, 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 0, 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 48, 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6800", 2024-09-21T22:01:58.190 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6801", 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6802", 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6803", 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6806", 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.192 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6807", 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6804", 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6805", 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6801/2491178498", 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6803/2491178498", 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6807/2491178498", 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6805/2491178498", 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:01:58.194 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "30ed992b-2e99-4523-9fdd-8389f75940af", 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 63, 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.195 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6816", 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6817", 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6818", 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:58.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6819", 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6822", 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6823", 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6820", 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.198 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6821", 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6817/1580142875", 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6819/1580142875", 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6823/1580142875", 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6821/1580142875", 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:58.199 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.652871+0000", 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:58.200 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.866866+0000", 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.859757+0000", 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:58.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:34.082180+0000", 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:58.202 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.844484+0000", 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.746321+0000", 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:58.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 65536, 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.324821+0000", 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:01:58.204 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.093833+0000", 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [], 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-09-21T22:01:58.205 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [], 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [], 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-09-21T22:01:58.206 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:01:58.207 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:01:58.207 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-09-21T22:01:58.207 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:58.207 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:58.208 INFO:tasks.thrashosds.thrasher:j is {'epoch': 81, 'fsid': '014f3ec5-afd0-4b18-9c74-de91f34d0760', 'created': '2024-09-21T22:00:24.916784+0000', 'modified': '2024-09-21T22:01:58.016583+0000', 'last_up_change': '2024-09-21T22:00:36.060631+0000', 'last_in_change': '2024-09-21T22:01:35.858445+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:00:37.034134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:00:42.753049+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:00:52.269263+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 45, 'snap_epoch': 81, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}], 'osds': [{'osd': 0, 'uuid': 'ebc4f0b9-33fc-4301-b1c0-ac843b19095b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6808', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6809', 'nonce': 3559797623}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6810', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6811', 'nonce': 3559797623}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6814', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6815', 'nonce': 3559797623}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6812', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6813', 'nonce': 3559797623}]}, 'public_addr': '172.21.15.102:6809/3559797623', 'cluster_addr': '172.21.15.102:6811/3559797623', 'heartbeat_back_addr': '172.21.15.102:6815/3559797623', 'heartbeat_front_addr': '172.21.15.102:6813/3559797623', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1c8f54fe-439f-486e-8b8b-fe892332ada3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1484527587890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6824', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6825', 'nonce': 428384344}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6826', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6827', 'nonce': 428384344}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6830', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6831', 'nonce': 428384344}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6828', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6829', 'nonce': 428384344}]}, 'public_addr': '172.21.15.102:6825/428384344', 'cluster_addr': '172.21.15.102:6827/428384344', 'heartbeat_back_addr': '172.21.15.102:6831/428384344', 'heartbeat_front_addr': '172.21.15.102:6829/428384344', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'b202159c-804c-4d22-9aa3-8f590dce8faa', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6816', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6817', 'nonce': 4237051748}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6818', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6819', 'nonce': 4237051748}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6822', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6823', 'nonce': 4237051748}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6820', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6821', 'nonce': 4237051748}]}, 'public_addr': '172.21.15.102:6817/4237051748', 'cluster_addr': '172.21.15.102:6819/4237051748', 'heartbeat_back_addr': '172.21.15.102:6823/4237051748', 'heartbeat_front_addr': '172.21.15.102:6821/4237051748', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '28a8c407-a445-4c76-8d7c-d5a249d13e03', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 3004236595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 3004236595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 3004236595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 3004236595}]}, 'public_addr': '172.21.15.102:6801/3004236595', 'cluster_addr': '172.21.15.102:6803/3004236595', 'heartbeat_back_addr': '172.21.15.102:6807/3004236595', 'heartbeat_front_addr': '172.21.15.102:6805/3004236595', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6824', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6825', 'nonce': 743062291}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6826', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6827', 'nonce': 743062291}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6830', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6831', 'nonce': 743062291}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6828', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6829', 'nonce': 743062291}]}, 'public_addr': '172.21.15.184:6825/743062291', 'cluster_addr': '172.21.15.184:6827/743062291', 'heartbeat_back_addr': '172.21.15.184:6831/743062291', 'heartbeat_front_addr': '172.21.15.184:6829/743062291', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '7a0cc26e-a543-4647-bc53-fbecb69b2326', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6808', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6809', 'nonce': 2410886219}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6810', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6811', 'nonce': 2410886219}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6814', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6815', 'nonce': 2410886219}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6812', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6813', 'nonce': 2410886219}]}, 'public_addr': '172.21.15.184:6809/2410886219', 'cluster_addr': '172.21.15.184:6811/2410886219', 'heartbeat_back_addr': '172.21.15.184:6815/2410886219', 'heartbeat_front_addr': '172.21.15.184:6813/2410886219', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '7768eeb7-c6d0-47d8-a400-c47a2154c590', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6800', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6801', 'nonce': 2491178498}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6802', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6803', 'nonce': 2491178498}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6806', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6807', 'nonce': 2491178498}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6804', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6805', 'nonce': 2491178498}]}, 'public_addr': '172.21.15.184:6801/2491178498', 'cluster_addr': '172.21.15.184:6803/2491178498', 'heartbeat_back_addr': '172.21.15.184:6807/2491178498', 'heartbeat_front_addr': '172.21.15.184:6805/2491178498', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '30ed992b-2e99-4523-9fdd-8389f75940af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6816', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6817', 'nonce': 1580142875}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6818', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6819', 'nonce': 1580142875}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6822', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6823', 'nonce': 1580142875}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6820', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6821', 'nonce': 1580142875}]}, 'public_addr': '172.21.15.184:6817/1580142875', 'cluster_addr': '172.21.15.184:6819/1580142875', 'heartbeat_back_addr': '172.21.15.184:6823/1580142875', 'heartbeat_front_addr': '172.21.15.184:6821/1580142875', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.652871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.866866+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.859757+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:34.082180+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.844484+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.746321+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.324821+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.093833+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:01:58.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:01:58.209 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:58.209 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:58.210 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:01:58.210 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:58.206+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:58.213 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-21T22:01:58.309 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:58.307+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:58.372 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:58.373 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:58.382 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:01:58.423 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:58.421+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:58.484 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:58.484 INFO:teuthology.orchestra.run.smithi102.stdout:5596 read 0x4462443 thru 0x446c780 (0xa33e bytes) 2024-09-21T22:01:58.488 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:58.494 INFO:teuthology.orchestra.run.smithi102.stdout:5599 trunc from 0x89f73c4 to 0x441ff46 2024-09-21T22:01:58.511 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:58.509+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:58.525 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:58.526 INFO:teuthology.orchestra.run.smithi102.stdout:5603 punch from 0xe72fc9 to 0xe80aa1, (0xdad8 bytes) 2024-09-21T22:01:58.526 INFO:teuthology.orchestra.run.smithi102.stdout:5604 read 0x281110 thru 0x28faee (0xe9df bytes) 2024-09-21T22:01:58.532 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:01:58.532 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:01:58.535 INFO:teuthology.orchestra.run.smithi102.stdout:5607 trunc from 0x441ff46 to 0xb487f74 2024-09-21T22:01:58.544 INFO:teuthology.orchestra.run.smithi102.stdout:5608 trunc from 0xb487f74 to 0x9cd8d9a 2024-09-21T22:01:58.545 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:58.545 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:58.547 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-21T22:01:58.027627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1866506870,"num_objects":1692,"num_object_clones":466,"num_object_copies":3384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1692,"num_whiteouts":433,"num_read":108789,"num_read_kb":608599,"num_write":16484,"num_write_kb":363416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":25180772,"num_keys_recovered":72,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13236,"ondisk_log_size":13236,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":325088,"kb_used_data":63760,"kb_used_omap":10,"kb_used_meta":261173,"kb_avail":660277792,"statfs":{"total":676457349120,"available":676124459008,"internally_reserved":0,"allocated":65290240,"data_stored":612868961,"data_compressed":20471475,"data_compressed_allocated":48979968,"data_compressed_original":604290628,"omap_allocated":11156,"internal_metadata":267441260},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112223382,"num_objects":315,"num_object_clones":96,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":315,"num_whiteouts":91,"num_read":13858,"num_read_kb":96067,"num_write":1898,"num_write_kb":46308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035595"},"pg_stats":[{"pgid":"3.1f","version":"78'267","reported_seq":1190,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T22:01:55.156953+0000","last_change":"2024-09-21T22:00:56.181293+0000","last_active":"2024-09-21T22:01:55.156953+0000","last_peered":"2024-09-21T22:01:55.156953+0000","last_clean":"2024-09-21T22:01:55.156953+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:01:55.156953+0000","last_undegraded":"2024-09-21T22:01:55.156953+0000","last_fullsized":"2024-09-21T22:01:55.156953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:56:43.646897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096701700000000003,"stat_sum":{"num_bytes":23594662,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":10,"num_read":1981,"num_read_kb":12591,"num_write":287,"num_write_kb":12886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"78'506","reported_seq":2036,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.015135+0000","last_change":"2024-09-21T22:01:39.894731+0000","last_active":"2024-09-21T22:01:57.015135+0000","last_peered":"2024-09-21T22:01:57.015135+0000","last_clean":"2024-09-21T22:01:57.015135+0000","last_became_active":"2024-09-21T22:01:39.893876+0000","last_became_peered":"2024-09-21T22:01:39.893876+0000","last_unstale":"2024-09-21T22:01:57.015135+0000","last_undegraded":"2024-09-21T22:01:57.015135+0000","last_fullsized":"2024-09-21T22:01:57.015135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:48:43.289342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064754199999999997,"stat_sum":{"num_bytes":68210790,"num_objects":58,"num_object_clones":15,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":13,"num_read":3037,"num_read_kb":16283,"num_write":701,"num_write_kb":7609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":4275862,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"79'1006","reported_seq":3084,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.010170+0000","last_change":"2024-09-21T22:00:56.175600+0000","last_active":"2024-09-21T22:01:57.010170+0000","last_peered":"2024-09-21T22:01:57.010170+0000","last_clean":"2024-09-21T22:01:57.010170+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:01:57.010170+0000","last_undegraded":"2024-09-21T22:01:57.010170+0000","last_fullsized":"2024-09-21T22:01:57.010170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1006,"log_dups_size":0,"ondisk_log_size":1006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:49:05.857869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003077237,"stat_sum":{"num_bytes":43808598,"num_objects":64,"num_object_clones":19,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":19,"num_read":7296,"num_read_kb":21446,"num_write":1365,"num_write_kb":14324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"79'339","reported_seq":4695,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.033486+0000","last_change":"2024-09-21T22:00:56.175356+0000","last_active":"2024-09-21T22:01:57.033486+0000","last_peered":"2024-09-21T22:01:57.033486+0000","last_clean":"2024-09-21T22:01:57.033486+0000","last_became_active":"2024-09-21T22:00:54.161171+0000","last_became_peered":"2024-09-21T22:00:54.161171+0000","last_unstale":"2024-09-21T22:01:57.033486+0000","last_undegraded":"2024-09-21T22:01:57.033486+0000","last_fullsized":"2024-09-21T22:01:57.033486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:32:17.214009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028551459999999998,"stat_sum":{"num_bytes":84739686,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":12,"num_read":4842,"num_read_kb":27320,"num_write":384,"num_write_kb":18081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'335","reported_seq":1888,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T22:01:55.342484+0000","last_change":"2024-09-21T22:00:56.180837+0000","last_active":"2024-09-21T22:01:55.342484+0000","last_peered":"2024-09-21T22:01:55.342484+0000","last_clean":"2024-09-21T22:01:55.342484+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:01:55.342484+0000","last_undegraded":"2024-09-21T22:01:55.342484+0000","last_fullsized":"2024-09-21T22:01:55.342484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:55.939565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000536288,"stat_sum":{"num_bytes":42447085,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":7,"num_read":2225,"num_read_kb":20876,"num_write":450,"num_write_kb":14712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"79'621","reported_seq":3969,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.029603+0000","last_change":"2024-09-21T22:00:56.166249+0000","last_active":"2024-09-21T22:01:57.029603+0000","last_peered":"2024-09-21T22:01:57.029603+0000","last_clean":"2024-09-21T22:01:57.029603+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:01:57.029603+0000","last_undegraded":"2024-09-21T22:01:57.029603+0000","last_fullsized":"2024-09-21T22:01:57.029603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:25:10.271596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085766300000000005,"stat_sum":{"num_bytes":26907832,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":7043,"num_read_kb":10802,"num_write":849,"num_write_kb":6612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"79'460","reported_seq":4350,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.011506+0000","last_change":"2024-09-21T22:00:56.167992+0000","last_active":"2024-09-21T22:01:57.011506+0000","last_peered":"2024-09-21T22:01:57.011506+0000","last_clean":"2024-09-21T22:01:57.011506+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:01:57.011506+0000","last_undegraded":"2024-09-21T22:01:57.011506+0000","last_fullsized":"2024-09-21T22:01:57.011506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:52:29.009468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000312307,"stat_sum":{"num_bytes":52526455,"num_objects":58,"num_object_clones":15,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":16,"num_read":5362,"num_read_kb":18370,"num_write":591,"num_write_kb":6450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"79'277","reported_seq":1613,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.014934+0000","last_change":"2024-09-21T22:00:56.158344+0000","last_active":"2024-09-21T22:01:57.014934+0000","last_peered":"2024-09-21T22:01:57.014934+0000","last_clean":"2024-09-21T22:01:57.014934+0000","last_became_active":"2024-09-21T22:00:54.155140+0000","last_became_peered":"2024-09-21T22:00:54.155140+0000","last_unstale":"2024-09-21T22:01:57.014934+0000","last_undegraded":"2024-09-21T22:01:57.014934+0000","last_fullsized":"2024-09-21T22:01:57.014934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:19.314627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037013200000000001,"stat_sum":{"num_bytes":71185898,"num_objects":58,"num_object_clones":16,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":14,"num_read":1904,"num_read_kb":12790,"num_write":259,"num_write_kb":6327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"78'310","reported_seq":2666,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T22:01:55.372266+0000","last_change":"2024-09-21T22:00:56.181482+0000","last_active":"2024-09-21T22:01:55.372266+0000","last_peered":"2024-09-21T22:01:55.372266+0000","last_clean":"2024-09-21T22:01:55.372266+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:01:55.372266+0000","last_undegraded":"2024-09-21T22:01:55.372266+0000","last_fullsized":"2024-09-21T22:01:55.372266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:52:11.253947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001057845,"stat_sum":{"num_bytes":38692542,"num_objects":60,"num_object_clones":16,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":16,"num_read":4053,"num_read_kb":31918,"num_write":318,"num_write_kb":20910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"79'413","reported_seq":4765,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.010037+0000","last_change":"2024-09-21T22:00:56.175667+0000","last_active":"2024-09-21T22:01:57.010037+0000","last_peered":"2024-09-21T22:01:57.010037+0000","last_clean":"2024-09-21T22:01:57.010037+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:01:57.010037+0000","last_undegraded":"2024-09-21T22:01:57.010037+0000","last_fullsized":"2024-09-21T22:01:57.010037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:01:06.141814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031184279999999999,"stat_sum":{"num_bytes":77670522,"num_objects":62,"num_object_clones":20,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":18,"num_read":5244,"num_read_kb":29376,"num_write":507,"num_write_kb":12021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"77'273","reported_seq":1396,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.017606+0000","last_change":"2024-09-21T22:00:56.161375+0000","last_active":"2024-09-21T22:01:57.017606+0000","last_peered":"2024-09-21T22:01:57.017606+0000","last_clean":"2024-09-21T22:01:57.017606+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:01:57.017606+0000","last_undegraded":"2024-09-21T22:01:57.017606+0000","last_fullsized":"2024-09-21T22:01:57.017606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:40:02.739858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057728900000000004,"stat_sum":{"num_bytes":62300382,"num_objects":48,"num_object_clones":14,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":13,"num_read":1730,"num_read_kb":13999,"num_write":320,"num_write_kb":9924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"79'359","reported_seq":2063,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.029366+0000","last_change":"2024-09-21T22:00:56.165733+0000","last_active":"2024-09-21T22:01:57.029366+0000","last_peered":"2024-09-21T22:01:57.029366+0000","last_clean":"2024-09-21T22:01:57.029366+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:01:57.029366+0000","last_undegraded":"2024-09-21T22:01:57.029366+0000","last_fullsized":"2024-09-21T22:01:57.029366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:05:10.899547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039301800000000002,"stat_sum":{"num_bytes":52375129,"num_objects":60,"num_object_clones":19,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":17,"num_read":2733,"num_read_kb":21361,"num_write":399,"num_write_kb":9818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.017809+0000","last_change":"2024-09-21T22:01:36.874875+0000","last_active":"2024-09-21T22:01:57.017809+0000","last_peered":"2024-09-21T22:01:57.017809+0000","last_clean":"2024-09-21T22:01:57.017809+0000","last_became_active":"2024-09-21T22:01:36.874561+0000","last_became_peered":"2024-09-21T22:01:36.874561+0000","last_unstale":"2024-09-21T22:01:57.017809+0000","last_undegraded":"2024-09-21T22:01:57.017809+0000","last_fullsized":"2024-09-21T22:01:57.017809+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:00:04.279405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"78'452","reported_seq":2647,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T22:01:55.342331+0000","last_change":"2024-09-21T22:00:56.180714+0000","last_active":"2024-09-21T22:01:55.342331+0000","last_peered":"2024-09-21T22:01:55.342331+0000","last_clean":"2024-09-21T22:01:55.342331+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:01:55.342331+0000","last_undegraded":"2024-09-21T22:01:55.342331+0000","last_fullsized":"2024-09-21T22:01:55.342331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:19:13.203939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043178500000000001,"stat_sum":{"num_bytes":82352089,"num_objects":52,"num_object_clones":16,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":11,"num_read":3609,"num_read_kb":28809,"num_write":630,"num_write_kb":20474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.029285+0000","last_change":"2024-09-21T22:01:36.878078+0000","last_active":"2024-09-21T22:01:57.029285+0000","last_peered":"2024-09-21T22:01:57.029285+0000","last_clean":"2024-09-21T22:01:57.029285+0000","last_became_active":"2024-09-21T22:01:36.877817+0000","last_became_peered":"2024-09-21T22:01:36.877817+0000","last_unstale":"2024-09-21T22:01:57.029285+0000","last_undegraded":"2024-09-21T22:01:57.029285+0000","last_fullsized":"2024-09-21T22:01:57.029285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:28:22.652563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'277","reported_seq":1918,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.015027+0000","last_change":"2024-09-21T22:00:56.159977+0000","last_active":"2024-09-21T22:01:57.015027+0000","last_peered":"2024-09-21T22:01:57.015027+0000","last_clean":"2024-09-21T22:01:57.015027+0000","last_became_active":"2024-09-21T22:00:54.162377+0000","last_became_peered":"2024-09-21T22:00:54.162377+0000","last_unstale":"2024-09-21T22:01:57.015027+0000","last_undegraded":"2024-09-21T22:01:57.015027+0000","last_fullsized":"2024-09-21T22:01:57.015027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:54:46.890360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069122900000000002,"stat_sum":{"num_bytes":22794923,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":2800,"num_read_kb":14765,"num_write":256,"num_write_kb":7660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.017738+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:01:57.017738+0000","last_peered":"2024-09-21T22:01:57.017738+0000","last_clean":"2024-09-21T22:01:57.017738+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:01:57.017738+0000","last_undegraded":"2024-09-21T22:01:57.017738+0000","last_fullsized":"2024-09-21T22:01:57.017738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"80'1054","reported_seq":5687,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.022185+0000","last_change":"2024-09-21T22:00:56.158198+0000","last_active":"2024-09-21T22:01:57.022185+0000","last_peered":"2024-09-21T22:01:57.022185+0000","last_clean":"2024-09-21T22:01:57.022185+0000","last_became_active":"2024-09-21T22:00:54.158128+0000","last_became_peered":"2024-09-21T22:00:54.158128+0000","last_unstale":"2024-09-21T22:01:57.022185+0000","last_undegraded":"2024-09-21T22:01:57.022185+0000","last_fullsized":"2024-09-21T22:01:57.022185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:26.473761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046529200000000002,"stat_sum":{"num_bytes":85324760,"num_objects":47,"num_object_clones":11,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":11,"num_read":10175,"num_read_kb":30032,"num_write":1542,"num_write_kb":9201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T22:01:55.002551+0000","last_change":"2024-09-21T22:00:54.156721+0000","last_active":"2024-09-21T22:01:55.002551+0000","last_peered":"2024-09-21T22:01:55.002551+0000","last_clean":"2024-09-21T22:01:55.002551+0000","last_became_active":"2024-09-21T22:00:54.156336+0000","last_became_peered":"2024-09-21T22:00:54.156336+0000","last_unstale":"2024-09-21T22:01:55.002551+0000","last_undegraded":"2024-09-21T22:01:55.002551+0000","last_fullsized":"2024-09-21T22:01:55.002551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:54:12.268488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'327","reported_seq":1669,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.010173+0000","last_change":"2024-09-21T22:00:56.175852+0000","last_active":"2024-09-21T22:01:57.010173+0000","last_peered":"2024-09-21T22:01:57.010173+0000","last_clean":"2024-09-21T22:01:57.010173+0000","last_became_active":"2024-09-21T22:00:54.156623+0000","last_became_peered":"2024-09-21T22:00:54.156623+0000","last_unstale":"2024-09-21T22:01:57.010173+0000","last_undegraded":"2024-09-21T22:01:57.010173+0000","last_fullsized":"2024-09-21T22:01:57.010173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:38:34.277606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031408949999999999,"stat_sum":{"num_bytes":61543026,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":15,"num_read":2166,"num_read_kb":14421,"num_write":373,"num_write_kb":9451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"79'348","reported_seq":1702,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.029466+0000","last_change":"2024-09-21T22:00:56.166325+0000","last_active":"2024-09-21T22:01:57.029466+0000","last_peered":"2024-09-21T22:01:57.029466+0000","last_clean":"2024-09-21T22:01:57.029466+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:01:57.029466+0000","last_undegraded":"2024-09-21T22:01:57.029466+0000","last_fullsized":"2024-09-21T22:01:57.029466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:48:42.389296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091363999999999996,"stat_sum":{"num_bytes":60738587,"num_objects":48,"num_object_clones":11,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":2093,"num_read_kb":16086,"num_write":427,"num_write_kb":11829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.009913+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:01:57.009913+0000","last_peered":"2024-09-21T22:01:57.009913+0000","last_clean":"2024-09-21T22:01:57.009913+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:01:57.009913+0000","last_undegraded":"2024-09-21T22:01:57.009913+0000","last_fullsized":"2024-09-21T22:01:57.009913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'217","reported_seq":1409,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.022133+0000","last_change":"2024-09-21T22:00:56.158370+0000","last_active":"2024-09-21T22:01:57.022133+0000","last_peered":"2024-09-21T22:01:57.022133+0000","last_clean":"2024-09-21T22:01:57.022133+0000","last_became_active":"2024-09-21T22:00:54.156923+0000","last_became_peered":"2024-09-21T22:00:54.156923+0000","last_unstale":"2024-09-21T22:01:57.022133+0000","last_undegraded":"2024-09-21T22:01:57.022133+0000","last_fullsized":"2024-09-21T22:01:57.022133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:06:08.377310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065359599999999999,"stat_sum":{"num_bytes":69882717,"num_objects":47,"num_object_clones":12,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":1144,"num_read_kb":13255,"num_write":210,"num_write_kb":10031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.022043+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:01:57.022043+0000","last_peered":"2024-09-21T22:01:57.022043+0000","last_clean":"2024-09-21T22:01:57.022043+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:01:57.022043+0000","last_undegraded":"2024-09-21T22:01:57.022043+0000","last_fullsized":"2024-09-21T22:01:57.022043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"78'154","reported_seq":1064,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T22:01:55.589587+0000","last_change":"2024-09-21T22:00:56.180594+0000","last_active":"2024-09-21T22:01:55.589587+0000","last_peered":"2024-09-21T22:01:55.589587+0000","last_clean":"2024-09-21T22:01:55.589587+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:01:55.589587+0000","last_undegraded":"2024-09-21T22:01:55.589587+0000","last_fullsized":"2024-09-21T22:01:55.589587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:52.623977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039822099999999998,"stat_sum":{"num_bytes":28380931,"num_objects":47,"num_object_clones":15,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":11,"num_read":809,"num_read_kb":19933,"num_write":160,"num_write_kb":9459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.017421+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:01:57.017421+0000","last_peered":"2024-09-21T22:01:57.017421+0000","last_clean":"2024-09-21T22:01:57.017421+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:01:57.017421+0000","last_undegraded":"2024-09-21T22:01:57.017421+0000","last_fullsized":"2024-09-21T22:01:57.017421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"79'359","reported_seq":1965,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.014952+0000","last_change":"2024-09-21T22:00:56.159828+0000","last_active":"2024-09-21T22:01:57.014952+0000","last_peered":"2024-09-21T22:01:57.014952+0000","last_clean":"2024-09-21T22:01:57.014952+0000","last_became_active":"2024-09-21T22:00:54.157660+0000","last_became_peered":"2024-09-21T22:00:54.157660+0000","last_unstale":"2024-09-21T22:01:57.014952+0000","last_undegraded":"2024-09-21T22:01:57.014952+0000","last_fullsized":"2024-09-21T22:01:57.014952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:21:12.379813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065768700000000001,"stat_sum":{"num_bytes":68558098,"num_objects":52,"num_object_clones":11,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":3207,"num_read_kb":13068,"num_write":334,"num_write_kb":7740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.009910+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:01:57.009910+0000","last_peered":"2024-09-21T22:01:57.009910+0000","last_clean":"2024-09-21T22:01:57.009910+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:01:57.009910+0000","last_undegraded":"2024-09-21T22:01:57.009910+0000","last_fullsized":"2024-09-21T22:01:57.009910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":288,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.017528+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:01:57.017528+0000","last_peered":"2024-09-21T22:01:57.017528+0000","last_clean":"2024-09-21T22:01:57.017528+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:01:57.017528+0000","last_undegraded":"2024-09-21T22:01:57.017528+0000","last_fullsized":"2024-09-21T22:01:57.017528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"79'477","reported_seq":5483,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.014939+0000","last_change":"2024-09-21T22:00:56.159517+0000","last_active":"2024-09-21T22:01:57.014939+0000","last_peered":"2024-09-21T22:01:57.014939+0000","last_clean":"2024-09-21T22:01:57.014939+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:01:57.014939+0000","last_undegraded":"2024-09-21T22:01:57.014939+0000","last_fullsized":"2024-09-21T22:01:57.014939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:43:08.297671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053085999999999997,"stat_sum":{"num_bytes":91344095,"num_objects":74,"num_object_clones":22,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":23,"num_read":7058,"num_read_kb":17256,"num_write":545,"num_write_kb":10590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"79'400","reported_seq":2711,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.029301+0000","last_change":"2024-09-21T22:00:56.166480+0000","last_active":"2024-09-21T22:01:57.029301+0000","last_peered":"2024-09-21T22:01:57.029301+0000","last_clean":"2024-09-21T22:01:57.029301+0000","last_became_active":"2024-09-21T22:00:54.160321+0000","last_became_peered":"2024-09-21T22:00:54.160321+0000","last_unstale":"2024-09-21T22:01:57.029301+0000","last_undegraded":"2024-09-21T22:01:57.029301+0000","last_fullsized":"2024-09-21T22:01:57.029301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:43:03.754982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010281190000000001,"stat_sum":{"num_bytes":41444944,"num_objects":58,"num_object_clones":16,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":10,"num_read":4301,"num_read_kb":25864,"num_write":457,"num_write_kb":14684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'351","reported_seq":946,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.029268+0000","last_change":"2024-09-21T22:01:39.894882+0000","last_active":"2024-09-21T22:01:57.029268+0000","last_peered":"2024-09-21T22:01:57.029268+0000","last_clean":"2024-09-21T22:01:57.029268+0000","last_became_active":"2024-09-21T22:01:39.894341+0000","last_became_peered":"2024-09-21T22:01:39.894341+0000","last_unstale":"2024-09-21T22:01:57.029268+0000","last_undegraded":"2024-09-21T22:01:57.029268+0000","last_fullsized":"2024-09-21T22:01:57.029268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:18:21.546478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090320500000000002,"stat_sum":{"num_bytes":86266131,"num_objects":53,"num_object_clones":12,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":18,"num_read":1724,"num_read_kb":4336,"num_write":386,"num_write_kb":7088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'233","reported_seq":1260,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.015043+0000","last_change":"2024-09-21T22:00:56.159527+0000","last_active":"2024-09-21T22:01:57.015043+0000","last_peered":"2024-09-21T22:01:57.015043+0000","last_clean":"2024-09-21T22:01:57.015043+0000","last_became_active":"2024-09-21T22:00:54.156515+0000","last_became_peered":"2024-09-21T22:00:54.156515+0000","last_unstale":"2024-09-21T22:01:57.015043+0000","last_undegraded":"2024-09-21T22:01:57.015043+0000","last_fullsized":"2024-09-21T22:01:57.015043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:13:42.757795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073161999999999999,"stat_sum":{"num_bytes":77930349,"num_objects":56,"num_object_clones":13,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":12,"num_read":1068,"num_read_kb":18850,"num_write":278,"num_write_kb":14555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"80'638","reported_seq":2434,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.019572+0000","last_change":"2024-09-21T22:00:56.175447+0000","last_active":"2024-09-21T22:01:57.019572+0000","last_peered":"2024-09-21T22:01:57.019572+0000","last_clean":"2024-09-21T22:01:57.019572+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:01:57.019572+0000","last_undegraded":"2024-09-21T22:01:57.019572+0000","last_fullsized":"2024-09-21T22:01:57.019572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:53:14.005734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029196539999999998,"stat_sum":{"num_bytes":59203014,"num_objects":66,"num_object_clones":20,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":16,"num_read":3744,"num_read_kb":22190,"num_write":846,"num_write_kb":14582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"80'228","reported_seq":3503,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.033084+0000","last_change":"2024-09-21T22:00:56.161329+0000","last_active":"2024-09-21T22:01:57.033084+0000","last_peered":"2024-09-21T22:01:57.033084+0000","last_clean":"2024-09-21T22:01:57.033084+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:01:57.033084+0000","last_undegraded":"2024-09-21T22:01:57.033084+0000","last_fullsized":"2024-09-21T22:01:57.033084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:15:01.492056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000674853,"stat_sum":{"num_bytes":81015720,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":10,"num_read":3269,"num_read_kb":16646,"num_write":219,"num_write_kb":6565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"78'652","reported_seq":1907,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.017593+0000","last_change":"2024-09-21T22:00:56.160920+0000","last_active":"2024-09-21T22:01:57.017593+0000","last_peered":"2024-09-21T22:01:57.017593+0000","last_clean":"2024-09-21T22:01:57.017593+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:01:57.017593+0000","last_undegraded":"2024-09-21T22:01:57.017593+0000","last_fullsized":"2024-09-21T22:01:57.017593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:57:00.441686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035276399999999999,"stat_sum":{"num_bytes":34170635,"num_objects":36,"num_object_clones":7,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":4121,"num_read_kb":12739,"num_write":1028,"num_write_kb":5797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"79'504","reported_seq":1726,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.017773+0000","last_change":"2024-09-21T22:00:56.161162+0000","last_active":"2024-09-21T22:01:57.017773+0000","last_peered":"2024-09-21T22:01:57.017773+0000","last_clean":"2024-09-21T22:01:57.017773+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:01:57.017773+0000","last_undegraded":"2024-09-21T22:01:57.017773+0000","last_fullsized":"2024-09-21T22:01:57.017773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:09:57.063841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054637399999999997,"stat_sum":{"num_bytes":100845516,"num_objects":62,"num_object_clones":15,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":10,"num_read":2439,"num_read_kb":16183,"num_write":660,"num_write_kb":12386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"78'208","reported_seq":693,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T22:01:55.391463+0000","last_change":"2024-09-21T22:01:39.894633+0000","last_active":"2024-09-21T22:01:55.391463+0000","last_peered":"2024-09-21T22:01:55.391463+0000","last_clean":"2024-09-21T22:01:55.391463+0000","last_became_active":"2024-09-21T22:01:39.894085+0000","last_became_peered":"2024-09-21T22:01:39.894085+0000","last_unstale":"2024-09-21T22:01:55.391463+0000","last_undegraded":"2024-09-21T22:01:55.391463+0000","last_fullsized":"2024-09-21T22:01:55.391463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:09:29.270110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297588,"stat_sum":{"num_bytes":34210813,"num_objects":43,"num_object_clones":15,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":16,"num_read":534,"num_read_kb":14573,"num_write":218,"num_write_kb":16588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"79'475","reported_seq":1863,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.017829+0000","last_change":"2024-09-21T22:00:56.160905+0000","last_active":"2024-09-21T22:01:57.017829+0000","last_peered":"2024-09-21T22:01:57.017829+0000","last_clean":"2024-09-21T22:01:57.017829+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:01:57.017829+0000","last_undegraded":"2024-09-21T22:01:57.017829+0000","last_fullsized":"2024-09-21T22:01:57.017829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:25:34.848103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042909099999999999,"stat_sum":{"num_bytes":48775912,"num_objects":58,"num_object_clones":18,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":15,"num_read":2620,"num_read_kb":22724,"num_write":633,"num_write_kb":13342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"78'350","reported_seq":1469,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T22:01:55.403453+0000","last_change":"2024-09-21T22:00:56.181344+0000","last_active":"2024-09-21T22:01:55.403453+0000","last_peered":"2024-09-21T22:01:55.403453+0000","last_clean":"2024-09-21T22:01:55.403453+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:01:55.403453+0000","last_undegraded":"2024-09-21T22:01:55.403453+0000","last_fullsized":"2024-09-21T22:01:55.403453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:06.943689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096881799999999998,"stat_sum":{"num_bytes":29770097,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":8,"num_read":2115,"num_read_kb":20835,"num_write":459,"num_write_kb":8289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"79'246","reported_seq":2236,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T22:01:57.017666+0000","last_change":"2024-09-21T22:00:56.161104+0000","last_active":"2024-09-21T22:01:57.017666+0000","last_peered":"2024-09-21T22:01:57.017666+0000","last_clean":"2024-09-21T22:01:57.017666+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:01:57.017666+0000","last_undegraded":"2024-09-21T22:01:57.017666+0000","last_fullsized":"2024-09-21T22:01:57.017666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:33:55.720012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051462399999999998,"stat_sum":{"num_bytes":56904545,"num_objects":63,"num_object_clones":22,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":19,"num_read":2227,"num_read_kb":28802,"num_write":232,"num_write_kb":11013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1865916483,"num_objects":1688,"num_object_clones":466,"num_object_copies":3376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1688,"num_whiteouts":433,"num_read":108673,"num_read_kb":608499,"num_write":16323,"num_write_kb":360998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":25180772,"num_keys_recovered":72,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":60702720,"data_stored":626394718,"data_compressed":21126789,"data_compressed_allocated":50532352,"data_compressed_original":620625476,"omap_allocated":0,"internal_metadata":0},"log_size":13116,"ondisk_log_size":13116,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52920,"kb_used_data":9256,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94318920,"statfs":{"total":96636764160,"available":96582574080,"internally_reserved":0,"allocated":9478144,"data_stored":86437373,"data_compressed":3271911,"data_compressed_allocated":7081984,"data_compressed_original":85146523,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":0,"seq":60129542164,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":9696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":9928704,"data_stored":98341178,"data_compressed":2637502,"data_compressed_allocated":7602176,"data_compressed_original":97172411,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62500,"kb_used_data":13268,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94309340,"statfs":{"total":96636764160,"available":96572764160,"internally_reserved":0,"allocated":13586432,"data_stored":132970140,"data_compressed":4303757,"data_compressed_allocated":10633216,"data_compressed_original":131371421,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36148,"kb_used_data":9112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335692,"statfs":{"total":96636764160,"available":96599748608,"internally_reserved":0,"allocated":9330688,"data_stored":82681469,"data_compressed":2957924,"data_compressed_allocated":6868992,"data_compressed_original":81410067,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40288,"kb_used_data":4940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331552,"statfs":{"total":96636764160,"available":96595509248,"internally_reserved":0,"allocated":5058560,"data_stored":41878929,"data_compressed":1707951,"data_compressed_allocated":3383296,"data_compressed_original":41016969,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46232,"kb_used_data":6724,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325608,"statfs":{"total":96636764160,"available":96589422592,"internally_reserved":0,"allocated":6885376,"data_stored":50846751,"data_compressed":2327992,"data_compressed_allocated":4734976,"data_compressed_original":49735984,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50268,"kb_used_data":10764,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321572,"statfs":{"total":96636764160,"available":96585289728,"internally_reserved":0,"allocated":11022336,"data_stored":119713121,"data_compressed":3264438,"data_compressed_allocated":8675328,"data_compressed_original":118437253,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10346496,"data_stored":120910501,"data_compressed":3392511,"data_compressed_allocated":8896512,"data_compressed_original":120046981,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":50421332,"data_compressed":2327992,"data_compressed_allocated":4734976,"data_compressed_original":49735984,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4136960,"data_stored":41453529,"data_compressed":1707951,"data_compressed_allocated":3383296,"data_compressed_original":41016969,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":82249862,"data_compressed":2957924,"data_compressed_allocated":6868992,"data_compressed_original":81410067,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12660736,"data_stored":132544676,"data_compressed":4303757,"data_compressed_allocated":10633216,"data_compressed_original":131371421,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8998912,"data_stored":97915695,"data_compressed":2637502,"data_compressed_allocated":7602176,"data_compressed_original":97172411,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1712128,"data_stored":15477582,"data_compressed":532173,"data_compressed_allocated":1368064,"data_compressed_original":15298560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8495104,"data_stored":85421541,"data_compressed":3266979,"data_compressed_allocated":7045120,"data_compressed_original":84573083,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:01:58.549 INFO:tasks.thrashosds.thrasher:Setting 3.5 to [3, 2] 2024-09-21T22:01:58.549 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.5', '3', '2'] 2024-09-21T22:01:58.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.5 3 2 2024-09-21T22:01:58.556 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:01:58.562 INFO:teuthology.orchestra.run.smithi102.stdout:5609 write 0xeb377ff thru 0xeb3f97c (0x817e bytes) 2024-09-21T22:01:58.567 INFO:teuthology.orchestra.run.smithi102.stdout:5610 write 0xd71b374 thru 0xd7289ee (0xd67b bytes) 2024-09-21T22:01:58.577 INFO:teuthology.orchestra.run.smithi102.stdout:5611 write 0xece7897 thru 0xece95b7 (0x1d21 bytes) 2024-09-21T22:01:58.580 INFO:teuthology.orchestra.run.smithi102.stdout:5612 write 0x99143cb thru 0x99234e3 (0xf119 bytes) 2024-09-21T22:01:58.584 INFO:teuthology.orchestra.run.smithi102.stdout:5614 trunc from 0xece95b8 to 0xe7167c9 2024-09-21T22:01:58.592 INFO:teuthology.orchestra.run.smithi102.stdout:5616 writesame 0x92ccbed thru 0x92d4ef0 data_size 0x5(0x8304 bytes) 2024-09-21T22:01:58.597 INFO:teuthology.orchestra.run.smithi102.stdout:5618 read 0x3a44752 thru 0x3a52006 (0xd8b5 bytes) 2024-09-21T22:01:58.597 INFO:teuthology.orchestra.run.smithi102.stdout:5619 read 0x2a8bbe9 thru 0x2a8c54e (0x966 bytes) 2024-09-21T22:01:58.598 INFO:teuthology.orchestra.run.smithi102.stdout:5620 write 0xbe13e41 thru 0xbe209fc (0xcbbc bytes) 2024-09-21T22:01:58.604 INFO:teuthology.orchestra.run.smithi102.stdout:5623 read 0xde54cc9 thru 0xde5a9a3 (0x5cdb bytes) 2024-09-21T22:01:58.604 INFO:teuthology.orchestra.run.smithi102.stdout:5624 writesame 0x1441e6c thru 0x144fb66 data_size 0x3(0xdcfb bytes) 2024-09-21T22:01:58.612 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:58.610+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:58.617 INFO:teuthology.orchestra.run.smithi102.stdout:5625 read 0xdd3f97e thru 0xdd4bf04 (0xc587 bytes) 2024-09-21T22:01:58.617 INFO:teuthology.orchestra.run.smithi102.stdout:5626 write 0x36e8332 thru 0x36f06ab (0x837a bytes) 2024-09-21T22:01:58.623 INFO:teuthology.orchestra.run.smithi102.stdout:5627 write 0x5619f50 thru 0x5625ba6 (0xbc57 bytes) 2024-09-21T22:01:58.630 INFO:teuthology.orchestra.run.smithi102.stdout:5628 read 0xb147ad thru 0xb20249 (0xba9d bytes) 2024-09-21T22:01:58.631 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:01:58.631 INFO:teuthology.orchestra.run.smithi102.stdout:5630 write 0xc1f2805 thru 0xc1fe582 (0xbd7e bytes) 2024-09-21T22:01:58.636 INFO:teuthology.orchestra.run.smithi102.stdout:5631 write 0x2e37f82 thru 0x2e3ec8e (0x6d0d bytes) 2024-09-21T22:01:58.644 INFO:teuthology.orchestra.run.smithi102.stdout:5633 writesame 0xd6bacba thru 0xd6c94f7 data_size 0x51(0xe83e bytes) 2024-09-21T22:01:58.651 INFO:teuthology.orchestra.run.smithi102.stdout:5634 writesame 0x739d56c thru 0x73ac489 data_size 0x2(0xef1e bytes) 2024-09-21T22:01:58.664 INFO:teuthology.orchestra.run.smithi102.stdout:5635 clone 44 order 22 su 16384 sc 6 2024-09-21T22:01:58.678 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:58.678 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:58.689 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:01:58.730 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:58.728+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:58.784 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:01:58.828 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:58.826+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:58.834 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:01:58.834 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:01:58.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:01:58.905 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:01:58.906 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:01:58.915 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:01:58.913+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:01:58.923 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:01:58.923 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:01:58.939 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:01:58.940 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:01:58.955 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:01:58.956 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:01:58.972 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:01:58.972 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:01:58.988 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:58.988 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:58.988 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:58.988 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:58.988 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:58.989 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:01:58.989 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:01:58.997 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:01:59.006 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:01:59.006 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:01:59.016 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:01:59.015+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:01:59.023 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:01:59.023 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:01:59.032 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:01:59.033 INFO:teuthology.orchestra.run.smithi102.stderr:set 3.5 pg_upmap mapping to [3,2] 2024-09-21T22:01:59.117 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:59.117 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:59.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.245498808999997, 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:01:59.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:01:59.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:01:59.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.122 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.122 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.245478816000002, 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:59.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:59.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:01:59.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.245359381, 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:01:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:01:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.132 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.245092675000002, 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.133 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:59.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:59.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:01:59.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:01:59.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:01:59.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:01:59.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:01:59.137 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.245062513000001, 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.138 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:01:59.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:01:59.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:59.142 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.245036976999998, 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:01:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:01:59.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.245014449000003, 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:01:59.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:01:59.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244990829000002, 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.151 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:59.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:01:59.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.155 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244970479999999, 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:01:59.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:01:59.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:01:59.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:01:59.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:01:59.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.160 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244948065999999, 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:01:59.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:01:59.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.165 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.166 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.166 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.166 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:59.166 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244771999000001, 2024-09-21T22:01:59.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:01:59.166 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.166 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.167 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.167 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:01:59.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.167 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:59.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:01:59.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:01:59.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244742991000003, 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.171 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244721159999997, 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.179 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244564015000002, 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.180 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:01:59.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244531545000001, 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.184 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:01:59.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:01:59.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:01:59.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:01:59.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:01:59.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244510013999999, 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.189 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:01:59.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244488697000001, 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:01:59.194 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:01:59.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:01:59.198 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244463254999999, 2024-09-21T22:01:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:01:59.199 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:01:59.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:01:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:01:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:01:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:01:59.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:01:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244442556000003, 2024-09-21T22:01:59.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:01:59.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:01:59.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.244421924000001, 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:01:59.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:01:59.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:01:59.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:01:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.213 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.213 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:59.213 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:59.115+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:59.214 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:01:59.255 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:59.253+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:59.318 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:01:59.317+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:01:59.358 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:59.358 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:59.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.358 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:80156 3.5 3.f7b69c85 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-21T22:01:59.358 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:01:59.358 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.31337748999999998, 2024-09-21T22:01:59.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.31339856500000002, 2024-09-21T22:01:59.359 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.359 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.359 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for peered", 2024-09-21T22:01:59.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.359 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 80156 2024-09-21T22:01:59.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.359 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:01:59.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:01:59.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043816+0000", 2024-09-21T22:01:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0839999999999999e-06 2024-09-21T22:01:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043825+0000", 2024-09-21T22:01:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2024-09-21T22:01:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043847+0000", 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1676999999999999e-05 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043858+0000", 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1199000000000001e-05 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043937+0000", 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9281000000000002e-05 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043950+0000", 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2513e-05 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:01:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 1 2024-09-21T22:01:59.364 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:59.367 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:01:59.420 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:01:59.418+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:01:59.470 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:59.470 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:01:59.470 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:01:59.470 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:01:59.470 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:59.479 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:01:59.524 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:01:59.522+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:01:59.584 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:01:59.584 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:01:59.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:01:59.584 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:01:59.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.584 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56953 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 425984~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.584 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:59.584 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326577779999999, 2024-09-21T22:01:59.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031605451, 2024-09-21T22:01:59.585 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.585 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.585 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.585 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56953 2024-09-21T22:01:59.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.586 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:59.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:59.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254975+0000", 2024-09-21T22:01:59.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.15e-07 2024-09-21T22:01:59.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254979+0000", 2024-09-21T22:01:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6399999999999999e-06 2024-09-21T22:01:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254984+0000", 2024-09-21T22:01:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4099999999999999e-06 2024-09-21T22:01:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254987+0000", 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.729e-06 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286387+0000", 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031400008 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286479+0000", 2024-09-21T22:01:59.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1768999999999995e-05 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286580+0000", 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010148 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.590 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56954 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 655360~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326562251, 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031833193000000003, 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56954 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.591 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254990+0000", 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254992+0000", 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1400000000000001e-06 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254995+0000", 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9629999999999998e-06 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.254997+0000", 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3970000000000001e-06 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286623+0000", 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031626354000000002 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286715+0000", 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2120999999999994e-05 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286823+0000", 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107997 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56955 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 884736~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.595 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326552876999999, 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032037574999999999, 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56955 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255000+0000", 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-07 2024-09-21T22:01:59.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255001+0000", 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0419999999999999e-06 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255006+0000", 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255010+0000", 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8700000000000002e-06 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286860+0000", 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031850695999999998 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.286941+0000", 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0419000000000004e-05 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287037+0000", 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6424999999999999e-05 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56956 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1114112~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255014+0000", 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326538143000001, 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032238259999999998, 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56956 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255014+0000", 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255014+0000", 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255015+0000", 2024-09-21T22:01:59.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3300000000000001e-07 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255016+0000", 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.313e-06 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255019+0000", 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3239999999999999e-06 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255022+0000", 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.729e-06 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287082+0000", 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032060403000000001 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287159+0000", 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6859000000000004e-05 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287253+0000", 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3399000000000005e-05 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56957 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1343488~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326527855, 2024-09-21T22:01:59.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032466460000000003, 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56957 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255025+0000", 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0100000000000001e-07 2024-09-21T22:01:59.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255026+0000", 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0690000000000001e-06 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255029+0000", 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8890000000000002e-06 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255031+0000", 2024-09-21T22:01:59.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5359999999999999e-06 2024-09-21T22:01:59.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287293+0000", 2024-09-21T22:01:59.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032262093999999998 2024-09-21T22:01:59.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287377+0000", 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3341e-05 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287491+0000", 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011433 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.610 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.611 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56958 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.611 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255034+0000", 2024-09-21T22:01:59.611 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326518277, 2024-09-21T22:01:59.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032659301000000002, 2024-09-21T22:01:59.611 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.611 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.611 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.611 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.612 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.612 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.612 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56958 2024-09-21T22:01:59.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.612 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255034+0000", 2024-09-21T22:01:59.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255034+0000", 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255035+0000", 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0199999999999998e-07 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255036+0000", 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.612e-06 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255041+0000", 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0220000000000004e-06 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255044+0000", 2024-09-21T22:01:59.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4729999999999999e-06 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287523+0000", 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032478928999999997 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287598+0000", 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5904999999999999e-05 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287694+0000", 2024-09-21T22:01:59.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5057999999999997e-05 2024-09-21T22:01:59.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.616 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.616 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56959 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1802240~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.616 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:59.616 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326505302999999, 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032794619999999997, 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56959 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:59.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:59.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255047+0000", 2024-09-21T22:01:59.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2100000000000001e-07 2024-09-21T22:01:59.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255049+0000", 2024-09-21T22:01:59.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.15e-06 2024-09-21T22:01:59.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255052+0000", 2024-09-21T22:01:59.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5449999999999999e-06 2024-09-21T22:01:59.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255055+0000", 2024-09-21T22:01:59.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5349999999999999e-06 2024-09-21T22:01:59.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287722+0000", 2024-09-21T22:01:59.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032667285999999997 2024-09-21T22:01:59.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287784+0000", 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2235000000000003e-05 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287842+0000", 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7648000000000001e-05 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56960 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326495244, 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033013893000000002, 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56960 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255057+0000", 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0200000000000001e-07 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255059+0000", 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.048e-06 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255062+0000", 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0189999999999998e-06 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255064+0000", 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.61e-06 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287888+0000", 2024-09-21T22:01:59.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032823475999999997 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.287968+0000", 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0339000000000004e-05 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288071+0000", 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000103199 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.627 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56975 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 212992~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255067+0000", 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326485218, 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033221667000000003, 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.628 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56975 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255067+0000", 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255067+0000", 2024-09-21T22:01:59.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255068+0000", 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.65e-07 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255072+0000", 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7770000000000002e-06 2024-09-21T22:01:59.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255078+0000", 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1500000000000004e-06 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255083+0000", 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7299999999999996e-06 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288111+0000", 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033027687999999999 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288190+0000", 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9065000000000003e-05 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288289+0000", 2024-09-21T22:01:59.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8992000000000004e-05 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56976 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255089+0000", 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326463054, 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033409467999999998, 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.633 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56976 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255089+0000", 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255089+0000", 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255090+0000", 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7700000000000004e-07 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255093+0000", 2024-09-21T22:01:59.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3189999999999999e-06 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255100+0000", 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1589999999999998e-06 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255104+0000", 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6410000000000001e-06 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288327+0000", 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033222584999999999 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288404+0000", 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7646999999999997e-05 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288499+0000", 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4539999999999999e-05 2024-09-21T22:01:59.637 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56977 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255112+0000", 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326440088, 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033612184000000003, 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.638 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56977 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255112+0000", 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255112+0000", 2024-09-21T22:01:59.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255113+0000", 2024-09-21T22:01:59.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000004e-07 2024-09-21T22:01:59.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255115+0000", 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1730000000000002e-06 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255122+0000", 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4710000000000004e-06 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255127+0000", 2024-09-21T22:01:59.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7379999999999999e-06 2024-09-21T22:01:59.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288540+0000", 2024-09-21T22:01:59.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033412301999999998 2024-09-21T22:01:59.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288622+0000", 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2194000000000006e-05 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288725+0000", 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102777 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.644 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56978 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.644 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255134+0000", 2024-09-21T22:01:59.644 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326418286999999, 2024-09-21T22:01:59.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033806969999999999, 2024-09-21T22:01:59.644 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.644 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.644 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56978 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255134+0000", 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255134+0000", 2024-09-21T22:01:59.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255135+0000", 2024-09-21T22:01:59.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:01:59.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255137+0000", 2024-09-21T22:01:59.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3700000000000002e-06 2024-09-21T22:01:59.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255143+0000", 2024-09-21T22:01:59.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1190000000000002e-06 2024-09-21T22:01:59.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255148+0000", 2024-09-21T22:01:59.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4700000000000004e-06 2024-09-21T22:01:59.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288785+0000", 2024-09-21T22:01:59.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033637453999999997 2024-09-21T22:01:59.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288854+0000", 2024-09-21T22:01:59.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8898000000000003e-05 2024-09-21T22:01:59.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288941+0000", 2024-09-21T22:01:59.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7247e-05 2024-09-21T22:01:59.650 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.650 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.650 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.650 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56979 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1130496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.650 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:59.650 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326398677, 2024-09-21T22:01:59.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033955731000000003, 2024-09-21T22:01:59.651 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.651 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.651 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.651 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56979 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:59.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255154+0000", 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255157+0000", 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.356e-06 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255163+0000", 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7689999999999999e-06 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255168+0000", 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9130000000000002e-06 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.288980+0000", 2024-09-21T22:01:59.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033811255999999998 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289050+0000", 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0691999999999993e-05 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289110+0000", 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9271999999999998e-05 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.655 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56980 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326374707999999, 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034096952, 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56980 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255178+0000", 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4999999999999998e-07 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255181+0000", 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3099999999999999e-06 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255188+0000", 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1250000000000004e-06 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255193+0000", 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9060000000000001e-06 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289144+0000", 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.033950928999999998 2024-09-21T22:01:59.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289204+0000", 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0544000000000002e-05 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289275+0000", 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0687999999999998e-05 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.660 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56981 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1589248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326353544, 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034304860999999999, 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.661 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56981 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255199+0000", 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255202+0000", 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1639999999999999e-06 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255207+0000", 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9410000000000004e-06 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255212+0000", 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289317+0000", 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034105115999999998 2024-09-21T22:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289399+0000", 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2094000000000004e-05 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289504+0000", 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010464299999999999 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56982 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 1818624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326335411000001, 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034446705000000001, 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56982 2024-09-21T22:01:59.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255217+0000", 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7500000000000001e-07 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255219+0000", 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4190000000000001e-06 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255222+0000", 2024-09-21T22:01:59.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.281e-06 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255225+0000", 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5289999999999998e-06 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289536+0000", 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034311087999999997 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289597+0000", 2024-09-21T22:01:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1359999999999995e-05 2024-09-21T22:01:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289664+0000", 2024-09-21T22:01:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6653e-05 2024-09-21T22:01:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.670 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.671 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.671 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:56983 3.8 3:17bcb607:::rbd_data.1124581ebce7.0000000000000000:25 [read 2048000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.671 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255227+0000", 2024-09-21T22:01:59.671 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326325149000001, 2024-09-21T22:01:59.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034580627000000003, 2024-09-21T22:01:59.671 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.671 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 56983 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255227+0000", 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255227+0000", 2024-09-21T22:01:59.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255228+0000", 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1299999999999999e-07 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255229+0000", 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0759999999999999e-06 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255232+0000", 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.881e-06 2024-09-21T22:01:59.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255234+0000", 2024-09-21T22:01:59.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3290000000000001e-06 2024-09-21T22:01:59.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289682+0000", 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034448631 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289748+0000", 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5464999999999997e-05 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289808+0000", 2024-09-21T22:01:59.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0031999999999997e-05 2024-09-21T22:01:59.677 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.677 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.677 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.677 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:57002 3.8 3:13575aeb:::rbd_data.112442ffa2ed.0000000000000007:24 [read 393216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.677 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:59.677 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326315447000001, 2024-09-21T22:01:59.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034726911999999999, 2024-09-21T22:01:59.677 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.678 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.678 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.678 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.678 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.678 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.678 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 57002 2024-09-21T22:01:59.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.678 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255237+0000", 2024-09-21T22:01:59.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255239+0000", 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5650000000000001e-06 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255244+0000", 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1499999999999998e-06 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255248+0000", 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3599999999999998e-06 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289833+0000", 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034584363999999999 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289891+0000", 2024-09-21T22:01:59.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8561999999999999e-05 2024-09-21T22:01:59.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289964+0000", 2024-09-21T22:01:59.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2619000000000004e-05 2024-09-21T22:01:59.682 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.682 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.683 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.683 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:57006 3.8 3:13575aeb:::rbd_data.112442ffa2ed.0000000000000007:24 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.683 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255254+0000", 2024-09-21T22:01:59.683 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.32629828, 2024-09-21T22:01:59.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034912427000000003, 2024-09-21T22:01:59.683 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.684 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.684 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.684 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.684 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.684 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.684 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 57006 2024-09-21T22:01:59.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.684 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255254+0000", 2024-09-21T22:01:59.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255254+0000", 2024-09-21T22:01:59.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255255+0000", 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255259+0000", 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8240000000000001e-06 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255265+0000", 2024-09-21T22:01:59.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255269+0000", 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3100000000000002e-06 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.289984+0000", 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034715357000000002 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290041+0000", 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7123000000000002e-05 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290167+0000", 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012530700000000001 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:57010 3.18 3:18405c99:::rbd_data.1124d06a34e4.000000000000000c:23 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:47.255276+0000", 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.326276239, 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034859288000000002, 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 57010 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:01:59.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255276+0000", 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255276+0000", 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255277+0000", 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8799999999999998e-07 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255279+0000", 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1940000000000001e-06 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255285+0000", 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9349999999999999e-06 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.255289+0000", 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4519999999999999e-06 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290003+0000", 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.034713711000000001 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290067+0000", 2024-09-21T22:01:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3944999999999998e-05 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:47.290136+0000", 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8663000000000003e-05 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:01:59.693 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:01:59.695 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:01:59.695 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:59.693+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:59.795 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:01:59.794+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:01:59.809 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:59.809 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:59.809 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:01:59.809 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:59.818 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:01:59.897 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:01:59.895+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:01:59.921 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:01:59.921 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:01:59.921 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:01:59.921 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:01:59.921 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:01:59.931 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:01:59.997 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:01:59.995+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:00.036 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:00.036 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:00.036 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:00.036 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:00.036 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.036 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.822227875000003, 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.037 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:02:00.038 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.039 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.040 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:02:00.041 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56963 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 622592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.780166795, 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021343747, 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.042 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56963 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.043 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2e-07 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253818+0000", 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1160000000000002e-06 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253823+0000", 2024-09-21T22:02:00.044 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253828+0000", 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.274987+0000", 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021158445000000001 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.045 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275065+0000", 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8407999999999999e-05 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275159+0000", 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3497000000000003e-05 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.046 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56964 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.780147478, 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021459051999999999, 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56964 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.047 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253835+0000", 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:00.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253837+0000", 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253842+0000", 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8080000000000001e-06 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253847+0000", 2024-09-21T22:02:00.049 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6099999999999999e-06 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275188+0000", 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021341057 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275230+0000", 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1941999999999999e-05 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.050 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275293+0000", 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3195999999999996e-05 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56965 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.780115477000001, 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021632274, 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.051 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56965 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.052 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253867+0000", 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253869+0000", 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253875+0000", 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0970000000000002e-06 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.053 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253880+0000", 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275329+0000", 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021448292000000001 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275407+0000", 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7946000000000002e-05 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.054 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275499+0000", 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1978000000000006e-05 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56966 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1310720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.78009563, 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021740731999999999, 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.055 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56966 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.056 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253888+0000", 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0669999999999999e-06 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253894+0000", 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8980000000000001e-06 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.057 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253900+0000", 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275526+0000", 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021625912000000001 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275569+0000", 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3043000000000001e-05 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275627+0000", 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7479000000000003e-05 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56967 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.780075458000001, 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021928007999999999, 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.059 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56967 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253907+0000", 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.41e-07 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253908+0000", 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.776e-06 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253914+0000", 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1950000000000002e-06 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.061 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253928+0000", 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3974e-05 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275662+0000", 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021734168000000002 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275740+0000", 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7807999999999998e-05 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.062 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275834+0000", 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4746000000000004e-05 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56968 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.780047315999999, 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022029615999999998, 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56968 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253935+0000", 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253937+0000", 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253943+0000", 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253948+0000", 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275861+0000", 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021913548000000001 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275905+0000", 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3795000000000003e-05 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275964+0000", 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8739000000000001e-05 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56969 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.780028647, 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022221162999999999, 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.067 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56969 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.068 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253955+0000", 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.874e-06 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253961+0000", 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999998e-06 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253965+0000", 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5260000000000004e-06 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276000+0000", 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022034611999999999 2024-09-21T22:02:00.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276078+0000", 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8311000000000003e-05 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276174+0000", 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6139999999999998e-05 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56984 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.071 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.780011029000001, 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022340279000000001, 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56984 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253973+0000", 2024-09-21T22:02:00.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.81e-06 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253979+0000", 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253983+0000", 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276203+0000", 2024-09-21T22:02:00.074 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022219848 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276248+0000", 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4880999999999999e-05 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276311+0000", 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3047999999999997e-05 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.075 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56985 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779993057, 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022528538000000001, 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56985 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253991+0000", 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1229999999999998e-06 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253997+0000", 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4759999999999997e-06 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254003+0000", 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.896e-06 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276347+0000", 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022344180000000002 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276424+0000", 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7014000000000005e-05 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276517+0000", 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3383999999999999e-05 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.079 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56986 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779973454, 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022636156000000001, 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56986 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.080 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254009+0000", 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:00.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254021+0000", 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2075e-05 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254027+0000", 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2910000000000004e-06 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254032+0000", 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0969999999999996e-06 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276545+0000", 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022513014000000001 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276588+0000", 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3183000000000003e-05 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276644+0000", 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6165999999999997e-05 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.083 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56987 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 868352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779942984, 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022813353000000001, 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56987 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.084 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254041+0000", 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254047+0000", 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254051+0000", 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6430000000000003e-06 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276680+0000", 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022628945000000001 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276758+0000", 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7775999999999995e-05 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276852+0000", 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4067999999999995e-05 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56988 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1097728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779925569, 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923770999999999, 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56988 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254058+0000", 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254064+0000", 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2950000000000001e-06 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254068+0000", 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1479999999999999e-06 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276880+0000", 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022812260000000001 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276923+0000", 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3347999999999999e-05 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276980+0000", 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6496000000000003e-05 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.091 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56989 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1327104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779908562999999, 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023109826999999999, 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56989 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254075+0000", 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.691e-06 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254081+0000", 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254085+0000", 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.498e-06 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277015+0000", 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929417000000001 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277092+0000", 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6625000000000006e-05 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277183+0000", 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1453999999999995e-05 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.095 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56990 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1556480~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779890416000001, 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023224305000000001, 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56990 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254092+0000", 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.22e-07 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254093+0000", 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7099999999999999e-06 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254099+0000", 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254103+0000", 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:02:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277211+0000", 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023107593999999999 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277254+0000", 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2762000000000002e-05 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277316+0000", 2024-09-21T22:02:00.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1876000000000002e-05 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56991 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779873070000001, 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023415498999999999, 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.100 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56991 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:00.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254111+0000", 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.813e-06 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254116+0000", 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254121+0000", 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5730000000000001e-06 2024-09-21T22:02:00.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277351+0000", 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023230621 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277431+0000", 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9818e-05 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277524+0000", 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2986999999999996e-05 2024-09-21T22:02:00.103 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56992 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 2015232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779855581, 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023528238999999999, 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.104 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56992 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254128+0000", 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8330000000000001e-06 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254134+0000", 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5729999999999998e-06 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254139+0000", 2024-09-21T22:02:00.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4790000000000004e-06 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277553+0000", 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023413607999999999 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277596+0000", 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3489000000000003e-05 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277654+0000", 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7911999999999997e-05 2024-09-21T22:02:00.107 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57020 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779358496, 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023243617000000001, 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.108 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57020 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254624+0000", 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254632+0000", 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1219999999999995e-06 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254640+0000", 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9370000000000004e-06 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254645+0000", 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3140000000000003e-06 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277690+0000", 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023044477000000001 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277768+0000", 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8594e-05 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277867+0000", 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8560999999999994e-05 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57021 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779329595, 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023344055999999998, 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.112 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57021 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254653+0000", 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254654+0000", 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254661+0000", 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254666+0000", 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277894+0000", 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023228029000000001 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277936+0000", 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2589000000000002e-05 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277996+0000", 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9967999999999999e-05 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57023 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 704512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 12.779310775999999, 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023525122999999998, 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.116 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57023 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.32e-07 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254679+0000", 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7479999999999993e-06 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254686+0000", 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254690+0000", 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7180000000000004e-06 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278021+0000", 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023330391999999998 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278097+0000", 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6464999999999994e-05 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278196+0000", 2024-09-21T22:02:00.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8852999999999997e-05 2024-09-21T22:02:00.120 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.120 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.120 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.120 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.120 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.120 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:00.121 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:00.122 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:00.120+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:00.222 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:00.221+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:00.265 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:00.265 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:00.265 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:00.265 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:00.274 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:00.358 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:00.357+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:00.417 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:00.417 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:00.417 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:00.417 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:00.417 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:00.425 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:00.423+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:00.425 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:00.525 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:00.524+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:00.570 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 56.516617562999997, 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.571 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:02:00.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:02:00.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:02:00.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29926 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3567616~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:02:00.576 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.639956302000002, 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028146526000000002, 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29926 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928549+0000", 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928550+0000", 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4499999999999997e-07 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928552+0000", 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1710000000000001e-06 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928558+0000", 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6690000000000003e-06 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928562+0000", 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2910000000000001e-06 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956591+0000", 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028029011999999999 2024-09-21T22:02:00.579 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956646+0000", 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5016999999999999e-05 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956696+0000", 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9920999999999999e-05 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29927 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3002368~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.639938073000003, 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028301160999999998, 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29927 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928568+0000", 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928569+0000", 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.395e-06 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928573+0000", 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.225e-06 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928575+0000", 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.583 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956723+0000", 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028148237 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956768+0000", 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4749999999999997e-05 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956869+0000", 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010078599999999999 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.584 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29928 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3043328~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.639919372999998, 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028496923, 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29928 2024-09-21T22:02:00.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928586+0000", 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928587+0000", 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4699999999999998e-07 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928588+0000", 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.313e-06 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928591+0000", 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1999999999999999e-06 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928598+0000", 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0890000000000002e-06 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.956939+0000", 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028341261 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957006+0000", 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6704000000000004e-05 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957083+0000", 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7108999999999996e-05 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.639903068999999, 2024-09-21T22:02:00.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:00.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:02:00.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:02:00.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.593 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.639893119, 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:00.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:00.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:02:00.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:02:00.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.639879716000003, 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.598 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.602 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.639870045000002, 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:00.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:02:00.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:02:00.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29937 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3248128~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.638092403000002, 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028121855000000001, 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29937 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930413+0000", 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930414+0000", 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930416+0000", 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-06 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930422+0000", 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0290000000000002e-06 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930435+0000", 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2404e-05 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958382+0000", 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027947339000000002 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958450+0000", 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7611e-05 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958535+0000", 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5680999999999995e-05 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.610 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29939 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3289088~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.638037674000003, 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028207189000000001, 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29939 2024-09-21T22:02:00.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930468+0000", 2024-09-21T22:02:00.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:00.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930471+0000", 2024-09-21T22:02:00.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1299999999999999e-06 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930476+0000", 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4410000000000001e-06 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930480+0000", 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.391e-06 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958565+0000", 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028084392999999999 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958617+0000", 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1706999999999998e-05 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958675+0000", 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8715999999999998e-05 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29941 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3330048~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.638000372, 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028386958, 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29941 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930505+0000", 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930506+0000", 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5999999999999999e-07 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930508+0000", 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.782e-06 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930514+0000", 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930518+0000", 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0949999999999998e-06 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958712+0000", 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028194745 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958788+0000", 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5556000000000006e-05 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958892+0000", 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000104304 2024-09-21T22:02:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.620 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.620 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.620 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29943 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3371008~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.620 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:02:00.620 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.637957036000003, 2024-09-21T22:02:00.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028512368999999999, 2024-09-21T22:02:00.620 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.620 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29943 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930549+0000", 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-07 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930551+0000", 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9080000000000002e-06 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930557+0000", 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6799999999999998e-06 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930561+0000", 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5399999999999997e-06 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958929+0000", 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028367277999999999 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.958988+0000", 2024-09-21T22:02:00.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8928000000000002e-05 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959061+0000", 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3460000000000005e-05 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29945 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3411968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.637918636999999, 2024-09-21T22:02:00.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028678985000000001, 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29945 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930588+0000", 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930589+0000", 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.939e-06 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930595+0000", 2024-09-21T22:02:00.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8810000000000001e-06 2024-09-21T22:02:00.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930600+0000", 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5539999999999999e-06 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959097+0000", 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028497248999999999 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959184+0000", 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7170999999999996e-05 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959266+0000", 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1769999999999998e-05 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.637874207999999, 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:02:00.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.637827952000002, 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.633 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:00.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:02:00.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:00.637 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.637790617, 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:00.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:02:00.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:02:00.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.637756435999997, 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.645 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.637716564000002, 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:02:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.637671279000003, 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:02:00.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:02:00.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:40935 3.5 3:a2bf362e:::rbd_data.112498fbc780.0000000000000004:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 33.572155903999999, 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028536945000000001, 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:00.654 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 40935 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996350+0000", 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996352+0000", 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.041e-06 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996362+0000", 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0447e-05 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996382+0000", 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9639e-05 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996393+0000", 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1358e-05 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996458+0000", 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4649999999999999e-05 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:26.996523+0000", 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4775000000000002e-05 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.001040+0000", 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045170920000000003 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024702+0000", 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023662336999999999 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024758+0000", 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6138999999999999e-05 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024825+0000", 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6834000000000004e-05 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:27.024887+0000", 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1632999999999998e-05 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.659 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.660 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:00.660 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:00.660 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:00.661 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:00.661 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:00.660+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:00.761 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:00.760+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:00.790 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone43 from 0xe7167c9 (overlap 0x441ff46) to 0x367ff6b 2024-09-21T22:02:00.817 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:00.817 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:00.817 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:00.817 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:00.826 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:00.862 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:00.860+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:00.908 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #42, image image_client.0-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent43 2024-09-21T22:02:00.963 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:00.961+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:00.972 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:00.973 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:00.973 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:00.973 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:00.973 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:00.982 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:01.039 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:01.052 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:02:01.079 INFO:teuthology.orchestra.run.smithi102.stdout:5637 writesame 0x752bd25 thru 0x7539047 data_size 0x3(0xd323 bytes) 2024-09-21T22:02:01.079 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:01.077+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:01.087 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:01.087 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:01.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:01.087 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:01.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.087 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:02:01.087 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.241630839999999, 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:02:01.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:02:01.093 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.242719327000003, 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.094 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:02:01.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:02:01.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:02:01.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:02:01.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:02:01.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.134262569999997, 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.101 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.134253276999999, 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.105 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:01.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.134229531000003, 2024-09-21T22:02:01.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:02:01.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:02:01.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.134218978, 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:01.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:02:01.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:02:01.117 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.134209575, 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.118 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:02:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:02:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.134198785000002, 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:02:01.122 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.134165512000003, 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:02:01.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:02:01.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.134154840000001, 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.131 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:02:01.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.130025349, 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.135 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.139 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.129626211000001, 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:01.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:02:01.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.128671619999999, 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:02:01.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:02:01.147 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.128648366999997, 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.148 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.127355696999999, 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.152 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.153 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.153 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.153 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.153 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:02:01.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.153 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.127336583999998, 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.157 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:01.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.161 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.127317454, 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.162 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:01.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:02:01.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:02:01.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.127299116000003, 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.166 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:02:01.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:02:01.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:01.170 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 41.127280716999998, 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:02:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:41899 3.10 3:0bb333a9:::rbd_data.11247a90fb52.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.330371306000004, 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015085853, 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:01.175 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 41899 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754789+0000", 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.372e-06 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754796+0000", 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8249999999999999e-06 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754809+0000", 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3662000000000001e-05 2024-09-21T22:02:01.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754816+0000", 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7220000000000002e-06 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754866+0000", 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9945999999999999e-05 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754919+0000", 2024-09-21T22:02:01.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3329999999999999e-05 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.758040+0000", 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031204869999999999 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769752+0000", 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011712530000000001 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769803+0000", 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.117e-05 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769841+0000", 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7982999999999999e-05 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769873+0000", 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1826000000000003e-05 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.180 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.181 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.181 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:01.181 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:01.181 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:01.182 INFO:teuthology.orchestra.run.smithi102.stdout:5639 trunc from 0xe7167c9 to 0xe232bd4 2024-09-21T22:02:01.182 INFO:teuthology.orchestra.run.smithi102.stdout:5640 punch from 0xc50703 to 0xc54ede, (0x47db bytes) 2024-09-21T22:02:01.183 INFO:teuthology.orchestra.run.smithi102.stdout:5641 read 0x7963d9f thru 0x796fac9 (0xbd2b bytes) 2024-09-21T22:02:01.183 INFO:teuthology.orchestra.run.smithi102.stdout:5642 trunc from 0xe232bd4 to 0xad08a8e 2024-09-21T22:02:01.183 INFO:teuthology.orchestra.run.smithi102.stdout:5643 write 0x8d3e82 thru 0x8dfdcc (0xbf4b bytes) 2024-09-21T22:02:01.183 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:01.180+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:01.183 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:01.197 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:01.227 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:01.227 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:01.249 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:01.249 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:01.269 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:01.269 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:01.272 INFO:teuthology.orchestra.run.smithi102.stdout:5644 read 0x1117329 thru 0x111e9ee (0x76c6 bytes) 2024-09-21T22:02:01.273 INFO:teuthology.orchestra.run.smithi102.stdout:5646 punch from 0xab653b6 to 0xab74d94, (0xf9de bytes) 2024-09-21T22:02:01.273 INFO:teuthology.orchestra.run.smithi102.stdout:5647 trunc from 0xad08a8e to 0xa64195a 2024-09-21T22:02:01.283 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:01.280+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:01.290 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:01.290 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:01.303 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:01.303 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:01.303 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:01.305 INFO:teuthology.orchestra.run.smithi102.stdout:5648 punch from 0x27cf5c to 0x27e53d, (0x15e1 bytes) 2024-09-21T22:02:01.305 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:01.305 INFO:teuthology.orchestra.run.smithi102.stdout:5650 write 0x7595994 thru 0x7598216 (0x2883 bytes) 2024-09-21T22:02:01.306 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:01.307 INFO:teuthology.orchestra.run.smithi102.stdout:5652 writesame 0x981f686 thru 0x982d3c8 data_size 0x3(0xdd43 bytes) 2024-09-21T22:02:01.310 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:01.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:01.316 INFO:teuthology.orchestra.run.smithi102.stdout:5654 write 0x7d7b115 thru 0x7d88a04 (0xd8f0 bytes) 2024-09-21T22:02:01.324 INFO:teuthology.orchestra.run.smithi102.stdout:5655 read 0x8c2991 thru 0x8c8964 (0x5fd4 bytes) 2024-09-21T22:02:01.325 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:01.334 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:01.334 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:01.339 INFO:teuthology.orchestra.run.smithi102.stdout:5657 trunc from 0xa64195a to 0x77fe9e 2024-09-21T22:02:01.358 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:01.358 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:01.384 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:01.383+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:01.425 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:01.426 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:01.426 INFO:teuthology.orchestra.run.smithi102.stdout:5658 writesame 0xaff1356 thru 0xaffddd3 data_size 0x1(0xca7e bytes) 2024-09-21T22:02:01.433 INFO:teuthology.orchestra.run.smithi102.stdout:5659 write 0xbb15d78 thru 0xbb1fa7d (0x9d06 bytes) 2024-09-21T22:02:01.435 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:01.438 INFO:teuthology.orchestra.run.smithi102.stdout:5660 read 0x49230ed thru 0x49287b1 (0x56c5 bytes) 2024-09-21T22:02:01.438 INFO:teuthology.orchestra.run.smithi102.stdout:5663 punch from 0x79c16a0 to 0x79c7660, (0x5fc0 bytes) 2024-09-21T22:02:01.438 INFO:teuthology.orchestra.run.smithi102.stdout:5666 read 0x6a790 thru 0x70f5b (0x67cc bytes) 2024-09-21T22:02:01.446 INFO:teuthology.orchestra.run.smithi102.stdout:5667 trunc from 0xbb1fa7e to 0x545c423 2024-09-21T22:02:01.468 INFO:teuthology.orchestra.run.smithi102.stdout:5668 writesame 0xb19b2b2 thru 0xb1a6c39 data_size 0xc(0xb988 bytes) 2024-09-21T22:02:01.468 INFO:teuthology.orchestra.run.smithi102.stdout:5670 write 0x4b24f90 thru 0x4b320ea (0xd15b bytes) 2024-09-21T22:02:01.477 INFO:teuthology.orchestra.run.smithi102.stdout:5671 write 0x32fce50 thru 0x330c632 (0xf7e3 bytes) 2024-09-21T22:02:01.484 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:01.482+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:01.485 INFO:teuthology.orchestra.run.smithi102.stdout:5672 punch from 0x2e70db1 to 0x2e7a73a, (0x9989 bytes) 2024-09-21T22:02:01.488 INFO:teuthology.orchestra.run.smithi102.stdout:5673 trunc from 0xb1a6c3a to 0xdfb4765 2024-09-21T22:02:01.494 INFO:teuthology.orchestra.run.smithi102.stdout:5674 read 0x2b68ddb thru 0x2b6a8c9 (0x1aef bytes) 2024-09-21T22:02:01.494 INFO:teuthology.orchestra.run.smithi102.stdout:5676 punch from 0x92176d0 to 0x9226281, (0xebb1 bytes) 2024-09-21T22:02:01.494 INFO:teuthology.orchestra.run.smithi102.stdout:5677 read 0xb08b856 thru 0xb09751a (0xbcc5 bytes) 2024-09-21T22:02:01.494 INFO:teuthology.orchestra.run.smithi102.stdout:5678 write 0x31e5776 thru 0x31f0959 (0xb1e4 bytes) 2024-09-21T22:02:01.497 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:01.499 INFO:teuthology.orchestra.run.smithi102.stdout:5680 trunc from 0xdfb4765 to 0xc70686a 2024-09-21T22:02:01.504 INFO:teuthology.orchestra.run.smithi102.stdout:5681 write 0x964becf thru 0x96584bd (0xc5ef bytes) 2024-09-21T22:02:01.516 INFO:teuthology.orchestra.run.smithi102.stdout:5682 write 0x8e0fbae thru 0x8e17397 (0x77ea bytes) 2024-09-21T22:02:01.521 INFO:teuthology.orchestra.run.smithi102.stdout:5683 write 0x22f8a81 thru 0x22fff0b (0x748b bytes) 2024-09-21T22:02:01.526 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:01.527 INFO:teuthology.orchestra.run.smithi102.stdout:5685 write 0x27b0a4f thru 0x27b6819 (0x5dcb bytes) 2024-09-21T22:02:01.532 INFO:teuthology.orchestra.run.smithi102.stdout:5686 write 0x16e108e thru 0x16e3d6b (0x2cde bytes) 2024-09-21T22:02:01.535 INFO:teuthology.orchestra.run.smithi102.stdout:5687 trunc from 0xc70686a to 0xb5e1ce9 2024-09-21T22:02:01.540 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:01.540 INFO:teuthology.orchestra.run.smithi102.stdout:5691 punch from 0xe58378 to 0xe5cd8a, (0x4a12 bytes) 2024-09-21T22:02:01.540 INFO:teuthology.orchestra.run.smithi102.stdout:5694 writesame 0x20f965f thru 0x21064f1 data_size 0x1(0xce93 bytes) 2024-09-21T22:02:01.553 INFO:teuthology.orchestra.run.smithi102.stdout:5695 punch from 0x2343e6b to 0x2353b3a, (0xfccf bytes) 2024-09-21T22:02:01.562 INFO:teuthology.orchestra.run.smithi102.stdout:5697 trunc from 0xb5e1ce9 to 0x3fb9c54 2024-09-21T22:02:01.578 INFO:teuthology.orchestra.run.smithi102.stdout:5698 punch from 0x3031da8 to 0x303f203, (0xd45b bytes) 2024-09-21T22:02:01.579 INFO:teuthology.orchestra.run.smithi102.stdout:5699 write 0x2fe49e1 thru 0x2ff4594 (0xfbb4 bytes) 2024-09-21T22:02:01.586 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:01.584+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:01.586 INFO:teuthology.orchestra.run.smithi102.stdout:5700 trunc from 0x3fb9c54 to 0x8a8f475 2024-09-21T22:02:01.589 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:01.589 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:01.591 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:01.597 INFO:teuthology.orchestra.run.smithi102.stdout:5703 writesame 0x94616a9 thru 0x946f437 data_size 0x1(0xdd8f bytes) 2024-09-21T22:02:01.597 INFO:teuthology.orchestra.run.smithi102.stdout:5705 write 0x904f3fd thru 0x9057a17 (0x861b bytes) 2024-09-21T22:02:01.598 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:01.602 INFO:teuthology.orchestra.run.smithi102.stdout:5706 read 0x7fabee1 thru 0x7fbb0b9 (0xf1d9 bytes) 2024-09-21T22:02:01.602 INFO:teuthology.orchestra.run.smithi102.stdout:5708 write 0x40e77b7 thru 0x40eef74 (0x77be bytes) 2024-09-21T22:02:01.604 INFO:teuthology.orchestra.run.smithi102.stdout:5709 writesame 0x76548e6 thru 0x7657664 data_size 0x1(0x2d7f bytes) 2024-09-21T22:02:01.610 INFO:teuthology.orchestra.run.smithi102.stdout:5710 write 0x89a915c thru 0x89b27cf (0x9674 bytes) 2024-09-21T22:02:01.622 INFO:teuthology.orchestra.run.smithi102.stdout:5711 writesame 0x3b5e464 thru 0x3b5ee9a data_size 0x1(0xa37 bytes) 2024-09-21T22:02:01.624 INFO:teuthology.orchestra.run.smithi102.stdout:5712 writesame 0x1d9f736 thru 0x1da1758 data_size 0x1(0x2023 bytes) 2024-09-21T22:02:01.635 INFO:teuthology.orchestra.run.smithi102.stdout:5713 writesame 0xaba748a thru 0xabb2103 data_size 0x21(0xac7a bytes) 2024-09-21T22:02:01.641 INFO:teuthology.orchestra.run.smithi102.stdout:5714 write 0xb022305 thru 0xb0312a7 (0xefa3 bytes) 2024-09-21T22:02:01.647 INFO:teuthology.orchestra.run.smithi102.stdout:5715 writesame 0x679439a thru 0x6795acf data_size 0x1(0x1736 bytes) 2024-09-21T22:02:01.653 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:01.653 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:01.653 INFO:teuthology.orchestra.run.smithi102.stdout:5719 read 0x796538e thru 0x796dc5c (0x88cf bytes) 2024-09-21T22:02:01.654 INFO:teuthology.orchestra.run.smithi102.stdout:5722 write 0x54ad31e thru 0x54b8b7f (0xb862 bytes) 2024-09-21T22:02:01.667 INFO:teuthology.orchestra.run.smithi102.stdout:5724 write 0xb5772b1 thru 0xb57e45c (0x71ac bytes) 2024-09-21T22:02:01.670 INFO:teuthology.orchestra.run.smithi102.stdout:5725 writesame 0x5471916 thru 0x547390a data_size 0x9(0x1ff5 bytes) 2024-09-21T22:02:01.672 INFO:teuthology.orchestra.run.smithi102.stdout:5727 punch from 0x8a70bf9 to 0x8a7a3af, (0x97b6 bytes) 2024-09-21T22:02:01.672 INFO:teuthology.orchestra.run.smithi102.stdout:5728 write 0x5f2912b thru 0x5f2e68b (0x5561 bytes) 2024-09-21T22:02:01.675 INFO:teuthology.orchestra.run.smithi102.stdout:5729 punch from 0x7e76efe to 0x7e827b9, (0xb8bb bytes) 2024-09-21T22:02:01.683 INFO:teuthology.orchestra.run.smithi102.stdout:5731 trunc from 0xb57e45d to 0x4e35afe 2024-09-21T22:02:01.686 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:01.684+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:01.714 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:02:01.716 INFO:teuthology.orchestra.run.smithi102.stdout:5732 writesame 0xeb8a679 thru 0xeb99686 data_size 0x1(0xf00e bytes) 2024-09-21T22:02:01.716 INFO:teuthology.orchestra.run.smithi102.stdout:5733 punch from 0x208b336 to 0x209a1fa, (0xeec4 bytes) 2024-09-21T22:02:01.730 INFO:teuthology.orchestra.run.smithi102.stdout:5735 trunc from 0xeb99687 to 0x3965fec 2024-09-21T22:02:01.731 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:01.731 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:01.743 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:01.757 INFO:teuthology.orchestra.run.smithi102.stdout:5736 write 0x8681d34 thru 0x868a83c (0x8b09 bytes) 2024-09-21T22:02:01.768 INFO:teuthology.orchestra.run.smithi102.stdout:5737 trunc from 0x868a83d to 0x5ca82ec 2024-09-21T22:02:01.787 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:01.787+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:01.792 INFO:teuthology.orchestra.run.smithi102.stdout:5738 writesame 0xd35f0d3 thru 0xd3677c5 data_size 0x1(0x86f3 bytes) 2024-09-21T22:02:01.800 INFO:teuthology.orchestra.run.smithi102.stdout:5739 write 0xea7adb2 thru 0xea812f1 (0x6540 bytes) 2024-09-21T22:02:01.804 INFO:teuthology.orchestra.run.smithi102.stdout:5743 read 0x37e6c04 thru 0x37ebe29 (0x5226 bytes) 2024-09-21T22:02:01.805 INFO:teuthology.orchestra.run.smithi102.stdout:5744 punch from 0x46a8e0b to 0x46b40cd, (0xb2c2 bytes) 2024-09-21T22:02:01.805 INFO:teuthology.orchestra.run.smithi102.stdout:5746 punch from 0xf62669 to 0xf68c5d, (0x65f4 bytes) 2024-09-21T22:02:01.805 INFO:teuthology.orchestra.run.smithi102.stdout:5748 punch from 0x9b7f7d3 to 0x9b89ff7, (0xa824 bytes) 2024-09-21T22:02:01.805 INFO:teuthology.orchestra.run.smithi102.stdout:5749 punch from 0xb77b87e to 0xb7893e9, (0xdb6b bytes) 2024-09-21T22:02:01.805 INFO:teuthology.orchestra.run.smithi102.stdout:5750 read 0xe4248bc thru 0xe428aad (0x41f2 bytes) 2024-09-21T22:02:01.806 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:01.806 INFO:teuthology.orchestra.run.smithi102.stdout:5753 writesame 0xa02d58 thru 0xa0fc85 data_size 0x17(0xcf2e bytes) 2024-09-21T22:02:01.864 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:01.865 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:01.873 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:01.888 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:01.888+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:01.989 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:01.989+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:02.016 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:02.016 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:02.025 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:02.090 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:02.089+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:02.127 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:02.128 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:02.136 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:02.191 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:02.189+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:02.239 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:02.239 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:02.248 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:02.332 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:02.330+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:02.391 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:02.391 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:02.392 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:02.391+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:02.400 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:02.493 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:02.491+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:02.543 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:02.544 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:02.552 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:02.594 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:02.593+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:02.694 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:02.694 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:02.695 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:02.692+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:02.703 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:02.727 INFO:teuthology.orchestra.run.smithi102.stdout:5754 writesame 0xe4604ed thru 0xe461ce8 data_size 0xa(0x17fc bytes) 2024-09-21T22:02:02.732 INFO:teuthology.orchestra.run.smithi102.stdout:5756 trunc from 0xea812f2 to 0xd898a5a 2024-09-21T22:02:02.742 INFO:teuthology.orchestra.run.smithi102.stdout:5757 write 0x5410706 thru 0x541ffab (0xf8a6 bytes) 2024-09-21T22:02:02.750 INFO:teuthology.orchestra.run.smithi102.stdout:5759 writesame 0x6b1983c thru 0x6b1be14 data_size 0x1(0x25d9 bytes) 2024-09-21T22:02:02.756 INFO:teuthology.orchestra.run.smithi102.stdout:5760 write 0x3e9358e thru 0x3e94788 (0x11fb bytes) 2024-09-21T22:02:02.760 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:02.760 INFO:teuthology.orchestra.run.smithi102.stdout:5763 writesame 0x7ca902d thru 0x7cacb42 data_size 0x3(0x3b16 bytes) 2024-09-21T22:02:02.769 INFO:teuthology.orchestra.run.smithi102.stdout:5764 punch from 0xa9cf636 to 0xa9d35e7, (0x3fb1 bytes) 2024-09-21T22:02:02.784 INFO:teuthology.orchestra.run.smithi102.stdout:5765 trunc from 0xd898a5a to 0x837e30 2024-09-21T22:02:02.795 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:02.795+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:02.825 INFO:teuthology.orchestra.run.smithi102.stdout:5766 write 0xeb002d6 thru 0xeb0f277 (0xefa2 bytes) 2024-09-21T22:02:02.833 INFO:teuthology.orchestra.run.smithi102.stdout:5767 writesame 0xc707086 thru 0xc70df38 data_size 0x1(0x6eb3 bytes) 2024-09-21T22:02:02.844 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:02.844 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:02.845 INFO:teuthology.orchestra.run.smithi102.stdout:5769 writesame 0x49f8f4b thru 0x49faf0c data_size 0x1(0x1fc2 bytes) 2024-09-21T22:02:02.851 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:02.851 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:02.851 INFO:teuthology.orchestra.run.smithi102.stdout:5773 write 0xd1442f9 thru 0xd144d99 (0xaa1 bytes) 2024-09-21T22:02:02.853 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:02.856 INFO:teuthology.orchestra.run.smithi102.stdout:5774 trunc from 0xeb0f278 to 0xc5327c3 2024-09-21T22:02:02.870 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:02.870 INFO:teuthology.orchestra.run.smithi102.stdout:5776 write 0x2208e96 thru 0x2217a63 (0xebce bytes) 2024-09-21T22:02:02.879 INFO:teuthology.orchestra.run.smithi102.stdout:5777 read 0x504ad1e thru 0x5058af5 (0xddd8 bytes) 2024-09-21T22:02:02.879 INFO:teuthology.orchestra.run.smithi102.stdout:5778 writesame 0x2930d5a thru 0x293bdfa data_size 0x1(0xb0a1 bytes) 2024-09-21T22:02:02.897 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:02.895+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:02.897 INFO:teuthology.orchestra.run.smithi102.stdout:5780 trunc from 0xc5327c3 to 0x5cfbcff 2024-09-21T22:02:02.923 INFO:teuthology.orchestra.run.smithi102.stdout:5781 write 0xe287b61 thru 0xe28a39c (0x283c bytes) 2024-09-21T22:02:02.933 INFO:teuthology.orchestra.run.smithi102.stdout:5782 writesame 0x2816e90 thru 0x28217c8 data_size 0x1(0xa939 bytes) 2024-09-21T22:02:02.944 INFO:teuthology.orchestra.run.smithi102.stdout:5783 write 0xa7ce43f thru 0xa7da361 (0xbf23 bytes) 2024-09-21T22:02:02.953 INFO:teuthology.orchestra.run.smithi102.stdout:5784 read 0x2a547de thru 0x2a57b8d (0x33b0 bytes) 2024-09-21T22:02:02.954 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:02.954 INFO:teuthology.orchestra.run.smithi102.stdout:5786 write 0x241968 thru 0x245869 (0x3f02 bytes) 2024-09-21T22:02:02.955 INFO:teuthology.orchestra.run.smithi102.stdout:5788 write 0x3f0d22 thru 0x3ffa6d (0xed4c bytes) 2024-09-21T22:02:02.970 INFO:teuthology.orchestra.run.smithi102.stdout:5789 trunc from 0xe28a39d to 0x349e264 2024-09-21T22:02:02.973 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:02.973 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:02.984 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:02.994 INFO:teuthology.orchestra.run.smithi102.stdout:5791 write 0x93f25fc thru 0x94007a2 (0xe1a7 bytes) 2024-09-21T22:02:02.997 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:02.997+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:03.013 INFO:teuthology.orchestra.run.smithi102.stdout:5793 write 0xbb41fd5 thru 0xbb4788e (0x58ba bytes) 2024-09-21T22:02:03.021 INFO:teuthology.orchestra.run.smithi102.stdout:5794 writesame 0x7573590 thru 0x757af29 data_size 0xb(0x799a bytes) 2024-09-21T22:02:03.031 INFO:teuthology.orchestra.run.smithi102.stdout:5796 read 0x22fce85 thru 0x2300907 (0x3a83 bytes) 2024-09-21T22:02:03.031 INFO:teuthology.orchestra.run.smithi102.stdout:5797 read 0xd4b4e1 thru 0xd59274 (0xdd94 bytes) 2024-09-21T22:02:03.031 INFO:teuthology.orchestra.run.smithi102.stdout:5798 punch from 0x4fe7bb to 0x50a30b, (0xbb50 bytes) 2024-09-21T22:02:03.038 INFO:teuthology.orchestra.run.smithi102.stdout:5799 write 0xce446ae thru 0xce48b06 (0x4459 bytes) 2024-09-21T22:02:03.042 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:03.049 INFO:teuthology.orchestra.run.smithi102.stdout:5802 trunc from 0xce48b07 to 0x725e88a 2024-09-21T22:02:03.075 INFO:teuthology.orchestra.run.smithi102.stdout:5803 write 0xd9fa46d thru 0xd9fe4c9 (0x405d bytes) 2024-09-21T22:02:03.079 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:03.084 INFO:teuthology.orchestra.run.smithi102.stdout:5807 trunc from 0xd9fe4ca to 0x981be74 2024-09-21T22:02:03.094 INFO:teuthology.orchestra.run.smithi102.stdout:5808 punch from 0x92e4779 to 0x92f1c48, (0xd4cf bytes) 2024-09-21T22:02:03.094 INFO:teuthology.orchestra.run.smithi102.stdout:5809 punch from 0x1feccc6 to 0x1ff8a5b, (0xbd95 bytes) 2024-09-21T22:02:03.094 INFO:teuthology.orchestra.run.smithi102.stdout:5810 write 0x57615ca thru 0x576bcde (0xa715 bytes) 2024-09-21T22:02:03.098 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:03.098+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:03.105 INFO:teuthology.orchestra.run.smithi102.stdout:5811 punch from 0x82cf209 to 0x82db5ee, (0xc3e5 bytes) 2024-09-21T22:02:03.105 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:03.105 INFO:teuthology.orchestra.run.smithi102.stdout:5815 read 0x3902402 thru 0x3905ccb (0x38ca bytes) 2024-09-21T22:02:03.105 INFO:teuthology.orchestra.run.smithi102.stdout:5818 write 0x7435d91 thru 0x7438aaa (0x2d1a bytes) 2024-09-21T22:02:03.108 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:03.109 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:03.121 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:03.122 INFO:teuthology.orchestra.run.smithi102.stdout:5819 trunc from 0x981be74 to 0x3612a1 2024-09-21T22:02:03.142 INFO:teuthology.orchestra.run.smithi102.stdout:5821 writesame 0x11a3924 thru 0x11b35da data_size 0x5f(0xfcb7 bytes) 2024-09-21T22:02:03.158 INFO:teuthology.orchestra.run.smithi102.stdout:5822 writesame 0x8492f42 thru 0x849a54f data_size 0x9(0x760e bytes) 2024-09-21T22:02:03.158 INFO:teuthology.orchestra.run.smithi102.stdout:5823 punch from 0x81d2b63 to 0x81d5818, (0x2cb5 bytes) 2024-09-21T22:02:03.159 INFO:teuthology.orchestra.run.smithi102.stdout:5824 punch from 0x72beb7e to 0x72ca9e7, (0xbe69 bytes) 2024-09-21T22:02:03.159 INFO:teuthology.orchestra.run.smithi102.stdout:5825 punch from 0x443d5ba to 0x444802a, (0xaa70 bytes) 2024-09-21T22:02:03.159 INFO:teuthology.orchestra.run.smithi102.stdout:5826 punch from 0x811c522 to 0x811d888, (0x1366 bytes) 2024-09-21T22:02:03.166 INFO:teuthology.orchestra.run.smithi102.stdout:5827 writesame 0xaadcfcd thru 0xaaeaed7 data_size 0x7(0xdf0b bytes) 2024-09-21T22:02:03.166 INFO:teuthology.orchestra.run.smithi102.stdout:5828 read 0xc869d2 thru 0xc92fc7 (0xc5f6 bytes) 2024-09-21T22:02:03.167 INFO:teuthology.orchestra.run.smithi102.stdout:5829 read 0x5da3ad7 thru 0x5dac7aa (0x8cd4 bytes) 2024-09-21T22:02:03.167 INFO:teuthology.orchestra.run.smithi102.stdout:5830 read 0x1fa4af6 thru 0x1fa77f6 (0x2d01 bytes) 2024-09-21T22:02:03.174 INFO:teuthology.orchestra.run.smithi102.stdout:5831 write 0xc35f77e thru 0xc36dd60 (0xe5e3 bytes) 2024-09-21T22:02:03.187 INFO:teuthology.orchestra.run.smithi102.stdout:5832 trunc from 0xc36dd61 to 0x763151d 2024-09-21T22:02:03.199 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:03.197+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:03.204 INFO:teuthology.orchestra.run.smithi102.stdout:5835 trunc from 0x763151d to 0xc9870a 2024-09-21T22:02:03.211 INFO:teuthology.orchestra.run.smithi102.stdout:5836 read 0x4e41f0 thru 0x4ea981 (0x6792 bytes) 2024-09-21T22:02:03.224 INFO:teuthology.orchestra.run.smithi102.stdout:5837 writesame 0x759fc39 thru 0x75a0e44 data_size 0x5(0x120c bytes) 2024-09-21T22:02:03.224 INFO:teuthology.orchestra.run.smithi102.stdout:5838 write 0x6f60ad5 thru 0x6f67e42 (0x736e bytes) 2024-09-21T22:02:03.228 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:03.228 INFO:teuthology.orchestra.run.smithi102.stdout:5841 clone 45 order 23 su 65536 sc 2 2024-09-21T22:02:03.241 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:03.241 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:03.250 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:03.300 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:03.298+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:03.354 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:03.355 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:03.363 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:03.373 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:03.407 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:03.406+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:03.466 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:03.466 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:03.474 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:03.493 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:03.493 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:03.510 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:03.511 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:03.516 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:03.515+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:03.526 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:03.526 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:03.542 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:03.559 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:03.575 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:03.591 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:03.592 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:03.605 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:03.603+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:03.608 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:03.609 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:03.622 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:03.622 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:03.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:03.622 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:03.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.622 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:02:03.622 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:03.622 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.408109569000004, 2024-09-21T22:02:03.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:02:03.622 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:02:03.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.627 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56963 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 622592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.366048489000001, 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021343747, 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56963 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2e-07 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253818+0000", 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1160000000000002e-06 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253823+0000", 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253828+0000", 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:02:03.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.274987+0000", 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021158445000000001 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275065+0000", 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8407999999999999e-05 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275159+0000", 2024-09-21T22:02:03.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3497000000000003e-05 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56964 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.366029172000001, 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021459051999999999, 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56964 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253835+0000", 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253837+0000", 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253842+0000", 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8080000000000001e-06 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253847+0000", 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6099999999999999e-06 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275188+0000", 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021341057 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275230+0000", 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1941999999999999e-05 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275293+0000", 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3195999999999996e-05 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56965 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.636 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365997171, 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021632274, 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56965 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253867+0000", 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253869+0000", 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253875+0000", 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0970000000000002e-06 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253880+0000", 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275329+0000", 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021448292000000001 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275407+0000", 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7946000000000002e-05 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275499+0000", 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1978000000000006e-05 2024-09-21T22:02:03.640 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56966 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1310720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365977323999999, 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021740731999999999, 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56966 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253888+0000", 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0669999999999999e-06 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253894+0000", 2024-09-21T22:02:03.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8980000000000001e-06 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253900+0000", 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275526+0000", 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021625912000000001 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275569+0000", 2024-09-21T22:02:03.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3043000000000001e-05 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275627+0000", 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7479000000000003e-05 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56967 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365957152, 2024-09-21T22:02:03.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021928007999999999, 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56967 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253907+0000", 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.41e-07 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253908+0000", 2024-09-21T22:02:03.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.776e-06 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253914+0000", 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1950000000000002e-06 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253928+0000", 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3974e-05 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275662+0000", 2024-09-21T22:02:03.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021734168000000002 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275740+0000", 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7807999999999998e-05 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275834+0000", 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4746000000000004e-05 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56968 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365929009999999, 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022029615999999998, 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56968 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.650 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253935+0000", 2024-09-21T22:02:03.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253937+0000", 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253943+0000", 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253948+0000", 2024-09-21T22:02:03.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275861+0000", 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021913548000000001 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275905+0000", 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3795000000000003e-05 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275964+0000", 2024-09-21T22:02:03.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8739000000000001e-05 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56969 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365910340999999, 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022221162999999999, 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.654 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56969 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253955+0000", 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.874e-06 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253961+0000", 2024-09-21T22:02:03.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999998e-06 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253965+0000", 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5260000000000004e-06 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276000+0000", 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022034611999999999 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276078+0000", 2024-09-21T22:02:03.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8311000000000003e-05 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276174+0000", 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6139999999999998e-05 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56984 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365892723000002, 2024-09-21T22:02:03.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022340279000000001, 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56984 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253973+0000", 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.81e-06 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253979+0000", 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253983+0000", 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276203+0000", 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022219848 2024-09-21T22:02:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276248+0000", 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4880999999999999e-05 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276311+0000", 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3047999999999997e-05 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.662 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56985 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365874751, 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022528538000000001, 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56985 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253991+0000", 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1229999999999998e-06 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253997+0000", 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4759999999999997e-06 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254003+0000", 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.896e-06 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276347+0000", 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022344180000000002 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276424+0000", 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7014000000000005e-05 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276517+0000", 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3383999999999999e-05 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.666 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56986 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365855148000001, 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022636156000000001, 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.667 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56986 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254009+0000", 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254021+0000", 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2075e-05 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254027+0000", 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2910000000000004e-06 2024-09-21T22:02:03.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254032+0000", 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0969999999999996e-06 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276545+0000", 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022513014000000001 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276588+0000", 2024-09-21T22:02:03.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3183000000000003e-05 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276644+0000", 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6165999999999997e-05 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56987 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 868352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365824677999999, 2024-09-21T22:02:03.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022813353000000001, 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56987 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254041+0000", 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254047+0000", 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254051+0000", 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6430000000000003e-06 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276680+0000", 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022628945000000001 2024-09-21T22:02:03.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276758+0000", 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7775999999999995e-05 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276852+0000", 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4067999999999995e-05 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56988 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1097728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365807263000001, 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923770999999999, 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56988 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254058+0000", 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254064+0000", 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2950000000000001e-06 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254068+0000", 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1479999999999999e-06 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276880+0000", 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022812260000000001 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276923+0000", 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3347999999999999e-05 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276980+0000", 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6496000000000003e-05 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.679 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56989 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1327104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365790257, 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023109826999999999, 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56989 2024-09-21T22:02:03.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254075+0000", 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.691e-06 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254081+0000", 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254085+0000", 2024-09-21T22:02:03.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.498e-06 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277015+0000", 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929417000000001 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277092+0000", 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6625000000000006e-05 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277183+0000", 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1453999999999995e-05 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56990 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1556480~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365772110000002, 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023224305000000001, 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.684 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56990 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.685 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254092+0000", 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.22e-07 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254093+0000", 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7099999999999999e-06 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254099+0000", 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254103+0000", 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277211+0000", 2024-09-21T22:02:03.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023107593999999999 2024-09-21T22:02:03.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.689 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277254+0000", 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2762000000000002e-05 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277316+0000", 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1876000000000002e-05 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56991 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.690 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365754763999998, 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023415498999999999, 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56991 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:03.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254111+0000", 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.813e-06 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254116+0000", 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254121+0000", 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5730000000000001e-06 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.693 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277351+0000", 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023230621 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277431+0000", 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9818e-05 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277524+0000", 2024-09-21T22:02:03.694 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2986999999999996e-05 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56992 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 2015232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365737275000001, 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023528238999999999, 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.695 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56992 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254128+0000", 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8330000000000001e-06 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254134+0000", 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5729999999999998e-06 2024-09-21T22:02:03.697 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254139+0000", 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4790000000000004e-06 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277553+0000", 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023413607999999999 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277596+0000", 2024-09-21T22:02:03.698 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3489000000000003e-05 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277654+0000", 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7911999999999997e-05 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57020 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365240190000002, 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023243617000000001, 2024-09-21T22:02:03.699 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57020 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.700 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254624+0000", 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254632+0000", 2024-09-21T22:02:03.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1219999999999995e-06 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254640+0000", 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9370000000000004e-06 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254645+0000", 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3140000000000003e-06 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.702 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277690+0000", 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023044477000000001 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277768+0000", 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8594e-05 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277867+0000", 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8560999999999994e-05 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.703 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57021 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.365211289000001, 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023344055999999998, 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57021 2024-09-21T22:02:03.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254653+0000", 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:03.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254654+0000", 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254661+0000", 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254666+0000", 2024-09-21T22:02:03.706 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277894+0000", 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023228029000000001 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277936+0000", 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2589000000000002e-05 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.707 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277996+0000", 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9967999999999999e-05 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57023 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 704512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 16.36519247, 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023525122999999998, 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.708 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57023 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.709 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.32e-07 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254679+0000", 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7479999999999993e-06 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254686+0000", 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:02:03.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254690+0000", 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7180000000000004e-06 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278021+0000", 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023330391999999998 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278097+0000", 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6464999999999994e-05 2024-09-21T22:02:03.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.712 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.712 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.712 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278196+0000", 2024-09-21T22:02:03.712 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8852999999999997e-05 2024-09-21T22:02:03.712 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.712 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.712 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.712 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.712 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.712 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:03.714 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:03.714 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:03.711+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:03.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:02:03.801 INFO:teuthology.orchestra.run.smithi102.stdout:truncating image image_client.0-clone44 from 0x75a0e45 (overlap 0x3612a1) to 0x56843 2024-09-21T22:02:03.814 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:03.813+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:03.830 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:03.830 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:03.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.830 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:83668 3.1d 3:beeda7c8:::rbd_header.1124f4fa8d1:head [call rbd.get_size in=19b out=9b,call rbd.get_features in=24b out=16b,call rbd.get_flags in=20b out=8b,call rbd.get_snapcontext in=18b out=12b,call lock.get_info in=30b out=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:03.830 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:03.829308+0000", 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.000235634, 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00026594699999999999, 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 83668 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:03.829308+0000", 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:03.829308+0000", 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:03.829309+0000", 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9400000000000005e-07 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:03.829312+0000", 2024-09-21T22:02:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2090000000000001e-06 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:03.829318+0000", 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8069999999999996e-06 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:03.829322+0000", 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8589999999999998e-06 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:03.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:03.829349+0000", 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6879000000000001e-05 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:03.829394+0000", 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4969000000000003e-05 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:03.829586+0000", 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00019295200000000001 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:03.834 INFO:teuthology.orchestra.run.smithi184.stdout: ], 2024-09-21T22:02:03.835 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 1 2024-09-21T22:02:03.835 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:03.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:03.881 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #43, image image_client.0-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent44 2024-09-21T22:02:03.924 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:03.923+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:04.010 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:04.010 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:04.010 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:04.010 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:04.010 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:04.016 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:04.015+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:04.019 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:04.035 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.037 INFO:teuthology.orchestra.run.smithi102.stdout:5843 trunc from 0x75a0e45 to 0x9044272 2024-09-21T22:02:04.046 INFO:teuthology.orchestra.run.smithi102.stdout:5844 read 0x86f46c2 thru 0x86f740b (0x2d4a bytes) 2024-09-21T22:02:04.052 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:02:04.052 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T22:02:04.056 INFO:teuthology.orchestra.run.smithi102.stdout:5845 trunc from 0x9044272 to 0x2589a 2024-09-21T22:02:04.101 INFO:teuthology.orchestra.run.smithi102.stdout:5846 read 0xd31b thru 0x1424f (0x6f35 bytes) 2024-09-21T22:02:04.102 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.102 INFO:teuthology.orchestra.run.smithi102.stdout:5848 read 0x21089 thru 0x25899 (0x4811 bytes) 2024-09-21T22:02:04.103 INFO:teuthology.orchestra.run.smithi102.stdout:5849 read 0x1fe3 thru 0x9de7 (0x7e05 bytes) 2024-09-21T22:02:04.103 INFO:teuthology.orchestra.run.smithi102.stdout:5850 read 0x1eb6a thru 0x25899 (0x6d30 bytes) 2024-09-21T22:02:04.117 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:04.116+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:04.118 INFO:teuthology.orchestra.run.smithi102.stdout:5851 write 0x694c587 thru 0x6955820 (0x929a bytes) 2024-09-21T22:02:04.122 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.132 INFO:teuthology.orchestra.run.smithi102.stdout:5853 write 0x9f5f8fd thru 0x9f6ba20 (0xc124 bytes) 2024-09-21T22:02:04.136 INFO:teuthology.orchestra.run.smithi102.stdout:5854 write 0x162da3b thru 0x162fd2d (0x22f3 bytes) 2024-09-21T22:02:04.139 INFO:teuthology.orchestra.run.smithi102.stdout:5856 punch from 0x79f0bab to 0x79f6180, (0x55d5 bytes) 2024-09-21T22:02:04.147 INFO:teuthology.orchestra.run.smithi102.stdout:5857 trunc from 0x9f6ba21 to 0x2e8773f 2024-09-21T22:02:04.172 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:04.172 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:04.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:04.172 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.118355802000004, 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:02:04.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:02:04.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:04.178 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.241641307999998, 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:02:04.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:02:04.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.241631357999999, 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.186 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.241617955000002, 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:02:04.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:02:04.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:02:04.190 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.241608284000002, 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.191 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29945 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3411968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.239656875999998, 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028678985000000001, 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.195 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29945 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930587+0000", 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930588+0000", 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930589+0000", 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.939e-06 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930595+0000", 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8810000000000001e-06 2024-09-21T22:02:04.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930600+0000", 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5539999999999999e-06 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959097+0000", 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028497248999999999 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959184+0000", 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7170999999999996e-05 2024-09-21T22:02:04.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959266+0000", 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1769999999999998e-05 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.239612446999999, 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.199 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:02:04.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:02:04.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.239566191000002, 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.203 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:02:04.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.239528856, 2024-09-21T22:02:04.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:02:04.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:04.211 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.239494675000003, 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.215 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.239454803000001, 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:02:04.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:02:04.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:04.219 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.239409518000002, 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:02:04.221 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:02:04.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.223 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85825 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2277376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.108312038, 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028813432, 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85825 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061936+0000", 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4790000000000001e-06 2024-09-21T22:02:04.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061939+0000", 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1240000000000001e-06 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061941+0000", 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.452e-06 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090598+0000", 2024-09-21T22:02:04.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028656966999999998 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090675+0000", 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6914000000000003e-05 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090745+0000", 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0290999999999995e-05 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.227 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85826 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2342912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.10829991999999999, 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028888786999999999, 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85826 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:04.228 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061946+0000", 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.556e-06 2024-09-21T22:02:04.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061949+0000", 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9249999999999999e-06 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061951+0000", 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4739999999999999e-06 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090758+0000", 2024-09-21T22:02:04.230 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028806486999999999 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090796+0000", 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8466000000000001e-05 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090833+0000", 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6674000000000002e-05 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85827 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2408448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.108289965, 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029053266000000001, 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85827 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:04.232 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9999999999999999e-07 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061955+0000", 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.156e-06 2024-09-21T22:02:04.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061958+0000", 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9340000000000002e-06 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061961+0000", 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5040000000000001e-06 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090862+0000", 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028901175000000001 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090937+0000", 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4881000000000004e-05 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091007+0000", 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0415999999999998e-05 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.235 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85828 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2473984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.108280285, 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029127014, 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85828 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:04.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061965+0000", 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:04.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061968+0000", 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.92e-06 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061971+0000", 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.101e-06 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091020+0000", 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029048398999999999 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091056+0000", 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6718000000000003e-05 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091091+0000", 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4501000000000001e-05 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85829 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2539520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:04.239 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.108230932, 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029251899000000001, 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85829 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:04.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062014+0000", 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062016+0000", 2024-09-21T22:02:04.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062022+0000", 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062027+0000", 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2180000000000001e-06 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091120+0000", 2024-09-21T22:02:04.242 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029093112000000001 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091195+0000", 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5499000000000003e-05 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091265+0000", 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9670000000000002e-05 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.243 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85830 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2605056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.108211286, 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029323741, 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85830 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.244 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062034+0000", 2024-09-21T22:02:04.245 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2729999999999999e-06 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062038+0000", 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.602e-06 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062042+0000", 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9949999999999999e-06 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.246 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091283+0000", 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029241195000000001 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091320+0000", 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7296999999999999e-05 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091356+0000", 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6170000000000001e-05 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85831 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2670592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.108198814, 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029484659999999999, 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85831 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.248 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:02:04.249 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062047+0000", 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062050+0000", 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1099999999999999e-06 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062052+0000", 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4899999999999999e-06 2024-09-21T22:02:04.250 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091385+0000", 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029333016999999999 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091461+0000", 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6019000000000005e-05 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091530+0000", 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8660999999999999e-05 2024-09-21T22:02:04.251 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85832 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2736128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.108188783, 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029557844999999999, 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85832 2024-09-21T22:02:04.252 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:04.253 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062057+0000", 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.119e-06 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062060+0000", 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9730000000000002e-06 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062062+0000", 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:02:04.254 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091542+0000", 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029480309999999999 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091579+0000", 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6254000000000002e-05 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091613+0000", 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4555999999999999e-05 2024-09-21T22:02:04.255 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.256 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.256 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:04.258 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:04.258 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:04.256+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:04.258 INFO:teuthology.orchestra.run.smithi102.stdout:5859 read 0x19eb8db thru 0x19f3a39 (0x815f bytes) 2024-09-21T22:02:04.258 INFO:teuthology.orchestra.run.smithi102.stdout:5860 punch from 0x12295d to 0x12f79d, (0xce40 bytes) 2024-09-21T22:02:04.259 INFO:teuthology.orchestra.run.smithi102.stdout:5862 write 0x42717cc thru 0x4272c40 (0x1475 bytes) 2024-09-21T22:02:04.259 INFO:teuthology.orchestra.run.smithi102.stdout:5864 write 0xbfb1c9f thru 0xbfb5a11 (0x3d73 bytes) 2024-09-21T22:02:04.259 INFO:teuthology.orchestra.run.smithi102.stdout:5865 read 0xa941d0e thru 0xa9457a1 (0x3a94 bytes) 2024-09-21T22:02:04.259 INFO:teuthology.orchestra.run.smithi102.stdout:5866 trunc from 0xbfb5a12 to 0x9f9d99d 2024-09-21T22:02:04.259 INFO:teuthology.orchestra.run.smithi102.stdout:5870 punch from 0x18f3f5c to 0x18f66fa, (0x279e bytes) 2024-09-21T22:02:04.259 INFO:teuthology.orchestra.run.smithi102.stdout:5871 write 0x57c0083 thru 0x57c9e18 (0x9d96 bytes) 2024-09-21T22:02:04.259 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.259 INFO:teuthology.orchestra.run.smithi102.stdout:5874 write 0xe0ffdf2 thru 0xe105a67 (0x5c76 bytes) 2024-09-21T22:02:04.259 INFO:teuthology.orchestra.run.smithi102.stdout:5875 flatten 2024-09-21T22:02:04.259 INFO:teuthology.orchestra.run.smithi102.stdout:5876 read 0x9649ee6 thru 0x964f481 (0x559c bytes) 2024-09-21T22:02:04.265 INFO:teuthology.orchestra.run.smithi102.stdout:5877 trunc from 0xe105a68 to 0xe528e4 2024-09-21T22:02:04.278 INFO:teuthology.orchestra.run.smithi102.stdout:5879 punch from 0x40a31b to 0x4112cf, (0x6fb4 bytes) 2024-09-21T22:02:04.291 INFO:teuthology.orchestra.run.smithi102.stdout:5880 writesame 0x6a9c968 thru 0x6a9ffe8 data_size 0x1(0x3681 bytes) 2024-09-21T22:02:04.291 INFO:teuthology.orchestra.run.smithi102.stdout:5881 read 0x3d245e8 thru 0x3d33e2b (0xf844 bytes) 2024-09-21T22:02:04.291 INFO:teuthology.orchestra.run.smithi102.stdout:5882 punch from 0x2ee350f to 0x2eeb82c, (0x831d bytes) 2024-09-21T22:02:04.291 INFO:teuthology.orchestra.run.smithi102.stdout:5883 punch from 0x49b4d40 to 0x49bc26b, (0x752b bytes) 2024-09-21T22:02:04.291 INFO:teuthology.orchestra.run.smithi102.stdout:5884 read 0x46f0e06 thru 0x46fa3d3 (0x95ce bytes) 2024-09-21T22:02:04.291 INFO:teuthology.orchestra.run.smithi102.stdout:5886 write 0x8c96a thru 0x992ee (0xc985 bytes) 2024-09-21T22:02:04.299 INFO:teuthology.orchestra.run.smithi102.stdout:5887 trunc from 0x6a9ffe9 to 0xfaf7fd 2024-09-21T22:02:04.313 INFO:teuthology.orchestra.run.smithi102.stdout:5888 writesame 0x1f6dfd5 thru 0x1f70f16 data_size 0x2(0x2f42 bytes) 2024-09-21T22:02:04.315 INFO:teuthology.orchestra.run.smithi102.stdout:5890 trunc from 0x1f70f17 to 0x44efae 2024-09-21T22:02:04.322 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.322 INFO:teuthology.orchestra.run.smithi102.stdout:5892 read 0x3605d0 thru 0x36c475 (0xbea6 bytes) 2024-09-21T22:02:04.322 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.322 INFO:teuthology.orchestra.run.smithi102.stdout:5894 read 0x4042ec thru 0x40e68f (0xa3a4 bytes) 2024-09-21T22:02:04.341 INFO:teuthology.orchestra.run.smithi102.stdout:5896 writesame 0xb4075d2 thru 0xb40d1df data_size 0x1(0x5c0e bytes) 2024-09-21T22:02:04.352 INFO:teuthology.orchestra.run.smithi102.stdout:5900 trunc from 0xb40d1e0 to 0x26d1db1 2024-09-21T22:02:04.357 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.358 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:04.357+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:04.367 INFO:teuthology.orchestra.run.smithi102.stdout:5902 writesame 0x5437dde thru 0x54472f1 data_size 0xa(0xf514 bytes) 2024-09-21T22:02:04.367 INFO:teuthology.orchestra.run.smithi102.stdout:5904 punch from 0x14cc060 to 0x14db52d, (0xf4cd bytes) 2024-09-21T22:02:04.377 INFO:teuthology.orchestra.run.smithi102.stdout:5905 write 0x94027d0 thru 0x9409b35 (0x7366 bytes) 2024-09-21T22:02:04.393 INFO:teuthology.orchestra.run.smithi102.stdout:5907 writesame 0xe9359f8 thru 0xe941d61 data_size 0x1(0xc36a bytes) 2024-09-21T22:02:04.393 INFO:teuthology.orchestra.run.smithi102.stdout:5908 punch from 0xbb2ea00 to 0xbb3058f, (0x1b8f bytes) 2024-09-21T22:02:04.393 INFO:teuthology.orchestra.run.smithi102.stdout:5909 write 0x6682ded thru 0x66921ee (0xf402 bytes) 2024-09-21T22:02:04.397 INFO:teuthology.orchestra.run.smithi102.stdout:5911 write 0x9569628 thru 0x956e36c (0x4d45 bytes) 2024-09-21T22:02:04.398 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.399 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.399 INFO:teuthology.orchestra.run.smithi102.stdout:5914 writesame 0xb0ccb7f thru 0xb0d1fd4 data_size 0x55(0x5456 bytes) 2024-09-21T22:02:04.402 INFO:teuthology.orchestra.run.smithi102.stdout:5916 punch from 0x9e66513 to 0x9e71be5, (0xb6d2 bytes) 2024-09-21T22:02:04.402 INFO:teuthology.orchestra.run.smithi102.stdout:5917 read 0xddfe441 thru 0xde003f5 (0x1fb5 bytes) 2024-09-21T22:02:04.402 INFO:teuthology.orchestra.run.smithi102.stdout:5918 write 0xbfd0036 thru 0xbfd3191 (0x315c bytes) 2024-09-21T22:02:04.404 INFO:teuthology.orchestra.run.smithi102.stdout:5919 writesame 0x1ff1a8e thru 0x2000e02 data_size 0xf(0xf375 bytes) 2024-09-21T22:02:04.407 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:04.407 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:04.407 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:04.407 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:04.408 INFO:teuthology.orchestra.run.smithi102.stdout:5920 write 0x72037d2 thru 0x7210b91 (0xd3c0 bytes) 2024-09-21T22:02:04.414 INFO:teuthology.orchestra.run.smithi102.stdout:5921 trunc from 0xe941d62 to 0xc941c47 2024-09-21T22:02:04.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:04.420 INFO:teuthology.orchestra.run.smithi102.stdout:5922 write 0x43d0a23 thru 0x43db8bf (0xae9d bytes) 2024-09-21T22:02:04.424 INFO:teuthology.orchestra.run.smithi102.stdout:5923 write 0x67a2104 thru 0x67aad4e (0x8c4b bytes) 2024-09-21T22:02:04.425 INFO:teuthology.orchestra.run.smithi102.stdout:5925 writesame 0x2d95a52 thru 0x2d9660b data_size 0x2(0xbba bytes) 2024-09-21T22:02:04.436 INFO:teuthology.orchestra.run.smithi102.stdout:5926 write 0xe351b6e thru 0xe35e0d6 (0xc569 bytes) 2024-09-21T22:02:04.439 INFO:teuthology.orchestra.run.smithi102.stdout:5927 write 0x66de74f thru 0x66e9364 (0xac16 bytes) 2024-09-21T22:02:04.441 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.441 INFO:teuthology.orchestra.run.smithi102.stdout:5929 write 0x85f478e thru 0x8603e01 (0xf674 bytes) 2024-09-21T22:02:04.445 INFO:teuthology.orchestra.run.smithi102.stdout:5930 write 0x73f8155 thru 0x7401725 (0x95d1 bytes) 2024-09-21T22:02:04.447 INFO:teuthology.orchestra.run.smithi102.stdout:5931 punch from 0x9ee6857 to 0x9eedabb, (0x7264 bytes) 2024-09-21T22:02:04.447 INFO:teuthology.orchestra.run.smithi102.stdout:5932 write 0x204cf7d thru 0x205bb60 (0xebe4 bytes) 2024-09-21T22:02:04.448 INFO:teuthology.orchestra.run.smithi102.stdout:5934 writesame 0xdd62a97 thru 0xdd68c6a data_size 0x6(0x61d4 bytes) 2024-09-21T22:02:04.452 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.452 INFO:teuthology.orchestra.run.smithi102.stdout:5937 write 0x7ba564f thru 0x7bad8ba (0x826c bytes) 2024-09-21T22:02:04.454 INFO:teuthology.orchestra.run.smithi102.stdout:5938 write 0xc9febac thru 0xca09b7f (0xafd4 bytes) 2024-09-21T22:02:04.458 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:04.457+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:04.468 INFO:teuthology.orchestra.run.smithi102.stdout:5939 trunc from 0xe35e0d7 to 0x599f1d3 2024-09-21T22:02:04.488 INFO:teuthology.orchestra.run.smithi102.stdout:5945 writesame 0x6894438 thru 0x689e8e6 data_size 0x45(0xa4af bytes) 2024-09-21T22:02:04.489 INFO:teuthology.orchestra.run.smithi102.stdout:5946 punch from 0x248b3c2 to 0x249385d, (0x849b bytes) 2024-09-21T22:02:04.504 INFO:teuthology.orchestra.run.smithi102.stdout:5947 writesame 0xdce8339 thru 0xdcf013c data_size 0xa(0x7e04 bytes) 2024-09-21T22:02:04.504 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.504 INFO:teuthology.orchestra.run.smithi102.stdout:5952 write 0x3cc2e2d thru 0x3cc827e (0x5452 bytes) 2024-09-21T22:02:04.508 INFO:teuthology.orchestra.run.smithi102.stdout:5954 read 0x3e47af5 thru 0x3e4e765 (0x6c71 bytes) 2024-09-21T22:02:04.508 INFO:teuthology.orchestra.run.smithi102.stdout:5956 punch from 0x6f50714 to 0x6f5a5ce, (0x9eba bytes) 2024-09-21T22:02:04.508 INFO:teuthology.orchestra.run.smithi102.stdout:5958 read 0x5b554cf thru 0x5b5c686 (0x71b8 bytes) 2024-09-21T22:02:04.508 INFO:teuthology.orchestra.run.smithi102.stdout:5960 write 0xbedf1e1 thru 0xbee376c (0x458c bytes) 2024-09-21T22:02:04.512 INFO:teuthology.orchestra.run.smithi102.stdout:5961 punch from 0xa2ecdb5 to 0xa2f1317, (0x4562 bytes) 2024-09-21T22:02:04.523 INFO:teuthology.orchestra.run.smithi102.stdout:5962 trunc from 0xdcf013d to 0x3eefb11 2024-09-21T22:02:04.535 INFO:teuthology.orchestra.run.smithi102.stdout:5963 read 0x3947a4d thru 0x3956291 (0xe845 bytes) 2024-09-21T22:02:04.543 INFO:teuthology.orchestra.run.smithi102.stdout:5965 write 0x5ed7811 thru 0x5ee042d (0x8c1d bytes) 2024-09-21T22:02:04.546 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.546 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.547 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.549 INFO:teuthology.orchestra.run.smithi102.stdout:5970 trunc from 0x5ee042e to 0x3b2e3b8 2024-09-21T22:02:04.559 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:04.558+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:04.560 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.566 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:04.566 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:04.566 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:04.566 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:04.566 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:04.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:04.577 INFO:teuthology.orchestra.run.smithi102.stdout:5973 writesame 0xd36edda thru 0xd373f85 data_size 0x2(0x51ac bytes) 2024-09-21T22:02:04.577 INFO:teuthology.orchestra.run.smithi102.stdout:5976 writesame 0xb6ce0c5 thru 0xb6d1cdb data_size 0x1(0x3c17 bytes) 2024-09-21T22:02:04.592 INFO:teuthology.orchestra.run.smithi102.stdout:5977 trunc from 0xd373f86 to 0x82c70a3 2024-09-21T22:02:04.601 INFO:teuthology.orchestra.run.smithi102.stdout:5979 read 0x6867305 thru 0x6869876 (0x2572 bytes) 2024-09-21T22:02:04.601 INFO:teuthology.orchestra.run.smithi102.stdout:5980 read 0x21febc7 thru 0x220106c (0x24a6 bytes) 2024-09-21T22:02:04.601 INFO:teuthology.orchestra.run.smithi102.stdout:5981 punch from 0x57afb25 to 0x57b55e1, (0x5abc bytes) 2024-09-21T22:02:04.602 INFO:teuthology.orchestra.run.smithi102.stdout:5983 read 0x2a7e9ad thru 0x2a8a93e (0xbf92 bytes) 2024-09-21T22:02:04.602 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.602 INFO:teuthology.orchestra.run.smithi102.stdout:compare and write disabled 2024-09-21T22:02:04.602 INFO:teuthology.orchestra.run.smithi102.stdout:5988 punch from 0x18fd928 to 0x1900aa6, (0x317e bytes) 2024-09-21T22:02:04.602 INFO:teuthology.orchestra.run.smithi102.stdout:5989 punch from 0x42079cd to 0x420e757, (0x6d8a bytes) 2024-09-21T22:02:04.602 INFO:teuthology.orchestra.run.smithi102.stdout:5990 writesame 0x3da3f17 thru 0x3da417d data_size 0x5(0x267 bytes) 2024-09-21T22:02:04.603 INFO:teuthology.orchestra.run.smithi102.stdout:5991 read 0x5db8bc7 thru 0x5dbdbd8 (0x5012 bytes) 2024-09-21T22:02:04.609 INFO:teuthology.orchestra.run.smithi102.stdout:5992 write 0x88ee37d thru 0x88f2e54 (0x4ad8 bytes) 2024-09-21T22:02:04.625 INFO:teuthology.orchestra.run.smithi102.stdout:5993 write 0xd36fe94 thru 0xd370f21 (0x108e bytes) 2024-09-21T22:02:04.635 INFO:teuthology.orchestra.run.smithi102.stdout:5994 punch from 0xdcf321 to 0xddabbf, (0xb89e bytes) 2024-09-21T22:02:04.635 INFO:teuthology.orchestra.run.smithi102.stdout:5995 read 0x22e3784 thru 0x22ef835 (0xc0b2 bytes) 2024-09-21T22:02:04.649 INFO:teuthology.orchestra.run.smithi102.stdout:5997 trunc from 0xd370f22 to 0xf4e974 2024-09-21T22:02:04.659 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:04.659+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:04.680 INFO:teuthology.orchestra.run.smithi102.stdout:5998 writesame 0x6ea065e thru 0x6ea2da7 data_size 0x2(0x274a bytes) 2024-09-21T22:02:04.680 INFO:teuthology.orchestra.run.smithi102.stdout:5999 read 0x8bdd06 thru 0x8c4e1c (0x7117 bytes) 2024-09-21T22:02:04.692 INFO:teuthology.orchestra.run.smithi102.stdout:6000 writesame 0xbeffe56 thru 0xbf08cc1 data_size 0xa(0x8e6c bytes) 2024-09-21T22:02:04.724 INFO:teuthology.orchestra.run.smithi102.stdout:checking clone #44, image image_client.0-clone44 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent45 2024-09-21T22:02:04.725 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:04.725 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:04.725 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:04.725 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:04.725 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.879826655999999, 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.726 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.727 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:02:04.728 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:02:04.729 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:02:04.730 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.731 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.880915143000003, 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.732 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:02:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:02:04.734 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:02:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:02:04.736 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:02:04.737 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.772458385999997, 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:02:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.739 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:02:04.740 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:02:04.741 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.772449092999999, 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.742 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.743 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.744 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:02:04.745 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.772425347000002, 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:02:04.746 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.747 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.748 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.749 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:04.750 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.772414793999999, 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.751 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:02:04.753 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.754 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.772405390999999, 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:02:04.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:02:04.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.758 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.772394601000002, 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:04.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.772361328000002, 2024-09-21T22:02:04.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.772350656, 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:02:04.766 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:02:04.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:02:04.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.768221165, 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.770 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:04.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:02:04.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.767822027000001, 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:02:04.774 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:02:04.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.766867435999998, 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.778 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:04.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:02:04.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:02:04.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.766844183000003, 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:02:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:02:04.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.765551512999998, 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.786 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:02:04.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:02:04.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.765532399999998, 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:02:04.790 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:04.794 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.76551327, 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:02:04.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.765494932000003, 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:02:04.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 44.765476532999998, 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.802 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:41899 3.10 3:0bb333a9:::rbd_data.11247a90fb52.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 35.968567122000003, 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015085853, 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:04.806 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 41899 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754789+0000", 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.372e-06 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754796+0000", 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8249999999999999e-06 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754809+0000", 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3662000000000001e-05 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754816+0000", 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7220000000000002e-06 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754866+0000", 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9945999999999999e-05 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754919+0000", 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3329999999999999e-05 2024-09-21T22:02:04.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.758040+0000", 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031204869999999999 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769752+0000", 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011712530000000001 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769803+0000", 2024-09-21T22:02:04.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.117e-05 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769841+0000", 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7982999999999999e-05 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769873+0000", 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1826000000000003e-05 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.811 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:04.812 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:04.812 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:04.812 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:02:04.813 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T22:02:04.814 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:04.815 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T22:02:04.815 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:04.810+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:04.913 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:04.913+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:04.958 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:04.958 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:04.958 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:04.958 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:04.967 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:05.014 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:05.012+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:05.111 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:05.111 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:05.111 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:05.111 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:05.111 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:05.115 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:05.114+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:05.120 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:05.216 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:05.216+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:05.265 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:05.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 87.189995044, 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:02:05.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:02:05.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.757958793, 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.272 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:02:05.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:02:05.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 47.405131976, 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.277 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 47.405112512999999, 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.281 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 47.405084436000003, 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:02:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 47.405062604000001, 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:02:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:02:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 47.405042277, 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 47.405021314999999, 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 47.405000328, 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:02:05.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29863 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 3031040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:05.304 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 47.370043348999999, 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023866634000000001, 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29863 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893334+0000", 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893339+0000", 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:02:05.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893345+0000", 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1469999999999998e-06 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893356+0000", 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0772e-05 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917062+0000", 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023706261999999999 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917108+0000", 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5318000000000002e-05 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917200+0000", 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2238999999999996e-05 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 24.463553533999999, 2024-09-21T22:02:05.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:02:05.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:02:05.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81730 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7127040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:05.313 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0899331380000001, 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023997688999999999, 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81730 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173444+0000", 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173450+0000", 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173456+0000", 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0599999999999996e-06 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173461+0000", 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5279999999999997e-06 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197301+0000", 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023840647 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197353+0000", 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2222000000000002e-05 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197441+0000", 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81734 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:05.317 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0898977050000003, 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024110228000000001, 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81734 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173482+0000", 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.136e-06 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173488+0000", 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3380000000000001e-06 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173493+0000", 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197456+0000", 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023962944999999999 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197495+0000", 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9385000000000003e-05 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197589+0000", 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4097000000000004e-05 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81735 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0898773300000002, 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024317473999999999, 2024-09-21T22:02:05.321 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81735 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173500+0000", 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173502+0000", 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9580000000000001e-06 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173507+0000", 2024-09-21T22:02:05.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6080000000000003e-06 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173516+0000", 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8130000000000002e-06 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197630+0000", 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024114304 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197717+0000", 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6839e-05 2024-09-21T22:02:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197817+0000", 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9494000000000007e-05 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81736 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0898544709999998, 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024493269000000002, 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.325 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81736 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173523+0000", 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173524+0000", 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173531+0000", 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.049e-06 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173539+0000", 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5790000000000004e-06 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197853+0000", 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024313950000000001 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197926+0000", 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2606000000000002e-05 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198015+0000", 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9728000000000006e-05 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81737 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 3883008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0898316230000002, 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024642094, 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.329 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81737 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173547+0000", 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.013e-06 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173554+0000", 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4559999999999997e-06 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173558+0000", 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4240000000000003e-06 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198041+0000", 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024483076999999999 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198102+0000", 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1066000000000001e-05 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198187+0000", 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4685000000000007e-05 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81738 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 4571136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0898127730000002, 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024869964000000001, 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.333 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81738 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173566+0000", 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.86e-06 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173574+0000", 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3200000000000002e-06 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173578+0000", 2024-09-21T22:02:05.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5360000000000003e-06 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198231+0000", 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024653195999999999 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198318+0000", 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6810000000000004e-05 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198434+0000", 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011572 2024-09-21T22:02:05.336 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81739 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0897925959999997, 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024965376000000001, 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81739 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.337 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173590+0000", 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173596+0000", 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1199999999999999e-06 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173600+0000", 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2379999999999999e-06 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198454+0000", 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024854246 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198496+0000", 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2202e-05 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198549+0000", 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3038999999999998e-05 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81740 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 6537216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.0897706579999999, 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025068272999999999, 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81740 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.341 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173608+0000", 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173614+0000", 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173618+0000", 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.459e-06 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198573+0000", 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024954473000000001 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198614+0000", 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.087e-05 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198674+0000", 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0528000000000001e-05 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81749 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7815168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 4.089752442, 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025172553, 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81749 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:05.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173625+0000", 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.46e-07 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173626+0000", 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.841e-06 2024-09-21T22:02:05.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173632+0000", 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8130000000000001e-06 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173638+0000", 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198697+0000", 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025059100000000001 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198736+0000", 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9319000000000001e-05 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198797+0000", 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0445000000000001e-05 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:05.348 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:05.349 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:05.350 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:05.348+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:05.450 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:05.448+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:05.454 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:05.454 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:05.454 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:05.454 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:05.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:05.550 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:05.548+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:05.606 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:05.606 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:05.606 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:05.606 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:05.606 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:05.615 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:05.620 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:05.656 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:05.654+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T22:02:05.752 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:05.750+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:05.762 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T22:02:05.778 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:05.778 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:05.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:05.778 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:05.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.778 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.778 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535427400000003, 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:05.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:02:05.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:02:05.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.782 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535405380999997, 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:02:05.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:05.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:02:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:02:05.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535384800000003, 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.787 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:02:05.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:02:05.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535356202000003, 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.791 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535333797, 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.795 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535313782000003, 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535293578999998, 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.803 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535274319999999, 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.807 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:02:05.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:02:05.810 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535248252999999, 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:02:05.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:02:05.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.814 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535227601999999, 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.815 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.818 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535169422999999, 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.819 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535114643999997, 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:02:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535080188000002, 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.830 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535058857999999, 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:05.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:02:05.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:02:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.834 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535037697, 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:05.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:02:05.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:05.838 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.535007172999997, 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:02:05.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.534982814000003, 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.843 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.846 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.534961508999999, 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:02:05.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:02:05.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:02:05.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:02:05.850 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.534940118999998, 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.851 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.534918752000003, 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:05.855 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:05.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:02:05.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:02:05.858 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.859 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.859 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.859 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:05.859 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:05.859 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:05.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:05.860 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:05.861 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:05.861 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:05.861 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:05.861 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:05.862 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:05.862 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:05.862 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:05.863 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:05.859+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:05.863 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:05.864 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:05.884 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:05.884 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:05.901 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:05.901 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:05.918 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:05.918 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:05.970 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:05.970 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:05.971 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:05.968+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:05.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:06.061 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:06.060+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:06.123 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:06.123 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:06.132 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:06.162 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:06.161+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:06.236 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:06.236 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:06.244 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:06.263 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:06.262+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:06.347 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:06.347 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:06.356 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:06.363 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:06.362+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:06.458 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:06.458 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:06.465 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:06.464+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:06.467 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:06.565 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:06.564+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:06.570 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:06.570 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:06.578 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:06.666 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:06.664+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:06.722 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:06.723 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:06.732 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:06.747 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T22:02:06.768 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T22:02:06.768 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:06.765+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:06.815 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:02:06.868 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:06.868+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:06.876 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:06.877 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:06.888 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:06.969 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:06.968+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:07.035 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:07.035 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:07.044 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:07.088 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:07.087+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:07.153 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:07.153 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:07.162 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:07.203 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:07.202+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:07.272 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:07.270+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:07.305 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:07.305 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:07.314 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:07.373 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:07.372+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:07.418 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:07.418 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:07.427 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:07.474 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:07.474+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:07.530 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:07.530 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:07.539 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:07.580 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:07.579+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:07.676 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:07.674+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:07.681 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:07.682 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:07.690 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:07.751 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T22:02:07.755 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:02:07.770 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T22:02:07.799 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:07.799 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:07.809 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:07.814 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:07.812+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:07.878 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:07.876+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:07.916 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:07.916 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:07.925 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:07.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:07.979 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:07.977+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:08.027 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:08.027 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:08.036 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:08.055 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:08.055 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:08.072 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:08.072 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:08.080 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:08.079+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:08.088 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:08.088 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:08.104 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:08.104 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:08.121 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:08.121 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:08.138 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:08.138 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:08.140 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:08.140 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:08.149 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:08.154 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:08.155 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:08.171 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:08.171 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:08.191 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:08.190+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:08.281 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:08.281+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:08.293 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:08.293 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:08.293 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:08.293 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:08.302 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:08.386 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:08.385+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:08.444 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:08.444 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:08.444 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:08.444 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:08.444 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:08.453 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:08.494 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:08.493+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:08.584 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:08.583+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:08.599 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:08.599 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:08.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:08.599 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:08.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.599 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:02:08.599 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 90.522727958999994, 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:02:08.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:02:08.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:02:08.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:02:08.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:02:08.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:02:08.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:02:08.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:02:08.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:08.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:02:08.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:02:08.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:08.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:02:08.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:08.608 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.090691708000001, 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:02:08.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.614 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.737864891000001, 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.615 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:02:08.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:08.619 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.737845428, 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:08.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.737817350999997, 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.624 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:02:08.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.737795519000002, 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.628 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:08.632 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.737775192000001, 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:08.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.636 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.73775423, 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.637 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:02:08.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:02:08.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.737733243000001, 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29863 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 3031040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.702776264000001, 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023866634000000001, 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.645 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29863 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:08.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893334+0000", 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893339+0000", 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893345+0000", 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1469999999999998e-06 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893356+0000", 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0772e-05 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917062+0000", 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023706261999999999 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917108+0000", 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5318000000000002e-05 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917200+0000", 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2238999999999996e-05 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.796286449, 2024-09-21T22:02:08.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:02:08.650 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.650 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.650 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:08.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.650 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.650 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:02:08.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.650 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:02:08.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81730 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7127040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.4226660530000004, 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023997688999999999, 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81730 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173444+0000", 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173450+0000", 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173456+0000", 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0599999999999996e-06 2024-09-21T22:02:08.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173461+0000", 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5279999999999997e-06 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197301+0000", 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023840647 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197353+0000", 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2222000000000002e-05 2024-09-21T22:02:08.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197441+0000", 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81734 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.4226306199999996, 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024110228000000001, 2024-09-21T22:02:08.659 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81734 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173482+0000", 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.136e-06 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173488+0000", 2024-09-21T22:02:08.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3380000000000001e-06 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173493+0000", 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197456+0000", 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023962944999999999 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197495+0000", 2024-09-21T22:02:08.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9385000000000003e-05 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197589+0000", 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4097000000000004e-05 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81735 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.4226102449999996, 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024317473999999999, 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.663 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81735 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:08.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173500+0000", 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173502+0000", 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9580000000000001e-06 2024-09-21T22:02:08.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173507+0000", 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6080000000000003e-06 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173516+0000", 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8130000000000002e-06 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197630+0000", 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024114304 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197717+0000", 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6839e-05 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197817+0000", 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9494000000000007e-05 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.667 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81736 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.422587386, 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024493269000000002, 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81736 2024-09-21T22:02:08.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173523+0000", 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173524+0000", 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173531+0000", 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.049e-06 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173539+0000", 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5790000000000004e-06 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197853+0000", 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024313950000000001 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197926+0000", 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2606000000000002e-05 2024-09-21T22:02:08.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198015+0000", 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9728000000000006e-05 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81737 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 3883008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.4225645379999996, 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024642094, 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.672 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81737 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173547+0000", 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.013e-06 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173554+0000", 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4559999999999997e-06 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173558+0000", 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4240000000000003e-06 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198041+0000", 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024483076999999999 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198102+0000", 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1066000000000001e-05 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198187+0000", 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4685000000000007e-05 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81738 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 4571136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:08.676 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.4225456879999996, 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024869964000000001, 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81738 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173566+0000", 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.86e-06 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173574+0000", 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3200000000000002e-06 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173578+0000", 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5360000000000003e-06 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198231+0000", 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024653195999999999 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198318+0000", 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6810000000000004e-05 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198434+0000", 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011572 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81739 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:08.680 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.4225255109999999, 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024965376000000001, 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81739 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173590+0000", 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173596+0000", 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1199999999999999e-06 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173600+0000", 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2379999999999999e-06 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198454+0000", 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024854246 2024-09-21T22:02:08.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198496+0000", 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2202e-05 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198549+0000", 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3038999999999998e-05 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81740 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 6537216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.4225035730000002, 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025068272999999999, 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81740 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.685 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173608+0000", 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173614+0000", 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173618+0000", 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.459e-06 2024-09-21T22:02:08.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198573+0000", 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024954473000000001 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198614+0000", 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.087e-05 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198674+0000", 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0528000000000001e-05 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.688 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81749 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7815168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 7.4224853570000002, 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025172553, 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81749 2024-09-21T22:02:08.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:08.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173625+0000", 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.46e-07 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173626+0000", 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.841e-06 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173632+0000", 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8130000000000001e-06 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173638+0000", 2024-09-21T22:02:08.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198697+0000", 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025059100000000001 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198736+0000", 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9319000000000001e-05 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198797+0000", 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0445000000000001e-05 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.692 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.693 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.693 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:08.693 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:08.693 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:08.694 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:08.693+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:08.694 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:08.753 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T22:02:08.778 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T22:02:08.794 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:08.793+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:08.819 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:08.819 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:08.819 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:08.819 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:08.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:08.914 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:08.913+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:08.986 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:08.986 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:08.986 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:08.986 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:08.986 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:08.995 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:08.996 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:08.996+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:09.097 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:09.096+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:09.139 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.898153069000003, 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:02:09.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.898131050000003, 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.898110469000002, 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.148 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.898081871000002, 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.152 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:02:09.155 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.898059465999999, 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.156 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:02:09.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:02:09.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.159 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.898039451000002, 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.160 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.898019247999997, 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897999988999999, 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:02:09.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897973921999998, 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:09.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:02:09.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:02:09.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897953270999999, 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.176 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897895091999999, 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:02:09.180 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:02:09.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:02:09.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897840313000003, 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:02:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897805857000002, 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897784526999999, 2024-09-21T22:02:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897763366, 2024-09-21T22:02:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:02:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897732842000003, 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:02:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897708483000002, 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:02:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897687177999998, 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:02:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897665787999998, 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.897644421000003, 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.221 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.221 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:09.222 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:09.222 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:09.220+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:09.322 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:09.321+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:09.368 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:09.368 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:09.377 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:09.461 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:09.460+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:09.520 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:09.520 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:09.520 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:09.520 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:09.520 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:09.524 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:09.523+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:09.528 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:09.625 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:09.625+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:09.672 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:09.672 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:09.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707231557999997, 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.673 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:02:09.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:02:09.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707210316999998, 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.677 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707189089000003, 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.681 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707165482999997, 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.685 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:02:09.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707146193, 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.689 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:02:09.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707113947000003, 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.693 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:02:09.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707089977999999, 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:02:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707070414, 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.701 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:02:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:02:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707049982000001, 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:02:09.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:02:09.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.709 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707028858999998, 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:02:09.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:09.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:02:09.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.713 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.707009642999999, 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.714 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.706989171000004, 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:02:09.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.721 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.706968455999998, 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:02:09.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:02:09.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.706948699999998, 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:02:09.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.729 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.706928984999998, 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:09.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:02:09.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:09.733 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.706909074999999, 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:02:09.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.706888092, 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.737 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:09.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:02:09.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.706867408000001, 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:02:09.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:02:09.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.706841504000003, 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 51.706820587000003, 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:09.749 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:09.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:09.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:02:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:02:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:09.753 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:09.753 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:09.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:09.755 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:09.753+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:09.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:02:09.773 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T22:02:09.791 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T22:02:09.875 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:09.874+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:09.911 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:09.911 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:09.911 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:09.911 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:09.921 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:09.962 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:09.961+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:10.056 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:10.056+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:10.065 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:10.065 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:10.065 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:10.065 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:10.065 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:10.074 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T22:02:10.111+0000 7f87bc8c5640 0 --2- 172.21.15.102:0/2518575376 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b813bdb0 0x7f87b80ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-21T22:02:10.157 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:10.156+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:10.180 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.309183732000001, 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.181 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:02:10.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.309163738999999, 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:02:10.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.309044303999997, 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.189 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:10.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:02:10.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308777597999999, 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:02:10.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:02:10.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308747435999997, 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.197 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:10.201 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308721900000002, 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:10.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:02:10.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.205 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308699372, 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:02:10.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:02:10.209 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308675751999999, 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.210 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.214 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308655403000003, 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:10.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308632989000003, 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:02:10.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:02:10.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308456921999998, 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.223 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:02:10.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308427913999999, 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.227 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:10.231 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308406083000001, 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:10.235 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308248937999998, 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.239 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308216467999998, 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:02:10.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.243 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308194937000003, 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308173619999998, 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:10.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:02:10.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:02:10.251 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308148178000003, 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.252 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:02:10.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308127478999999, 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:02:10.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:10.260 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.308106846999998, 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:10.264 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:10.265 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:10.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:10.267 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:10.265+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:10.367 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:10.366+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:10.413 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:10.413 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:10.413 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:10.422 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:10.428 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:10.428 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:10.445 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:10.446 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:10.463 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:10.463 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:10.467 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:10.466+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:10.479 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:10.480 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:10.497 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:10.513 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:10.513 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:10.528 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:10.528 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:10.530 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:10.530 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:10.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:10.547 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:10.547 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:10.568 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:10.567+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:10.650 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:10.650 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:10.659 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:10.703 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:10.702+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:10.769 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:10.768+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:10.770 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:10.770 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:10.772 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T22:02:10.772 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:02:10.781 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:10.795 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T22:02:10.795 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:02:10.879 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:10.878+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:10.939 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:10.948 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:10.992 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:10.991+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:11.052 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:11.052 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:11.060 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:11.102 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:11.101+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:11.126 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:02:11.126 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:02:11.138 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-21T22:02:11.017761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2007258126,"num_objects":1940,"num_object_clones":495,"num_object_copies":3880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1940,"num_whiteouts":450,"num_read":129502,"num_read_kb":751963,"num_write":19045,"num_write_kb":437954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":324,"num_bytes_recovered":30603674,"num_keys_recovered":83,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15291,"ondisk_log_size":15291,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":385784,"kb_used_data":72756,"kb_used_omap":10,"kb_used_meta":312565,"kb_avail":660217096,"statfs":{"total":676457349120,"available":676062306304,"internally_reserved":0,"allocated":74502144,"data_stored":736141054,"data_compressed":24311685,"data_compressed_allocated":56729600,"data_compressed_original":726712787,"omap_allocated":11156,"internal_metadata":320066668},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-54500383,"num_objects":-77,"num_object_clones":-24,"num_object_copies":-154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-77,"num_whiteouts":-21,"num_read":5608,"num_read_kb":24478,"num_write":875,"num_write_kb":5578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000633"},"pg_stats":[{"pgid":"3.1f","version":"89'304","reported_seq":1831,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.749798+0000","last_change":"2024-09-21T22:02:05.749798+0000","last_active":"2024-09-21T22:02:05.749798+0000","last_peered":"2024-09-21T22:02:05.749798+0000","last_clean":"2024-09-21T22:02:05.749798+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:02:05.749798+0000","last_undegraded":"2024-09-21T22:02:05.749798+0000","last_fullsized":"2024-09-21T22:02:05.749798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:52:46.191208+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0027146890000000002,"stat_sum":{"num_bytes":27199142,"num_objects":58,"num_object_clones":13,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":13,"num_read":2574,"num_read_kb":17505,"num_write":339,"num_write_kb":16596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"3.1e","version":"90'537","reported_seq":2423,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.847777+0000","last_change":"2024-09-21T22:02:06.759274+0000","last_active":"2024-09-21T22:02:06.847777+0000","last_peered":"2024-09-21T22:02:06.847777+0000","last_clean":"2024-09-21T22:02:06.847777+0000","last_became_active":"2024-09-21T22:01:39.893876+0000","last_became_peered":"2024-09-21T22:01:39.893876+0000","last_unstale":"2024-09-21T22:02:06.847777+0000","last_undegraded":"2024-09-21T22:02:06.847777+0000","last_fullsized":"2024-09-21T22:02:06.847777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:36.869191+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0079387429999999998,"stat_sum":{"num_bytes":68620390,"num_objects":64,"num_object_clones":15,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":13,"num_read":3373,"num_read_kb":17563,"num_write":727,"num_write_kb":7987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":4275862,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.1d","version":"90'1092","reported_seq":3701,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.768716+0000","last_change":"2024-09-21T22:02:06.768716+0000","last_active":"2024-09-21T22:02:06.768716+0000","last_peered":"2024-09-21T22:02:06.768716+0000","last_clean":"2024-09-21T22:02:06.768716+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:02:06.768716+0000","last_undegraded":"2024-09-21T22:02:06.768716+0000","last_fullsized":"2024-09-21T22:02:06.768716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1092,"log_dups_size":0,"ondisk_log_size":1092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:26:07.599295+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.003792798,"stat_sum":{"num_bytes":46330109,"num_objects":70,"num_object_clones":20,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":19,"num_read":8364,"num_read_kb":25271,"num_write":1443,"num_write_kb":17099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.1c","version":"90'408","reported_seq":5647,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.850211+0000","last_change":"2024-09-21T22:02:06.766352+0000","last_active":"2024-09-21T22:02:06.850211+0000","last_peered":"2024-09-21T22:02:06.850211+0000","last_clean":"2024-09-21T22:02:06.850211+0000","last_became_active":"2024-09-21T22:00:54.161171+0000","last_became_peered":"2024-09-21T22:00:54.161171+0000","last_unstale":"2024-09-21T22:02:06.850211+0000","last_undegraded":"2024-09-21T22:02:06.850211+0000","last_fullsized":"2024-09-21T22:02:06.850211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:32:51.758215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013824169999999999,"stat_sum":{"num_bytes":85098802,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":12,"num_read":5806,"num_read_kb":34295,"num_write":488,"num_write_kb":23356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.1b","version":"87'366","reported_seq":2066,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.746416+0000","last_change":"2024-09-21T22:02:05.746903+0000","last_active":"2024-09-21T22:02:05.746416+0000","last_peered":"2024-09-21T22:02:05.746416+0000","last_clean":"2024-09-21T22:02:05.746416+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:02:05.746416+0000","last_undegraded":"2024-09-21T22:02:05.746416+0000","last_fullsized":"2024-09-21T22:02:05.746416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:02:07.601474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010711989999999999,"stat_sum":{"num_bytes":43759513,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":2352,"num_read_kb":22169,"num_write":486,"num_write_kb":15124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"3.1a","version":"90'633","reported_seq":4832,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.883694+0000","last_change":"2024-09-21T22:02:06.762082+0000","last_active":"2024-09-21T22:02:06.883694+0000","last_peered":"2024-09-21T22:02:06.883694+0000","last_clean":"2024-09-21T22:02:06.883694+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:02:06.883694+0000","last_undegraded":"2024-09-21T22:02:06.883694+0000","last_fullsized":"2024-09-21T22:02:06.883694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:57:07.349184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067288199999999997,"stat_sum":{"num_bytes":35534008,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":14,"num_read":7866,"num_read_kb":13869,"num_write":859,"num_write_kb":7251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.19","version":"90'628","reported_seq":4826,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.842857+0000","last_change":"2024-09-21T22:02:06.752763+0000","last_active":"2024-09-21T22:02:06.842857+0000","last_peered":"2024-09-21T22:02:06.842857+0000","last_clean":"2024-09-21T22:02:06.842857+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:02:06.842857+0000","last_undegraded":"2024-09-21T22:02:06.842857+0000","last_fullsized":"2024-09-21T22:02:06.842857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:41:53.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001685045,"stat_sum":{"num_bytes":71892343,"num_objects":66,"num_object_clones":16,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":16,"num_read":6244,"num_read_kb":21149,"num_write":847,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.18","version":"90'321","reported_seq":2802,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.843714+0000","last_change":"2024-09-21T22:02:06.754463+0000","last_active":"2024-09-21T22:02:06.843714+0000","last_peered":"2024-09-21T22:02:06.843714+0000","last_clean":"2024-09-21T22:02:06.843714+0000","last_became_active":"2024-09-21T22:00:54.155140+0000","last_became_peered":"2024-09-21T22:00:54.155140+0000","last_unstale":"2024-09-21T22:02:06.843714+0000","last_undegraded":"2024-09-21T22:02:06.843714+0000","last_fullsized":"2024-09-21T22:02:06.843714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:33:38.469083+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0032279790000000002,"stat_sum":{"num_bytes":81281286,"num_objects":64,"num_object_clones":17,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":14,"num_read":3031,"num_read_kb":25023,"num_write":311,"num_write_kb":14558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.17","version":"87'350","reported_seq":2938,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.748410+0000","last_change":"2024-09-21T22:02:05.748988+0000","last_active":"2024-09-21T22:02:05.748410+0000","last_peered":"2024-09-21T22:02:05.748410+0000","last_clean":"2024-09-21T22:02:05.748410+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:02:05.748410+0000","last_undegraded":"2024-09-21T22:02:05.748410+0000","last_fullsized":"2024-09-21T22:02:05.748410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:47:22.178572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001633928,"stat_sum":{"num_bytes":41354720,"num_objects":74,"num_object_clones":18,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":17,"num_read":4269,"num_read_kb":36537,"num_write":347,"num_write_kb":23149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"3.16","version":"90'445","reported_seq":4953,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.839308+0000","last_change":"2024-09-21T22:02:06.765644+0000","last_active":"2024-09-21T22:02:06.839308+0000","last_peered":"2024-09-21T22:02:06.839308+0000","last_clean":"2024-09-21T22:02:06.839308+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:02:06.839308+0000","last_undegraded":"2024-09-21T22:02:06.839308+0000","last_fullsized":"2024-09-21T22:02:06.839308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:48:00.140634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076438400000000001,"stat_sum":{"num_bytes":77670522,"num_objects":68,"num_object_clones":20,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":18,"num_read":5377,"num_read_kb":30480,"num_write":530,"num_write_kb":12130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.15","version":"90'306","reported_seq":1892,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.786013+0000","last_change":"2024-09-21T22:02:06.786013+0000","last_active":"2024-09-21T22:02:06.786013+0000","last_peered":"2024-09-21T22:02:06.786013+0000","last_clean":"2024-09-21T22:02:06.786013+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:02:06.786013+0000","last_undegraded":"2024-09-21T22:02:06.786013+0000","last_fullsized":"2024-09-21T22:02:06.786013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:57:25.679448+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.016751076,"stat_sum":{"num_bytes":71213278,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":13,"num_read":2180,"num_read_kb":16266,"num_write":368,"num_write_kb":14123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.14","version":"90'384","reported_seq":2451,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.773951+0000","last_change":"2024-09-21T22:02:06.774616+0000","last_active":"2024-09-21T22:02:06.773951+0000","last_peered":"2024-09-21T22:02:06.773951+0000","last_clean":"2024-09-21T22:02:06.773951+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:02:06.773951+0000","last_undegraded":"2024-09-21T22:02:06.773951+0000","last_fullsized":"2024-09-21T22:02:06.773951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:39.071579+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013024259,"stat_sum":{"num_bytes":69152345,"num_objects":64,"num_object_clones":19,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":17,"num_read":3069,"num_read_kb":22646,"num_write":416,"num_write_kb":9973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.769065+0000","last_change":"2024-09-21T22:01:36.874875+0000","last_active":"2024-09-21T22:02:06.769065+0000","last_peered":"2024-09-21T22:02:06.769065+0000","last_clean":"2024-09-21T22:02:06.769065+0000","last_became_active":"2024-09-21T22:01:36.874561+0000","last_became_peered":"2024-09-21T22:01:36.874561+0000","last_unstale":"2024-09-21T22:02:06.769065+0000","last_undegraded":"2024-09-21T22:02:06.769065+0000","last_fullsized":"2024-09-21T22:02:06.769065+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:00:04.279405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"89'509","reported_seq":3150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.873981+0000","last_change":"2024-09-21T22:02:05.746938+0000","last_active":"2024-09-21T22:02:05.873981+0000","last_peered":"2024-09-21T22:02:05.873981+0000","last_clean":"2024-09-21T22:02:05.873981+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:02:05.873981+0000","last_undegraded":"2024-09-21T22:02:05.873981+0000","last_fullsized":"2024-09-21T22:02:05.873981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:50.510758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053940100000000001,"stat_sum":{"num_bytes":83204057,"num_objects":64,"num_object_clones":17,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":13,"num_read":4424,"num_read_kb":29970,"num_write":674,"num_write_kb":21378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.761423+0000","last_change":"2024-09-21T22:01:36.878078+0000","last_active":"2024-09-21T22:02:06.761423+0000","last_peered":"2024-09-21T22:02:06.761423+0000","last_clean":"2024-09-21T22:02:06.761423+0000","last_became_active":"2024-09-21T22:01:36.877817+0000","last_became_peered":"2024-09-21T22:01:36.877817+0000","last_unstale":"2024-09-21T22:02:06.761423+0000","last_undegraded":"2024-09-21T22:02:06.761423+0000","last_fullsized":"2024-09-21T22:02:06.761423+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:28:22.652563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"90'326","reported_seq":2203,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.871089+0000","last_change":"2024-09-21T22:02:06.769976+0000","last_active":"2024-09-21T22:02:06.871089+0000","last_peered":"2024-09-21T22:02:06.871089+0000","last_clean":"2024-09-21T22:02:06.871089+0000","last_became_active":"2024-09-21T22:00:54.162377+0000","last_became_peered":"2024-09-21T22:00:54.162377+0000","last_unstale":"2024-09-21T22:02:06.871089+0000","last_undegraded":"2024-09-21T22:02:06.871089+0000","last_fullsized":"2024-09-21T22:02:06.871089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:24:38.158101+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.018342181999999999,"stat_sum":{"num_bytes":22926011,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":3066,"num_read_kb":17782,"num_write":312,"num_write_kb":12028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.769349+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:02:06.769349+0000","last_peered":"2024-09-21T22:02:06.769349+0000","last_clean":"2024-09-21T22:02:06.769349+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:02:06.769349+0000","last_undegraded":"2024-09-21T22:02:06.769349+0000","last_fullsized":"2024-09-21T22:02:06.769349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"90'1098","reported_seq":5875,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.851560+0000","last_change":"2024-09-21T22:02:06.759727+0000","last_active":"2024-09-21T22:02:06.851560+0000","last_peered":"2024-09-21T22:02:06.851560+0000","last_clean":"2024-09-21T22:02:06.851560+0000","last_became_active":"2024-09-21T22:00:54.158128+0000","last_became_peered":"2024-09-21T22:00:54.158128+0000","last_unstale":"2024-09-21T22:02:06.851560+0000","last_undegraded":"2024-09-21T22:02:06.851560+0000","last_fullsized":"2024-09-21T22:02:06.851560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:15.734509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063171899999999999,"stat_sum":{"num_bytes":89519064,"num_objects":54,"num_object_clones":13,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":11,"num_read":10409,"num_read_kb":38341,"num_write":1610,"num_write_kb":13485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.744828+0000","last_change":"2024-09-21T22:00:54.156721+0000","last_active":"2024-09-21T22:02:05.744828+0000","last_peered":"2024-09-21T22:02:05.744828+0000","last_clean":"2024-09-21T22:02:05.744828+0000","last_became_active":"2024-09-21T22:00:54.156336+0000","last_became_peered":"2024-09-21T22:00:54.156336+0000","last_unstale":"2024-09-21T22:02:05.744828+0000","last_undegraded":"2024-09-21T22:02:05.744828+0000","last_fullsized":"2024-09-21T22:02:05.744828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:54:12.268488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"90'470","reported_seq":2757,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.856473+0000","last_change":"2024-09-21T22:02:06.767618+0000","last_active":"2024-09-21T22:02:06.856473+0000","last_peered":"2024-09-21T22:02:06.856473+0000","last_clean":"2024-09-21T22:02:06.856473+0000","last_became_active":"2024-09-21T22:02:02.725129+0000","last_became_peered":"2024-09-21T22:02:02.725129+0000","last_unstale":"2024-09-21T22:02:06.856473+0000","last_undegraded":"2024-09-21T22:02:06.856473+0000","last_fullsized":"2024-09-21T22:02:06.856473+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:28.324390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015928008,"stat_sum":{"num_bytes":61805170,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":15,"num_read":3529,"num_read_kb":19955,"num_write":624,"num_write_kb":14122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":5422902,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.3","version":"90'375","reported_seq":2139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.868063+0000","last_change":"2024-09-21T22:02:06.768748+0000","last_active":"2024-09-21T22:02:06.868063+0000","last_peered":"2024-09-21T22:02:06.868063+0000","last_clean":"2024-09-21T22:02:06.868063+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:02:06.868063+0000","last_undegraded":"2024-09-21T22:02:06.868063+0000","last_fullsized":"2024-09-21T22:02:06.868063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:29:54.719071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0071862549999999999,"stat_sum":{"num_bytes":62265560,"num_objects":59,"num_object_clones":12,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":12,"num_read":2488,"num_read_kb":18407,"num_write":444,"num_write_kb":12381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.2","version":"21'2","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.764677+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:02:06.764677+0000","last_peered":"2024-09-21T22:02:06.764677+0000","last_clean":"2024-09-21T22:02:06.764677+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:02:06.764677+0000","last_undegraded":"2024-09-21T22:02:06.764677+0000","last_fullsized":"2024-09-21T22:02:06.764677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"89'331","reported_seq":2163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.759951+0000","last_change":"2024-09-21T22:02:06.760228+0000","last_active":"2024-09-21T22:02:06.759951+0000","last_peered":"2024-09-21T22:02:06.759951+0000","last_clean":"2024-09-21T22:02:06.759951+0000","last_became_active":"2024-09-21T22:00:54.156923+0000","last_became_peered":"2024-09-21T22:00:54.156923+0000","last_unstale":"2024-09-21T22:02:06.759951+0000","last_undegraded":"2024-09-21T22:02:06.759951+0000","last_fullsized":"2024-09-21T22:02:06.759951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:35:59.811876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089282999999999995,"stat_sum":{"num_bytes":69882717,"num_objects":52,"num_object_clones":12,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":13,"num_read":2506,"num_read_kb":15791,"num_write":312,"num_write_kb":10215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.759066+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:02:06.759066+0000","last_peered":"2024-09-21T22:02:06.759066+0000","last_clean":"2024-09-21T22:02:06.759066+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:02:06.759066+0000","last_undegraded":"2024-09-21T22:02:06.759066+0000","last_fullsized":"2024-09-21T22:02:06.759066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"87'188","reported_seq":1318,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.744985+0000","last_change":"2024-09-21T22:02:05.745563+0000","last_active":"2024-09-21T22:02:05.744985+0000","last_peered":"2024-09-21T22:02:05.744985+0000","last_clean":"2024-09-21T22:02:05.744985+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:02:05.744985+0000","last_undegraded":"2024-09-21T22:02:05.744985+0000","last_fullsized":"2024-09-21T22:02:05.744985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:40.230570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099863899999999995,"stat_sum":{"num_bytes":29883282,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":1010,"num_read_kb":21081,"num_write":186,"num_write_kb":9611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.768435+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:02:06.768435+0000","last_peered":"2024-09-21T22:02:06.768435+0000","last_clean":"2024-09-21T22:02:06.768435+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:02:06.768435+0000","last_undegraded":"2024-09-21T22:02:06.768435+0000","last_fullsized":"2024-09-21T22:02:06.768435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'408","reported_seq":2058,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.837956+0000","last_change":"2024-09-21T22:02:06.767238+0000","last_active":"2024-09-21T22:02:06.837956+0000","last_peered":"2024-09-21T22:02:06.837956+0000","last_clean":"2024-09-21T22:02:06.837956+0000","last_became_active":"2024-09-21T22:00:54.157660+0000","last_became_peered":"2024-09-21T22:00:54.157660+0000","last_unstale":"2024-09-21T22:02:06.837956+0000","last_undegraded":"2024-09-21T22:02:06.837956+0000","last_fullsized":"2024-09-21T22:02:06.837956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:35:34.095173+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.015672193000000001,"stat_sum":{"num_bytes":70655250,"num_objects":61,"num_object_clones":12,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":14,"num_read":3239,"num_read_kb":17319,"num_write":365,"num_write_kb":10961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.3","version":"19'1","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.764674+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:02:06.764674+0000","last_peered":"2024-09-21T22:02:06.764674+0000","last_clean":"2024-09-21T22:02:06.764674+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:02:06.764674+0000","last_undegraded":"2024-09-21T22:02:06.764674+0000","last_fullsized":"2024-09-21T22:02:06.764674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":308,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.768538+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:02:06.768538+0000","last_peered":"2024-09-21T22:02:06.768538+0000","last_clean":"2024-09-21T22:02:06.768538+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:02:06.768538+0000","last_undegraded":"2024-09-21T22:02:06.768538+0000","last_fullsized":"2024-09-21T22:02:06.768538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"90'534","reported_seq":6602,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.764923+0000","last_change":"2024-09-21T22:02:06.765237+0000","last_active":"2024-09-21T22:02:06.764923+0000","last_peered":"2024-09-21T22:02:06.764923+0000","last_clean":"2024-09-21T22:02:06.764923+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:02:06.764923+0000","last_undegraded":"2024-09-21T22:02:06.764923+0000","last_fullsized":"2024-09-21T22:02:06.764923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:28.919994+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013680345999999999,"stat_sum":{"num_bytes":105956929,"num_objects":78,"num_object_clones":22,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":23,"num_read":8102,"num_read_kb":26275,"num_write":627,"num_write_kb":11535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.9","version":"90'433","reported_seq":3383,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.768110+0000","last_change":"2024-09-21T22:02:06.768110+0000","last_active":"2024-09-21T22:02:06.768110+0000","last_peered":"2024-09-21T22:02:06.768110+0000","last_clean":"2024-09-21T22:02:06.768110+0000","last_became_active":"2024-09-21T22:00:54.160321+0000","last_became_peered":"2024-09-21T22:00:54.160321+0000","last_unstale":"2024-09-21T22:02:06.768110+0000","last_undegraded":"2024-09-21T22:02:06.768110+0000","last_fullsized":"2024-09-21T22:02:06.768110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:49.116225+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0066110989999999996,"stat_sum":{"num_bytes":51930704,"num_objects":68,"num_object_clones":17,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":10,"num_read":4921,"num_read_kb":33132,"num_write":475,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.a","version":"90'422","reported_seq":1500,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.897205+0000","last_change":"2024-09-21T22:02:06.774343+0000","last_active":"2024-09-21T22:02:06.897205+0000","last_peered":"2024-09-21T22:02:06.897205+0000","last_clean":"2024-09-21T22:02:06.897205+0000","last_became_active":"2024-09-21T22:01:39.894341+0000","last_became_peered":"2024-09-21T22:01:39.894341+0000","last_unstale":"2024-09-21T22:02:06.897205+0000","last_undegraded":"2024-09-21T22:02:06.897205+0000","last_fullsized":"2024-09-21T22:02:06.897205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:09:18.452951+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.012800819,"stat_sum":{"num_bytes":88363283,"num_objects":61,"num_object_clones":13,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":18,"num_read":2687,"num_read_kb":9117,"num_write":443,"num_write_kb":9054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.b","version":"90'265","reported_seq":1482,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.838900+0000","last_change":"2024-09-21T22:02:06.762210+0000","last_active":"2024-09-21T22:02:06.838900+0000","last_peered":"2024-09-21T22:02:06.838900+0000","last_clean":"2024-09-21T22:02:06.838900+0000","last_became_active":"2024-09-21T22:00:54.156515+0000","last_became_peered":"2024-09-21T22:00:54.156515+0000","last_unstale":"2024-09-21T22:02:06.838900+0000","last_undegraded":"2024-09-21T22:02:06.838900+0000","last_fullsized":"2024-09-21T22:02:06.838900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:24.652619+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.010871844,"stat_sum":{"num_bytes":78192493,"num_objects":63,"num_object_clones":13,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":12,"num_read":1238,"num_read_kb":20187,"num_write":297,"num_write_kb":15448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.c","version":"90'733","reported_seq":2907,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.895607+0000","last_change":"2024-09-21T22:02:06.774237+0000","last_active":"2024-09-21T22:02:06.895607+0000","last_peered":"2024-09-21T22:02:06.895607+0000","last_clean":"2024-09-21T22:02:06.895607+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:02:06.895607+0000","last_undegraded":"2024-09-21T22:02:06.895607+0000","last_fullsized":"2024-09-21T22:02:06.895607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:33:11.084906+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0092747669999999997,"stat_sum":{"num_bytes":60551464,"num_objects":73,"num_object_clones":22,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":16,"num_read":4414,"num_read_kb":24825,"num_write":979,"num_write_kb":15139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.d","version":"90'253","reported_seq":4150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.897717+0000","last_change":"2024-09-21T22:02:06.785855+0000","last_active":"2024-09-21T22:02:06.897717+0000","last_peered":"2024-09-21T22:02:06.897717+0000","last_clean":"2024-09-21T22:02:06.897717+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:02:06.897717+0000","last_undegraded":"2024-09-21T22:02:06.897717+0000","last_fullsized":"2024-09-21T22:02:06.897717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:07:25.767186+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.016679770999999999,"stat_sum":{"num_bytes":82859469,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":10,"num_read":4300,"num_read_kb":19221,"num_write":233,"num_write_kb":6588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.e","version":"90'692","reported_seq":2274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.774509+0000","last_change":"2024-09-21T22:02:06.774883+0000","last_active":"2024-09-21T22:02:06.774509+0000","last_peered":"2024-09-21T22:02:06.774509+0000","last_clean":"2024-09-21T22:02:06.774509+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:02:06.774509+0000","last_undegraded":"2024-09-21T22:02:06.774509+0000","last_fullsized":"2024-09-21T22:02:06.774509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:18:08.252800+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0061771550000000001,"stat_sum":{"num_bytes":34694923,"num_objects":44,"num_object_clones":7,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":8,"num_read":4436,"num_read_kb":15511,"num_write":1065,"num_write_kb":6695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.f","version":"90'796","reported_seq":2268,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.848805+0000","last_change":"2024-09-21T22:02:06.782759+0000","last_active":"2024-09-21T22:02:06.848805+0000","last_peered":"2024-09-21T22:02:06.848805+0000","last_clean":"2024-09-21T22:02:06.848805+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:02:06.848805+0000","last_undegraded":"2024-09-21T22:02:06.848805+0000","last_fullsized":"2024-09-21T22:02:06.848805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:49:10.707756+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013741755,"stat_sum":{"num_bytes":102746191,"num_objects":73,"num_object_clones":16,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":10,"num_read":3923,"num_read_kb":17596,"num_write":1124,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.10","version":"88'249","reported_seq":988,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.744459+0000","last_change":"2024-09-21T22:02:05.744910+0000","last_active":"2024-09-21T22:02:05.744459+0000","last_peered":"2024-09-21T22:02:05.744459+0000","last_clean":"2024-09-21T22:02:05.744459+0000","last_became_active":"2024-09-21T22:01:39.894085+0000","last_became_peered":"2024-09-21T22:01:39.894085+0000","last_unstale":"2024-09-21T22:02:05.744459+0000","last_undegraded":"2024-09-21T22:02:05.744459+0000","last_fullsized":"2024-09-21T22:02:05.744459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:01:35.995139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061628699999999998,"stat_sum":{"num_bytes":36666252,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":18,"num_read":776,"num_read_kb":16086,"num_write":249,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"3.11","version":"90'662","reported_seq":3053,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.844974+0000","last_change":"2024-09-21T22:02:06.779909+0000","last_active":"2024-09-21T22:02:06.844974+0000","last_peered":"2024-09-21T22:02:06.844974+0000","last_clean":"2024-09-21T22:02:06.844974+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:02:06.844974+0000","last_undegraded":"2024-09-21T22:02:06.844974+0000","last_fullsized":"2024-09-21T22:02:06.844974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:11.121492+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.011361131,"stat_sum":{"num_bytes":60608321,"num_objects":61,"num_object_clones":18,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":15,"num_read":4532,"num_read_kb":48069,"num_write":967,"num_write_kb":22089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.12","version":"87'384","reported_seq":1850,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.745936+0000","last_change":"2024-09-21T22:02:05.746372+0000","last_active":"2024-09-21T22:02:05.745936+0000","last_peered":"2024-09-21T22:02:05.745936+0000","last_clean":"2024-09-21T22:02:05.745936+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:02:05.745936+0000","last_undegraded":"2024-09-21T22:02:05.745936+0000","last_fullsized":"2024-09-21T22:02:05.745936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:35:15.448385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001306768,"stat_sum":{"num_bytes":35848444,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":12,"num_read":2448,"num_read_kb":25773,"num_write":487,"num_write_kb":11309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"3.13","version":"90'269","reported_seq":2493,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.839283+0000","last_change":"2024-09-21T22:02:06.782409+0000","last_active":"2024-09-21T22:02:06.839283+0000","last_peered":"2024-09-21T22:02:06.839283+0000","last_clean":"2024-09-21T22:02:06.839283+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:02:06.839283+0000","last_undegraded":"2024-09-21T22:02:06.839283+0000","last_fullsized":"2024-09-21T22:02:06.839283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:53.821708+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013625099,"stat_sum":{"num_bytes":59001697,"num_objects":65,"num_object_clones":23,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":19,"num_read":2433,"num_read_kb":34652,"num_write":250,"num_write_kb":13161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2006667739,"num_objects":1936,"num_object_clones":495,"num_object_copies":3872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1936,"num_whiteouts":450,"num_read":129386,"num_read_kb":751863,"num_write":18884,"num_write_kb":435536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":324,"num_bytes_recovered":30603674,"num_keys_recovered":83,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67620864,"data_stored":740258739,"data_compressed":24268409,"data_compressed_allocated":57065472,"data_compressed_original":734165392,"omap_allocated":0,"internal_metadata":0},"log_size":15171,"ondisk_log_size":15171,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56012,"kb_used_data":10824,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315828,"statfs":{"total":96636764160,"available":96579407872,"internally_reserved":0,"allocated":11083776,"data_stored":103656059,"data_compressed":3923980,"data_compressed_allocated":8482816,"data_compressed_original":102254559,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":0,"seq":60129542166,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37176,"kb_used_data":10148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334664,"statfs":{"total":96636764160,"available":96598695936,"internally_reserved":0,"allocated":10391552,"data_stored":109070760,"data_compressed":2868327,"data_compressed_allocated":7987200,"data_compressed_original":107822719,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86808,"kb_used_data":15220,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94285032,"statfs":{"total":96636764160,"available":96547872768,"internally_reserved":0,"allocated":15585280,"data_stored":157614892,"data_compressed":5253501,"data_compressed_allocated":12410880,"data_compressed_original":155893217,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55180,"kb_used_data":10104,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94316660,"statfs":{"total":96636764160,"available":96580259840,"internally_reserved":0,"allocated":10346496,"data_stored":97539101,"data_compressed":3354141,"data_compressed_allocated":7696384,"data_compressed_original":96155667,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45792,"kb_used_data":6280,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326048,"statfs":{"total":96636764160,"available":96589873152,"internally_reserved":0,"allocated":6430720,"data_stored":59633426,"data_compressed":2217580,"data_compressed_allocated":4456448,"data_compressed_original":58617481,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53036,"kb_used_data":7912,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318804,"statfs":{"total":96636764160,"available":96582455296,"internally_reserved":0,"allocated":8101888,"data_stored":69477188,"data_compressed":2896246,"data_compressed_allocated":5754880,"data_compressed_original":68266288,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51780,"kb_used_data":12268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94320060,"statfs":{"total":96636764160,"available":96583741440,"internally_reserved":0,"allocated":12562432,"data_stored":139149628,"data_compressed":3797910,"data_compressed_allocated":9940992,"data_compressed_original":137702856,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11411456,"data_stored":137414609,"data_compressed":3770015,"data_compressed_allocated":9850880,"data_compressed_original":136467845,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6787072,"data_stored":67247992,"data_compressed":2765439,"data_compressed_allocated":5521408,"data_compressed_original":66537776,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":58551596,"data_compressed":2185902,"data_compressed_allocated":4390912,"data_compressed_original":58027657,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9285632,"data_stored":97047144,"data_compressed":3354141,"data_compressed_allocated":7696384,"data_compressed_original":96155667,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14200832,"data_stored":155753143,"data_compressed":5056625,"data_compressed_allocated":12132352,"data_compressed_original":154545633,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9162752,"data_stored":107453507,"data_compressed":2784412,"data_compressed_allocated":7835648,"data_compressed_original":106700415,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1712128,"data_stored":15477582,"data_compressed":532173,"data_compressed_allocated":1368064,"data_compressed_original":15298560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9760768,"data_stored":101313166,"data_compressed":3819702,"data_compressed_allocated":8269824,"data_compressed_original":100431839,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:02:11.140 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:02:11.179 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:11.178+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:11.204 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:11.204 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:11.213 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:11.273 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:11.272+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:11.315 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:11.316 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:11.324 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:11.374 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:11.373+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:11.427 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:11.427 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:11.437 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:11.452 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:02:11.452 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:02:11.464 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-21T22:02:11.017761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2007258126,"num_objects":1940,"num_object_clones":495,"num_object_copies":3880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1940,"num_whiteouts":450,"num_read":129502,"num_read_kb":751963,"num_write":19045,"num_write_kb":437954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":324,"num_bytes_recovered":30603674,"num_keys_recovered":83,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15291,"ondisk_log_size":15291,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":385784,"kb_used_data":72756,"kb_used_omap":10,"kb_used_meta":312565,"kb_avail":660217096,"statfs":{"total":676457349120,"available":676062306304,"internally_reserved":0,"allocated":74502144,"data_stored":736141054,"data_compressed":24311685,"data_compressed_allocated":56729600,"data_compressed_original":726712787,"omap_allocated":11156,"internal_metadata":320066668},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-54500383,"num_objects":-77,"num_object_clones":-24,"num_object_copies":-154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-77,"num_whiteouts":-21,"num_read":5608,"num_read_kb":24478,"num_write":875,"num_write_kb":5578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000633"},"pg_stats":[{"pgid":"3.1f","version":"89'304","reported_seq":1831,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.749798+0000","last_change":"2024-09-21T22:02:05.749798+0000","last_active":"2024-09-21T22:02:05.749798+0000","last_peered":"2024-09-21T22:02:05.749798+0000","last_clean":"2024-09-21T22:02:05.749798+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:02:05.749798+0000","last_undegraded":"2024-09-21T22:02:05.749798+0000","last_fullsized":"2024-09-21T22:02:05.749798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:52:46.191208+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0027146890000000002,"stat_sum":{"num_bytes":27199142,"num_objects":58,"num_object_clones":13,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":13,"num_read":2574,"num_read_kb":17505,"num_write":339,"num_write_kb":16596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"3.1e","version":"90'537","reported_seq":2423,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.847777+0000","last_change":"2024-09-21T22:02:06.759274+0000","last_active":"2024-09-21T22:02:06.847777+0000","last_peered":"2024-09-21T22:02:06.847777+0000","last_clean":"2024-09-21T22:02:06.847777+0000","last_became_active":"2024-09-21T22:01:39.893876+0000","last_became_peered":"2024-09-21T22:01:39.893876+0000","last_unstale":"2024-09-21T22:02:06.847777+0000","last_undegraded":"2024-09-21T22:02:06.847777+0000","last_fullsized":"2024-09-21T22:02:06.847777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:36.869191+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0079387429999999998,"stat_sum":{"num_bytes":68620390,"num_objects":64,"num_object_clones":15,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":13,"num_read":3373,"num_read_kb":17563,"num_write":727,"num_write_kb":7987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":4275862,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.1d","version":"90'1092","reported_seq":3701,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.768716+0000","last_change":"2024-09-21T22:02:06.768716+0000","last_active":"2024-09-21T22:02:06.768716+0000","last_peered":"2024-09-21T22:02:06.768716+0000","last_clean":"2024-09-21T22:02:06.768716+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:02:06.768716+0000","last_undegraded":"2024-09-21T22:02:06.768716+0000","last_fullsized":"2024-09-21T22:02:06.768716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1092,"log_dups_size":0,"ondisk_log_size":1092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:26:07.599295+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.003792798,"stat_sum":{"num_bytes":46330109,"num_objects":70,"num_object_clones":20,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":19,"num_read":8364,"num_read_kb":25271,"num_write":1443,"num_write_kb":17099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.1c","version":"90'408","reported_seq":5647,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.850211+0000","last_change":"2024-09-21T22:02:06.766352+0000","last_active":"2024-09-21T22:02:06.850211+0000","last_peered":"2024-09-21T22:02:06.850211+0000","last_clean":"2024-09-21T22:02:06.850211+0000","last_became_active":"2024-09-21T22:00:54.161171+0000","last_became_peered":"2024-09-21T22:00:54.161171+0000","last_unstale":"2024-09-21T22:02:06.850211+0000","last_undegraded":"2024-09-21T22:02:06.850211+0000","last_fullsized":"2024-09-21T22:02:06.850211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:32:51.758215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013824169999999999,"stat_sum":{"num_bytes":85098802,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":12,"num_read":5806,"num_read_kb":34295,"num_write":488,"num_write_kb":23356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.1b","version":"87'366","reported_seq":2066,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.746416+0000","last_change":"2024-09-21T22:02:05.746903+0000","last_active":"2024-09-21T22:02:05.746416+0000","last_peered":"2024-09-21T22:02:05.746416+0000","last_clean":"2024-09-21T22:02:05.746416+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:02:05.746416+0000","last_undegraded":"2024-09-21T22:02:05.746416+0000","last_fullsized":"2024-09-21T22:02:05.746416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:02:07.601474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010711989999999999,"stat_sum":{"num_bytes":43759513,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":2352,"num_read_kb":22169,"num_write":486,"num_write_kb":15124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"3.1a","version":"90'633","reported_seq":4832,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.883694+0000","last_change":"2024-09-21T22:02:06.762082+0000","last_active":"2024-09-21T22:02:06.883694+0000","last_peered":"2024-09-21T22:02:06.883694+0000","last_clean":"2024-09-21T22:02:06.883694+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:02:06.883694+0000","last_undegraded":"2024-09-21T22:02:06.883694+0000","last_fullsized":"2024-09-21T22:02:06.883694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:57:07.349184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067288199999999997,"stat_sum":{"num_bytes":35534008,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":14,"num_read":7866,"num_read_kb":13869,"num_write":859,"num_write_kb":7251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.19","version":"90'628","reported_seq":4826,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.842857+0000","last_change":"2024-09-21T22:02:06.752763+0000","last_active":"2024-09-21T22:02:06.842857+0000","last_peered":"2024-09-21T22:02:06.842857+0000","last_clean":"2024-09-21T22:02:06.842857+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:02:06.842857+0000","last_undegraded":"2024-09-21T22:02:06.842857+0000","last_fullsized":"2024-09-21T22:02:06.842857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:41:53.585242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001685045,"stat_sum":{"num_bytes":71892343,"num_objects":66,"num_object_clones":16,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":16,"num_read":6244,"num_read_kb":21149,"num_write":847,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.18","version":"90'321","reported_seq":2802,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.843714+0000","last_change":"2024-09-21T22:02:06.754463+0000","last_active":"2024-09-21T22:02:06.843714+0000","last_peered":"2024-09-21T22:02:06.843714+0000","last_clean":"2024-09-21T22:02:06.843714+0000","last_became_active":"2024-09-21T22:00:54.155140+0000","last_became_peered":"2024-09-21T22:00:54.155140+0000","last_unstale":"2024-09-21T22:02:06.843714+0000","last_undegraded":"2024-09-21T22:02:06.843714+0000","last_fullsized":"2024-09-21T22:02:06.843714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:33:38.469083+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0032279790000000002,"stat_sum":{"num_bytes":81281286,"num_objects":64,"num_object_clones":17,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":14,"num_read":3031,"num_read_kb":25023,"num_write":311,"num_write_kb":14558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.17","version":"87'350","reported_seq":2938,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.748410+0000","last_change":"2024-09-21T22:02:05.748988+0000","last_active":"2024-09-21T22:02:05.748410+0000","last_peered":"2024-09-21T22:02:05.748410+0000","last_clean":"2024-09-21T22:02:05.748410+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:02:05.748410+0000","last_undegraded":"2024-09-21T22:02:05.748410+0000","last_fullsized":"2024-09-21T22:02:05.748410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:47:22.178572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001633928,"stat_sum":{"num_bytes":41354720,"num_objects":74,"num_object_clones":18,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":17,"num_read":4269,"num_read_kb":36537,"num_write":347,"num_write_kb":23149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"3.16","version":"90'445","reported_seq":4953,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.839308+0000","last_change":"2024-09-21T22:02:06.765644+0000","last_active":"2024-09-21T22:02:06.839308+0000","last_peered":"2024-09-21T22:02:06.839308+0000","last_clean":"2024-09-21T22:02:06.839308+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:02:06.839308+0000","last_undegraded":"2024-09-21T22:02:06.839308+0000","last_fullsized":"2024-09-21T22:02:06.839308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:48:00.140634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076438400000000001,"stat_sum":{"num_bytes":77670522,"num_objects":68,"num_object_clones":20,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":18,"num_read":5377,"num_read_kb":30480,"num_write":530,"num_write_kb":12130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.15","version":"90'306","reported_seq":1892,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.786013+0000","last_change":"2024-09-21T22:02:06.786013+0000","last_active":"2024-09-21T22:02:06.786013+0000","last_peered":"2024-09-21T22:02:06.786013+0000","last_clean":"2024-09-21T22:02:06.786013+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:02:06.786013+0000","last_undegraded":"2024-09-21T22:02:06.786013+0000","last_fullsized":"2024-09-21T22:02:06.786013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:57:25.679448+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.016751076,"stat_sum":{"num_bytes":71213278,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":13,"num_read":2180,"num_read_kb":16266,"num_write":368,"num_write_kb":14123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.14","version":"90'384","reported_seq":2451,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.773951+0000","last_change":"2024-09-21T22:02:06.774616+0000","last_active":"2024-09-21T22:02:06.773951+0000","last_peered":"2024-09-21T22:02:06.773951+0000","last_clean":"2024-09-21T22:02:06.773951+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:02:06.773951+0000","last_undegraded":"2024-09-21T22:02:06.773951+0000","last_fullsized":"2024-09-21T22:02:06.773951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:39.071579+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013024259,"stat_sum":{"num_bytes":69152345,"num_objects":64,"num_object_clones":19,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":17,"num_read":3069,"num_read_kb":22646,"num_write":416,"num_write_kb":9973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.769065+0000","last_change":"2024-09-21T22:01:36.874875+0000","last_active":"2024-09-21T22:02:06.769065+0000","last_peered":"2024-09-21T22:02:06.769065+0000","last_clean":"2024-09-21T22:02:06.769065+0000","last_became_active":"2024-09-21T22:01:36.874561+0000","last_became_peered":"2024-09-21T22:01:36.874561+0000","last_unstale":"2024-09-21T22:02:06.769065+0000","last_undegraded":"2024-09-21T22:02:06.769065+0000","last_fullsized":"2024-09-21T22:02:06.769065+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:00:04.279405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"89'509","reported_seq":3150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.873981+0000","last_change":"2024-09-21T22:02:05.746938+0000","last_active":"2024-09-21T22:02:05.873981+0000","last_peered":"2024-09-21T22:02:05.873981+0000","last_clean":"2024-09-21T22:02:05.873981+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:02:05.873981+0000","last_undegraded":"2024-09-21T22:02:05.873981+0000","last_fullsized":"2024-09-21T22:02:05.873981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:50.510758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053940100000000001,"stat_sum":{"num_bytes":83204057,"num_objects":64,"num_object_clones":17,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":13,"num_read":4424,"num_read_kb":29970,"num_write":674,"num_write_kb":21378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.761423+0000","last_change":"2024-09-21T22:01:36.878078+0000","last_active":"2024-09-21T22:02:06.761423+0000","last_peered":"2024-09-21T22:02:06.761423+0000","last_clean":"2024-09-21T22:02:06.761423+0000","last_became_active":"2024-09-21T22:01:36.877817+0000","last_became_peered":"2024-09-21T22:01:36.877817+0000","last_unstale":"2024-09-21T22:02:06.761423+0000","last_undegraded":"2024-09-21T22:02:06.761423+0000","last_fullsized":"2024-09-21T22:02:06.761423+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:28:22.652563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"90'326","reported_seq":2203,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.871089+0000","last_change":"2024-09-21T22:02:06.769976+0000","last_active":"2024-09-21T22:02:06.871089+0000","last_peered":"2024-09-21T22:02:06.871089+0000","last_clean":"2024-09-21T22:02:06.871089+0000","last_became_active":"2024-09-21T22:00:54.162377+0000","last_became_peered":"2024-09-21T22:00:54.162377+0000","last_unstale":"2024-09-21T22:02:06.871089+0000","last_undegraded":"2024-09-21T22:02:06.871089+0000","last_fullsized":"2024-09-21T22:02:06.871089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:24:38.158101+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.018342181999999999,"stat_sum":{"num_bytes":22926011,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":3066,"num_read_kb":17782,"num_write":312,"num_write_kb":12028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.769349+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:02:06.769349+0000","last_peered":"2024-09-21T22:02:06.769349+0000","last_clean":"2024-09-21T22:02:06.769349+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:02:06.769349+0000","last_undegraded":"2024-09-21T22:02:06.769349+0000","last_fullsized":"2024-09-21T22:02:06.769349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"90'1098","reported_seq":5875,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.851560+0000","last_change":"2024-09-21T22:02:06.759727+0000","last_active":"2024-09-21T22:02:06.851560+0000","last_peered":"2024-09-21T22:02:06.851560+0000","last_clean":"2024-09-21T22:02:06.851560+0000","last_became_active":"2024-09-21T22:00:54.158128+0000","last_became_peered":"2024-09-21T22:00:54.158128+0000","last_unstale":"2024-09-21T22:02:06.851560+0000","last_undegraded":"2024-09-21T22:02:06.851560+0000","last_fullsized":"2024-09-21T22:02:06.851560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:04:15.734509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063171899999999999,"stat_sum":{"num_bytes":89519064,"num_objects":54,"num_object_clones":13,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":11,"num_read":10409,"num_read_kb":38341,"num_write":1610,"num_write_kb":13485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.744828+0000","last_change":"2024-09-21T22:00:54.156721+0000","last_active":"2024-09-21T22:02:05.744828+0000","last_peered":"2024-09-21T22:02:05.744828+0000","last_clean":"2024-09-21T22:02:05.744828+0000","last_became_active":"2024-09-21T22:00:54.156336+0000","last_became_peered":"2024-09-21T22:00:54.156336+0000","last_unstale":"2024-09-21T22:02:05.744828+0000","last_undegraded":"2024-09-21T22:02:05.744828+0000","last_fullsized":"2024-09-21T22:02:05.744828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:54:12.268488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"90'470","reported_seq":2757,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.856473+0000","last_change":"2024-09-21T22:02:06.767618+0000","last_active":"2024-09-21T22:02:06.856473+0000","last_peered":"2024-09-21T22:02:06.856473+0000","last_clean":"2024-09-21T22:02:06.856473+0000","last_became_active":"2024-09-21T22:02:02.725129+0000","last_became_peered":"2024-09-21T22:02:02.725129+0000","last_unstale":"2024-09-21T22:02:06.856473+0000","last_undegraded":"2024-09-21T22:02:06.856473+0000","last_fullsized":"2024-09-21T22:02:06.856473+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:28.324390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015928008,"stat_sum":{"num_bytes":61805170,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":15,"num_read":3529,"num_read_kb":19955,"num_write":624,"num_write_kb":14122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":5422902,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.3","version":"90'375","reported_seq":2139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.868063+0000","last_change":"2024-09-21T22:02:06.768748+0000","last_active":"2024-09-21T22:02:06.868063+0000","last_peered":"2024-09-21T22:02:06.868063+0000","last_clean":"2024-09-21T22:02:06.868063+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:02:06.868063+0000","last_undegraded":"2024-09-21T22:02:06.868063+0000","last_fullsized":"2024-09-21T22:02:06.868063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:29:54.719071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0071862549999999999,"stat_sum":{"num_bytes":62265560,"num_objects":59,"num_object_clones":12,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":12,"num_read":2488,"num_read_kb":18407,"num_write":444,"num_write_kb":12381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.2","version":"21'2","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.764677+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:02:06.764677+0000","last_peered":"2024-09-21T22:02:06.764677+0000","last_clean":"2024-09-21T22:02:06.764677+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:02:06.764677+0000","last_undegraded":"2024-09-21T22:02:06.764677+0000","last_fullsized":"2024-09-21T22:02:06.764677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"89'331","reported_seq":2163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.759951+0000","last_change":"2024-09-21T22:02:06.760228+0000","last_active":"2024-09-21T22:02:06.759951+0000","last_peered":"2024-09-21T22:02:06.759951+0000","last_clean":"2024-09-21T22:02:06.759951+0000","last_became_active":"2024-09-21T22:00:54.156923+0000","last_became_peered":"2024-09-21T22:00:54.156923+0000","last_unstale":"2024-09-21T22:02:06.759951+0000","last_undegraded":"2024-09-21T22:02:06.759951+0000","last_fullsized":"2024-09-21T22:02:06.759951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:35:59.811876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089282999999999995,"stat_sum":{"num_bytes":69882717,"num_objects":52,"num_object_clones":12,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":13,"num_read":2506,"num_read_kb":15791,"num_write":312,"num_write_kb":10215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.759066+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:02:06.759066+0000","last_peered":"2024-09-21T22:02:06.759066+0000","last_clean":"2024-09-21T22:02:06.759066+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:02:06.759066+0000","last_undegraded":"2024-09-21T22:02:06.759066+0000","last_fullsized":"2024-09-21T22:02:06.759066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"87'188","reported_seq":1318,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.744985+0000","last_change":"2024-09-21T22:02:05.745563+0000","last_active":"2024-09-21T22:02:05.744985+0000","last_peered":"2024-09-21T22:02:05.744985+0000","last_clean":"2024-09-21T22:02:05.744985+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:02:05.744985+0000","last_undegraded":"2024-09-21T22:02:05.744985+0000","last_fullsized":"2024-09-21T22:02:05.744985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:40.230570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099863899999999995,"stat_sum":{"num_bytes":29883282,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":1010,"num_read_kb":21081,"num_write":186,"num_write_kb":9611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.768435+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:02:06.768435+0000","last_peered":"2024-09-21T22:02:06.768435+0000","last_clean":"2024-09-21T22:02:06.768435+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:02:06.768435+0000","last_undegraded":"2024-09-21T22:02:06.768435+0000","last_fullsized":"2024-09-21T22:02:06.768435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'408","reported_seq":2058,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.837956+0000","last_change":"2024-09-21T22:02:06.767238+0000","last_active":"2024-09-21T22:02:06.837956+0000","last_peered":"2024-09-21T22:02:06.837956+0000","last_clean":"2024-09-21T22:02:06.837956+0000","last_became_active":"2024-09-21T22:00:54.157660+0000","last_became_peered":"2024-09-21T22:00:54.157660+0000","last_unstale":"2024-09-21T22:02:06.837956+0000","last_undegraded":"2024-09-21T22:02:06.837956+0000","last_fullsized":"2024-09-21T22:02:06.837956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:35:34.095173+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.015672193000000001,"stat_sum":{"num_bytes":70655250,"num_objects":61,"num_object_clones":12,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":14,"num_read":3239,"num_read_kb":17319,"num_write":365,"num_write_kb":10961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"2.3","version":"19'1","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.764674+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:02:06.764674+0000","last_peered":"2024-09-21T22:02:06.764674+0000","last_clean":"2024-09-21T22:02:06.764674+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:02:06.764674+0000","last_undegraded":"2024-09-21T22:02:06.764674+0000","last_fullsized":"2024-09-21T22:02:06.764674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":308,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.768538+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:02:06.768538+0000","last_peered":"2024-09-21T22:02:06.768538+0000","last_clean":"2024-09-21T22:02:06.768538+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:02:06.768538+0000","last_undegraded":"2024-09-21T22:02:06.768538+0000","last_fullsized":"2024-09-21T22:02:06.768538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"90'534","reported_seq":6602,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.764923+0000","last_change":"2024-09-21T22:02:06.765237+0000","last_active":"2024-09-21T22:02:06.764923+0000","last_peered":"2024-09-21T22:02:06.764923+0000","last_clean":"2024-09-21T22:02:06.764923+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:02:06.764923+0000","last_undegraded":"2024-09-21T22:02:06.764923+0000","last_fullsized":"2024-09-21T22:02:06.764923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:28.919994+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013680345999999999,"stat_sum":{"num_bytes":105956929,"num_objects":78,"num_object_clones":22,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":23,"num_read":8102,"num_read_kb":26275,"num_write":627,"num_write_kb":11535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.9","version":"90'433","reported_seq":3383,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.768110+0000","last_change":"2024-09-21T22:02:06.768110+0000","last_active":"2024-09-21T22:02:06.768110+0000","last_peered":"2024-09-21T22:02:06.768110+0000","last_clean":"2024-09-21T22:02:06.768110+0000","last_became_active":"2024-09-21T22:00:54.160321+0000","last_became_peered":"2024-09-21T22:00:54.160321+0000","last_unstale":"2024-09-21T22:02:06.768110+0000","last_undegraded":"2024-09-21T22:02:06.768110+0000","last_fullsized":"2024-09-21T22:02:06.768110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:49.116225+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0066110989999999996,"stat_sum":{"num_bytes":51930704,"num_objects":68,"num_object_clones":17,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":10,"num_read":4921,"num_read_kb":33132,"num_write":475,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.a","version":"90'422","reported_seq":1500,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.897205+0000","last_change":"2024-09-21T22:02:06.774343+0000","last_active":"2024-09-21T22:02:06.897205+0000","last_peered":"2024-09-21T22:02:06.897205+0000","last_clean":"2024-09-21T22:02:06.897205+0000","last_became_active":"2024-09-21T22:01:39.894341+0000","last_became_peered":"2024-09-21T22:01:39.894341+0000","last_unstale":"2024-09-21T22:02:06.897205+0000","last_undegraded":"2024-09-21T22:02:06.897205+0000","last_fullsized":"2024-09-21T22:02:06.897205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:09:18.452951+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.012800819,"stat_sum":{"num_bytes":88363283,"num_objects":61,"num_object_clones":13,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":18,"num_read":2687,"num_read_kb":9117,"num_write":443,"num_write_kb":9054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.b","version":"90'265","reported_seq":1482,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.838900+0000","last_change":"2024-09-21T22:02:06.762210+0000","last_active":"2024-09-21T22:02:06.838900+0000","last_peered":"2024-09-21T22:02:06.838900+0000","last_clean":"2024-09-21T22:02:06.838900+0000","last_became_active":"2024-09-21T22:00:54.156515+0000","last_became_peered":"2024-09-21T22:00:54.156515+0000","last_unstale":"2024-09-21T22:02:06.838900+0000","last_undegraded":"2024-09-21T22:02:06.838900+0000","last_fullsized":"2024-09-21T22:02:06.838900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:05:24.652619+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.010871844,"stat_sum":{"num_bytes":78192493,"num_objects":63,"num_object_clones":13,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":12,"num_read":1238,"num_read_kb":20187,"num_write":297,"num_write_kb":15448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.c","version":"90'733","reported_seq":2907,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.895607+0000","last_change":"2024-09-21T22:02:06.774237+0000","last_active":"2024-09-21T22:02:06.895607+0000","last_peered":"2024-09-21T22:02:06.895607+0000","last_clean":"2024-09-21T22:02:06.895607+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:02:06.895607+0000","last_undegraded":"2024-09-21T22:02:06.895607+0000","last_fullsized":"2024-09-21T22:02:06.895607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:33:11.084906+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0092747669999999997,"stat_sum":{"num_bytes":60551464,"num_objects":73,"num_object_clones":22,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":16,"num_read":4414,"num_read_kb":24825,"num_write":979,"num_write_kb":15139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.d","version":"90'253","reported_seq":4150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.897717+0000","last_change":"2024-09-21T22:02:06.785855+0000","last_active":"2024-09-21T22:02:06.897717+0000","last_peered":"2024-09-21T22:02:06.897717+0000","last_clean":"2024-09-21T22:02:06.897717+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:02:06.897717+0000","last_undegraded":"2024-09-21T22:02:06.897717+0000","last_fullsized":"2024-09-21T22:02:06.897717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:07:25.767186+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.016679770999999999,"stat_sum":{"num_bytes":82859469,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":10,"num_read":4300,"num_read_kb":19221,"num_write":233,"num_write_kb":6588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.e","version":"90'692","reported_seq":2274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.774509+0000","last_change":"2024-09-21T22:02:06.774883+0000","last_active":"2024-09-21T22:02:06.774509+0000","last_peered":"2024-09-21T22:02:06.774509+0000","last_clean":"2024-09-21T22:02:06.774509+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:02:06.774509+0000","last_undegraded":"2024-09-21T22:02:06.774509+0000","last_fullsized":"2024-09-21T22:02:06.774509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:18:08.252800+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0061771550000000001,"stat_sum":{"num_bytes":34694923,"num_objects":44,"num_object_clones":7,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":8,"num_read":4436,"num_read_kb":15511,"num_write":1065,"num_write_kb":6695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.f","version":"90'796","reported_seq":2268,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.848805+0000","last_change":"2024-09-21T22:02:06.782759+0000","last_active":"2024-09-21T22:02:06.848805+0000","last_peered":"2024-09-21T22:02:06.848805+0000","last_clean":"2024-09-21T22:02:06.848805+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:02:06.848805+0000","last_undegraded":"2024-09-21T22:02:06.848805+0000","last_fullsized":"2024-09-21T22:02:06.848805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:49:10.707756+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013741755,"stat_sum":{"num_bytes":102746191,"num_objects":73,"num_object_clones":16,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":10,"num_read":3923,"num_read_kb":17596,"num_write":1124,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.10","version":"88'249","reported_seq":988,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.744459+0000","last_change":"2024-09-21T22:02:05.744910+0000","last_active":"2024-09-21T22:02:05.744459+0000","last_peered":"2024-09-21T22:02:05.744459+0000","last_clean":"2024-09-21T22:02:05.744459+0000","last_became_active":"2024-09-21T22:01:39.894085+0000","last_became_peered":"2024-09-21T22:01:39.894085+0000","last_unstale":"2024-09-21T22:02:05.744459+0000","last_undegraded":"2024-09-21T22:02:05.744459+0000","last_fullsized":"2024-09-21T22:02:05.744459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:01:35.995139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061628699999999998,"stat_sum":{"num_bytes":36666252,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":18,"num_read":776,"num_read_kb":16086,"num_write":249,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"3.11","version":"90'662","reported_seq":3053,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.844974+0000","last_change":"2024-09-21T22:02:06.779909+0000","last_active":"2024-09-21T22:02:06.844974+0000","last_peered":"2024-09-21T22:02:06.844974+0000","last_clean":"2024-09-21T22:02:06.844974+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:02:06.844974+0000","last_undegraded":"2024-09-21T22:02:06.844974+0000","last_fullsized":"2024-09-21T22:02:06.844974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:11.121492+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.011361131,"stat_sum":{"num_bytes":60608321,"num_objects":61,"num_object_clones":18,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":15,"num_read":4532,"num_read_kb":48069,"num_write":967,"num_write_kb":22089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]},{"pgid":"3.12","version":"87'384","reported_seq":1850,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T22:02:05.745936+0000","last_change":"2024-09-21T22:02:05.746372+0000","last_active":"2024-09-21T22:02:05.745936+0000","last_peered":"2024-09-21T22:02:05.745936+0000","last_clean":"2024-09-21T22:02:05.745936+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:02:05.745936+0000","last_undegraded":"2024-09-21T22:02:05.745936+0000","last_fullsized":"2024-09-21T22:02:05.745936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:35:15.448385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001306768,"stat_sum":{"num_bytes":35848444,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":12,"num_read":2448,"num_read_kb":25773,"num_write":487,"num_write_kb":11309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2f","length":"1"}]},{"pgid":"3.13","version":"90'269","reported_seq":2493,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T22:02:06.839283+0000","last_change":"2024-09-21T22:02:06.782409+0000","last_active":"2024-09-21T22:02:06.839283+0000","last_peered":"2024-09-21T22:02:06.839283+0000","last_clean":"2024-09-21T22:02:06.839283+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:02:06.839283+0000","last_undegraded":"2024-09-21T22:02:06.839283+0000","last_fullsized":"2024-09-21T22:02:06.839283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:53.821708+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013625099,"stat_sum":{"num_bytes":59001697,"num_objects":65,"num_object_clones":23,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":19,"num_read":2433,"num_read_kb":34652,"num_write":250,"num_write_kb":13161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2e","length":"2"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2006667739,"num_objects":1936,"num_object_clones":495,"num_object_copies":3872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1936,"num_whiteouts":450,"num_read":129386,"num_read_kb":751863,"num_write":18884,"num_write_kb":435536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":324,"num_bytes_recovered":30603674,"num_keys_recovered":83,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67620864,"data_stored":740258739,"data_compressed":24268409,"data_compressed_allocated":57065472,"data_compressed_original":734165392,"omap_allocated":0,"internal_metadata":0},"log_size":15171,"ondisk_log_size":15171,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56012,"kb_used_data":10824,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315828,"statfs":{"total":96636764160,"available":96579407872,"internally_reserved":0,"allocated":11083776,"data_stored":103656059,"data_compressed":3923980,"data_compressed_allocated":8482816,"data_compressed_original":102254559,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":0,"seq":60129542166,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37176,"kb_used_data":10148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334664,"statfs":{"total":96636764160,"available":96598695936,"internally_reserved":0,"allocated":10391552,"data_stored":109070760,"data_compressed":2868327,"data_compressed_allocated":7987200,"data_compressed_original":107822719,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86808,"kb_used_data":15220,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94285032,"statfs":{"total":96636764160,"available":96547872768,"internally_reserved":0,"allocated":15585280,"data_stored":157614892,"data_compressed":5253501,"data_compressed_allocated":12410880,"data_compressed_original":155893217,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55180,"kb_used_data":10104,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94316660,"statfs":{"total":96636764160,"available":96580259840,"internally_reserved":0,"allocated":10346496,"data_stored":97539101,"data_compressed":3354141,"data_compressed_allocated":7696384,"data_compressed_original":96155667,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45792,"kb_used_data":6280,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326048,"statfs":{"total":96636764160,"available":96589873152,"internally_reserved":0,"allocated":6430720,"data_stored":59633426,"data_compressed":2217580,"data_compressed_allocated":4456448,"data_compressed_original":58617481,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53036,"kb_used_data":7912,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94318804,"statfs":{"total":96636764160,"available":96582455296,"internally_reserved":0,"allocated":8101888,"data_stored":69477188,"data_compressed":2896246,"data_compressed_allocated":5754880,"data_compressed_original":68266288,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51780,"kb_used_data":12268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94320060,"statfs":{"total":96636764160,"available":96583741440,"internally_reserved":0,"allocated":12562432,"data_stored":139149628,"data_compressed":3797910,"data_compressed_allocated":9940992,"data_compressed_original":137702856,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11411456,"data_stored":137414609,"data_compressed":3770015,"data_compressed_allocated":9850880,"data_compressed_original":136467845,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6787072,"data_stored":67247992,"data_compressed":2765439,"data_compressed_allocated":5521408,"data_compressed_original":66537776,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":58551596,"data_compressed":2185902,"data_compressed_allocated":4390912,"data_compressed_original":58027657,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9285632,"data_stored":97047144,"data_compressed":3354141,"data_compressed_allocated":7696384,"data_compressed_original":96155667,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14200832,"data_stored":155753143,"data_compressed":5056625,"data_compressed_allocated":12132352,"data_compressed_original":154545633,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9162752,"data_stored":107453507,"data_compressed":2784412,"data_compressed_allocated":7835648,"data_compressed_original":106700415,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1712128,"data_stored":15477582,"data_compressed":532173,"data_compressed_allocated":1368064,"data_compressed_original":15298560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9760768,"data_stored":101313166,"data_compressed":3819702,"data_compressed_allocated":8269824,"data_compressed_original":100431839,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:02:11.466 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T22:02:11.466 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:02:11.466 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-21T22:02:11.466 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:02:11.478 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:11.477+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:11.576 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:11.575+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:11.580 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:11.581 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:11.589 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:11.677 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:11.676+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:11.733 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:11.733 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:11.743 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:11.778 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:11.777+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:11.780 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:02:11.780 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:11.780 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 94, 2024-09-21T22:02:11.780 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "014f3ec5-afd0-4b18-9c74-de91f34d0760", 2024-09-21T22:02:11.780 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-09-21T22:00:24.916784+0000", 2024-09-21T22:02:11.780 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-09-21T22:02:10.765599+0000", 2024-09-21T22:02:11.780 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-09-21T22:00:36.060631+0000", 2024-09-21T22:02:11.780 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-09-21T22:01:35.858445+0000", 2024-09-21T22:02:11.780 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:02:11.780 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5804032, 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "nodeep-scrub", 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 5, 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-09-21T22:02:11.781 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 3, 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 8, 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "luminous", 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:37.034134+0000", 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-09-21T22:02:11.782 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:11.783 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.784 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "17", 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:11.785 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:11.786 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 8, 2024-09-21T22:02:11.788 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 8, 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.25, 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:42.753049+0000", 2024-09-21T22:02:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "21", 2024-09-21T22:02:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 2, 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 21, 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.9900000095367432, 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.9900000095367432, 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2.630000114440918, 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2.630000114440918, 2024-09-21T22:02:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "pool_client.0", 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:52.269263+0000", 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-09-21T22:02:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "94", 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 47, 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 94, 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:11.801 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.7400000095367432, 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.7400000095367432, 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:02:11.802 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "ebc4f0b9-33fc-4301-b1c0-ac843b19095b", 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 13, 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 66, 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6808", 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6809", 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6810", 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6811", 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6814", 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6815", 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6812", 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6813", 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6809/3559797623", 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6811/3559797623", 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6815/3559797623", 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6813/3559797623", 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:11.808 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "1c8f54fe-439f-486e-8b8b-fe892332ada3", 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 0.1484527587890625, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:11.809 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6824", 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6825", 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6826", 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6827", 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6830", 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6831", 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.812 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6828", 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6829", 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.813 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6825/428384344", 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6827/428384344", 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6831/428384344", 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6829/428384344", 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "b202159c-804c-4d22-9aa3-8f590dce8faa", 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:11.814 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6816", 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6817", 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6818", 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6819", 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6822", 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6823", 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6820", 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6821", 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6817/4237051748", 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6819/4237051748", 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6823/4237051748", 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6821/4237051748", 2024-09-21T22:02:11.819 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "28a8c407-a445-4c76-8d7c-d5a249d13e03", 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:11.820 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 85, 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6800", 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6801", 2024-09-21T22:02:11.821 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6802", 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6803", 2024-09-21T22:02:11.822 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6806", 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6807", 2024-09-21T22:02:11.823 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6804", 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6805", 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:11.824 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6801/3004236595", 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6803/3004236595", 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6807/3004236595", 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6805/3004236595", 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605", 2024-09-21T22:02:11.825 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 66, 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.826 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6824", 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6825", 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.827 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6826", 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6827", 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.828 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6830", 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6831", 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6828", 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6829", 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6825/743062291", 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6827/743062291", 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6831/743062291", 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6829/743062291", 2024-09-21T22:02:11.830 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7a0cc26e-a543-4647-bc53-fbecb69b2326", 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:11.831 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6808", 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6809", 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.832 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6810", 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6811", 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6814", 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6815", 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6812", 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6813", 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.835 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6809/2410886219", 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6811/2410886219", 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6815/2410886219", 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6813/2410886219", 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7768eeb7-c6d0-47d8-a400-c47a2154c590", 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 0, 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 0, 2024-09-21T22:02:11.836 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 48, 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6800", 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6801", 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6802", 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6803", 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6806", 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6807", 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6804", 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6805", 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6801/2491178498", 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6803/2491178498", 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6807/2491178498", 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6805/2491178498", 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "30ed992b-2e99-4523-9fdd-8389f75940af", 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 63, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:11.842 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6816", 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6817", 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6818", 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6819", 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.844 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6822", 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6823", 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:11.845 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6820", 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6821", 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6817/1580142875", 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6819/1580142875", 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6823/1580142875", 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6821/1580142875", 2024-09-21T22:02:11.846 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:11.847 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.652871+0000", 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.866866+0000", 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.848 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.859757+0000", 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:11.849 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:34.082180+0000", 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:11.850 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.844484+0000", 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.746321+0000", 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 65536, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.324821+0000", 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:11.852 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.093833+0000", 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [ 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: "pgid": "3.5", 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: 3, 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: 2 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-09-21T22:02:11.853 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [ 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.854 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: "snaps": [ 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: "begin": 42, 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: "length": 6 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [ 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: "snaps": [ 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: "begin": 42, 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: "length": 1 2024-09-21T22:02:11.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:11.856 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:11.858 INFO:tasks.thrashosds.thrasher:j is {'epoch': 94, 'fsid': '014f3ec5-afd0-4b18-9c74-de91f34d0760', 'created': '2024-09-21T22:00:24.916784+0000', 'modified': '2024-09-21T22:02:10.765599+0000', 'last_up_change': '2024-09-21T22:00:36.060631+0000', 'last_in_change': '2024-09-21T22:01:35.858445+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:00:37.034134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:00:42.753049+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:00:52.269263+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 47, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}], 'osds': [{'osd': 0, 'uuid': 'ebc4f0b9-33fc-4301-b1c0-ac843b19095b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6808', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6809', 'nonce': 3559797623}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6810', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6811', 'nonce': 3559797623}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6814', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6815', 'nonce': 3559797623}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6812', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6813', 'nonce': 3559797623}]}, 'public_addr': '172.21.15.102:6809/3559797623', 'cluster_addr': '172.21.15.102:6811/3559797623', 'heartbeat_back_addr': '172.21.15.102:6815/3559797623', 'heartbeat_front_addr': '172.21.15.102:6813/3559797623', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1c8f54fe-439f-486e-8b8b-fe892332ada3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1484527587890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6824', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6825', 'nonce': 428384344}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6826', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6827', 'nonce': 428384344}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6830', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6831', 'nonce': 428384344}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6828', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6829', 'nonce': 428384344}]}, 'public_addr': '172.21.15.102:6825/428384344', 'cluster_addr': '172.21.15.102:6827/428384344', 'heartbeat_back_addr': '172.21.15.102:6831/428384344', 'heartbeat_front_addr': '172.21.15.102:6829/428384344', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'b202159c-804c-4d22-9aa3-8f590dce8faa', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6816', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6817', 'nonce': 4237051748}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6818', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6819', 'nonce': 4237051748}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6822', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6823', 'nonce': 4237051748}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6820', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6821', 'nonce': 4237051748}]}, 'public_addr': '172.21.15.102:6817/4237051748', 'cluster_addr': '172.21.15.102:6819/4237051748', 'heartbeat_back_addr': '172.21.15.102:6823/4237051748', 'heartbeat_front_addr': '172.21.15.102:6821/4237051748', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '28a8c407-a445-4c76-8d7c-d5a249d13e03', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 85, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 3004236595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 3004236595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 3004236595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 3004236595}]}, 'public_addr': '172.21.15.102:6801/3004236595', 'cluster_addr': '172.21.15.102:6803/3004236595', 'heartbeat_back_addr': '172.21.15.102:6807/3004236595', 'heartbeat_front_addr': '172.21.15.102:6805/3004236595', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6824', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6825', 'nonce': 743062291}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6826', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6827', 'nonce': 743062291}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6830', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6831', 'nonce': 743062291}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6828', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6829', 'nonce': 743062291}]}, 'public_addr': '172.21.15.184:6825/743062291', 'cluster_addr': '172.21.15.184:6827/743062291', 'heartbeat_back_addr': '172.21.15.184:6831/743062291', 'heartbeat_front_addr': '172.21.15.184:6829/743062291', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '7a0cc26e-a543-4647-bc53-fbecb69b2326', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6808', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6809', 'nonce': 2410886219}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6810', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6811', 'nonce': 2410886219}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6814', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6815', 'nonce': 2410886219}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6812', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6813', 'nonce': 2410886219}]}, 'public_addr': '172.21.15.184:6809/2410886219', 'cluster_addr': '172.21.15.184:6811/2410886219', 'heartbeat_back_addr': '172.21.15.184:6815/2410886219', 'heartbeat_front_addr': '172.21.15.184:6813/2410886219', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '7768eeb7-c6d0-47d8-a400-c47a2154c590', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6800', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6801', 'nonce': 2491178498}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6802', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6803', 'nonce': 2491178498}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6806', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6807', 'nonce': 2491178498}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6804', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6805', 'nonce': 2491178498}]}, 'public_addr': '172.21.15.184:6801/2491178498', 'cluster_addr': '172.21.15.184:6803/2491178498', 'heartbeat_back_addr': '172.21.15.184:6807/2491178498', 'heartbeat_front_addr': '172.21.15.184:6805/2491178498', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '30ed992b-2e99-4523-9fdd-8389f75940af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6816', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6817', 'nonce': 1580142875}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6818', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6819', 'nonce': 1580142875}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6822', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6823', 'nonce': 1580142875}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6820', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6821', 'nonce': 1580142875}]}, 'public_addr': '172.21.15.184:6817/1580142875', 'cluster_addr': '172.21.15.184:6819/1580142875', 'heartbeat_back_addr': '172.21.15.184:6823/1580142875', 'heartbeat_front_addr': '172.21.15.184:6821/1580142875', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.652871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.866866+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.859757+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:34.082180+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.844484+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.746321+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.324821+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.093833+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.5', 'osds': [3, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 42, 'length': 6}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 42, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:02:11.858 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-21T22:02:11.900 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:11.899+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:11.963 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:11.963 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:11.972 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:12.016 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:12.015+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:12.076 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:12.076 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:12.081 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:12.080+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:12.084 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:12.182 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:12.181+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:12.228 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:12.228 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:12.237 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:12.283 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:12.282+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:12.340 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:12.340 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:12.348 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:12.390 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:12.389+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:12.453 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:12.453 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:12.461 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:12.505 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:12.504+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:12.559 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:12.564 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:12.564 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:12.573 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:12.615 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:12.614+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:12.682 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:12.682 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:12.686 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:12.686+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:12.699 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:12.699 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:12.716 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:12.716 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:12.723 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:12.723 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:12.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:12.723 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482355433000002, 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.724 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:02:12.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:02:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482333414000003, 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.728 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:12.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.732 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482312833000002, 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.736 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482284235000002, 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:02:12.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482261829999999, 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482241815000002, 2024-09-21T22:02:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:02:12.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.749 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482221612000004, 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.750 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:02:12.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482202352999998, 2024-09-21T22:02:12.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:02:12.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:02:12.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482176285999998, 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:12.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:02:12.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482155634999998, 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482097455999998, 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.767 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.771 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482042677000003, 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:12.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:02:12.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.482008221000001, 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:02:12.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:02:12.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.481986890999998, 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.780 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:02:12.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:02:12.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.481965729999999, 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.784 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:12.788 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.481935206000003, 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.792 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.481910847000002, 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:02:12.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:02:12.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:02:12.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:02:12.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:02:12.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.798 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.481889541999998, 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.802 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.481868151999997, 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.803 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.481846785000002, 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:12.807 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:12.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:02:12.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:02:12.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:12.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:12.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:12.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:02:12.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:02:12.811 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.811 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.811 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.811 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:12.811 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:12.811 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:12.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:02:12.813 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:12.813 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:12.813 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:12.814 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:12.814 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:12.814 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:12.815 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:12.815 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:12.815 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:12.815 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:12.816 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:12.816 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:12.811+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:12.912 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:12.911+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:12.971 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:12.971 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:12.972 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:12.972 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:12.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:13.022 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:13.021+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:13.114 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:13.113+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:13.125 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:13.125 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:13.126 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:13.126 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:13.126 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:13.134 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:13.215 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:13.214+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273492648000001, 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:13.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:02:13.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:02:13.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273471407000002, 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:02:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273450179000001, 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:02:13.247 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:02:13.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:02:13.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273426573000002, 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.251 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273407282999997, 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.255 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:13.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:02:13.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.258 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273375037000001, 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.259 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273351067999997, 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.263 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:02:13.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.267 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273331503999998, 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:13.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:02:13.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.271 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273311071999998, 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:02:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:02:13.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.275 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273289949000002, 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:02:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273270732999997, 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.280 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273250261000001, 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:13.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:02:13.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:02:13.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273229546000003, 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:02:13.288 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:02:13.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.292 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273209790000003, 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:02:13.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:02:13.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.296 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273190075000002, 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:02:13.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:13.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:02:13.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273170165000003, 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.301 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:13.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:02:13.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:02:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273149181999997, 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:02:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.309 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273128497999998, 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273102594000001, 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:02:13.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.317 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.273081677, 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.321 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.322 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.322 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.322 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:13.323 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:13.323 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:13.322+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:13.423 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:13.422+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:13.426 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:13.426 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:13.427 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:13.427 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:13.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:13.524 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:13.523+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:13.578 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:13.578 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:13.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:13.625 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:13.624+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:13.725 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:13.724+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.859252757999997, 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.731 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:02:13.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.859232765000002, 2024-09-21T22:02:13.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:02:13.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:02:13.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.85911333, 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:02:13.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858846624000002, 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.744 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858816462, 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.748 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:02:13.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:02:13.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858790925999998, 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.752 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858768398000002, 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.756 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858744778000002, 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.760 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:13.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:02:13.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858724428999999, 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:02:13.764 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:02:13.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858702014999999, 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.768 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:02:13.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858525948, 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.772 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:02:13.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:02:13.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858496940000002, 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:02:13.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:02:13.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.780 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858475108999997, 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:13.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:02:13.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:02:13.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.784 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858317964000001, 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:13.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858285494, 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:02:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:02:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:02:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858263962999999, 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:02:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:02:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:02:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858242646000001, 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858217203999999, 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:13.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:02:13.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:02:13.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858196505000002, 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.805 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:13.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 55.858175873, 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:13.809 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:13.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:02:13.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:13.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.813 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:13.814 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:13.814 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:13.815 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:13.816 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:02:13.826 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:13.824+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:13.927 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:13.925+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:13.966 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:13.966 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:13.966 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:13.966 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:13.974 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:14.028 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:14.026+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:14.076 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:14.076 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:14.076 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:14.076 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:14.076 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:14.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:14.129 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:14.128+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:14.190 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:14.190 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:14.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:14.190 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:14.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:80156 3.5 3:a1396def:::rbd_object_map.1124d81bddfe:head [read 0~94] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 15.144426198, 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6793500620000001, 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 80156 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043816+0000", 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0839999999999999e-06 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043825+0000", 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043847+0000", 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1676999999999999e-05 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043858+0000", 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1199000000000001e-05 2024-09-21T22:02:14.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043937+0000", 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9281000000000002e-05 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043950+0000", 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2513e-05 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715287+0000", 2024-09-21T22:02:14.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.67133663899999996 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715300+0000", 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3654e-05 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.722928+0000", 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0076280950000001 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723038+0000", 2024-09-21T22:02:14.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110145 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723164+0000", 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012601100000000001 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85050 3.18 3:1fd90dc3:::rbd_data.1124d990a49c.0000000000000001:2d [sparse-read 7929856~42491] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.258283779999999, 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044083326999999999, 2024-09-21T22:02:14.196 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85050 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4600000000000001e-07 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929958+0000", 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3599999999999999e-06 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929962+0000", 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8060000000000001e-06 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929965+0000", 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973768+0000", 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043802843000000001 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973830+0000", 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2547999999999998e-05 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974040+0000", 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020997400000000001 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85051 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.258272527000001, 2024-09-21T22:02:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044177951999999999, 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85051 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.96e-07 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929970+0000", 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.751e-06 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929977+0000", 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5420000000000002e-06 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929981+0000", 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5739999999999997e-06 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973745+0000", 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043763541000000003 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973820+0000", 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974146+0000", 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00032645299999999999 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85052 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:14.204 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.258253486999999, 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044346141999999998, 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85052 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6e-07 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929989+0000", 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3820000000000001e-06 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929992+0000", 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1310000000000002e-06 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929994+0000", 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4760000000000001e-06 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974207+0000", 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044212491999999999 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974266+0000", 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9098999999999998e-05 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974333+0000", 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7302e-05 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85053 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:14.208 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.258243438999999, 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044518747999999997, 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85053 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929999+0000", 2024-09-21T22:02:14.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.221e-06 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930001+0000", 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.903e-06 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930004+0000", 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3360000000000002e-06 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974399+0000", 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044395260999999998 2024-09-21T22:02:14.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974440+0000", 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1254000000000002e-05 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974516+0000", 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5564999999999999e-05 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85054 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2162688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.212 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.258232107, 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044703447, 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85054 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930009+0000", 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930011+0000", 2024-09-21T22:02:14.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.883e-06 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930016+0000", 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4369999999999998e-06 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930020+0000", 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3680000000000002e-06 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974543+0000", 2024-09-21T22:02:14.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044523600000000003 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974624+0000", 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0989999999999995e-05 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974712+0000", 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7831999999999995e-05 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85055 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.258217367, 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044885911000000001, 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85055 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.28e-07 2024-09-21T22:02:14.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930025+0000", 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3230000000000001e-06 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930032+0000", 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709999999999997e-06 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930035+0000", 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8770000000000002e-06 2024-09-21T22:02:14.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974740+0000", 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044704893000000002 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974822+0000", 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2047999999999998e-05 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974909+0000", 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7471000000000003e-05 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85056 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.258202846, 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060964000000002, 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85056 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.221 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2600000000000001e-07 2024-09-21T22:02:14.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930039+0000", 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1230000000000001e-06 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930043+0000", 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8750000000000002e-06 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930047+0000", 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8840000000000004e-06 2024-09-21T22:02:14.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974937+0000", 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044890473 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975014+0000", 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6574000000000002e-05 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975099+0000", 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4808999999999994e-05 2024-09-21T22:02:14.224 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85057 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.258187699, 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045182878000000003, 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.225 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85057 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930055+0000", 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1040000000000001e-06 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930065+0000", 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0023e-05 2024-09-21T22:02:14.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930070+0000", 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8400000000000002e-06 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975131+0000", 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060718999999999 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975183+0000", 2024-09-21T22:02:14.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1910999999999998e-05 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975236+0000", 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2948000000000002e-05 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85062 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.256296631, 2024-09-21T22:02:14.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044032922000000002, 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85062 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931945+0000", 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5499999999999998e-07 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931947+0000", 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931953+0000", 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1720000000000004e-06 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931958+0000", 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7169999999999999e-06 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975829+0000", 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043871432000000002 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975894+0000", 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5060000000000004e-05 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975977+0000", 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2626999999999993e-05 2024-09-21T22:02:14.233 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85063 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.256276117000001, 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044185847, 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.234 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85063 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:14.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931965+0000", 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4900000000000001e-07 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931967+0000", 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2359999999999999e-06 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931977+0000", 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8959999999999998e-06 2024-09-21T22:02:14.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931982+0000", 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976005+0000", 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044023195000000001 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976067+0000", 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1495999999999995e-05 2024-09-21T22:02:14.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976150+0000", 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3458e-05 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85064 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.256249632999999, 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044333939000000003, 2024-09-21T22:02:14.238 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85064 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931994+0000", 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932001+0000", 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7270000000000007e-06 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932005+0000", 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9009999999999996e-06 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976178+0000", 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044172185000000003 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976242+0000", 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4430999999999993e-05 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976325+0000", 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2885000000000003e-05 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85065 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7471104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:14.242 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.256228746, 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044487967000000003, 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85065 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-07 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932014+0000", 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4610000000000001e-06 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932017+0000", 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8319999999999999e-06 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932020+0000", 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.571e-06 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976351+0000", 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044330688 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976407+0000", 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6023999999999998e-05 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976500+0000", 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3142999999999999e-05 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85066 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.256217716, 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044733053000000002, 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85066 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1e-07 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932024+0000", 2024-09-21T22:02:14.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.108e-06 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932029+0000", 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.335e-06 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932031+0000", 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976528+0000", 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044496971000000003 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976590+0000", 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2200999999999996e-05 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976756+0000", 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016567200000000001 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85077 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.255242474999999, 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044123073999999998, 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85077 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.251 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932999+0000", 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.37e-07 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933006+0000", 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933013+0000", 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5510000000000002e-06 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933019+0000", 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5679999999999999e-06 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977004+0000", 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043985319000000002 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977071+0000", 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7131000000000005e-05 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977121+0000", 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9925000000000001e-05 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85078 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.255214262000001, 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044323946000000003, 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85078 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933027+0000", 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933029+0000", 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933035+0000", 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933041+0000", 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8300000000000001e-06 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977158+0000", 2024-09-21T22:02:14.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044117682999999998 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977273+0000", 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114307 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977350+0000", 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7466999999999995e-05 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85079 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.255193447, 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044512719999999999, 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85079 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933050+0000", 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933056+0000", 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.105e-06 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933060+0000", 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.561e-06 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977399+0000", 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044339296 2024-09-21T22:02:14.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977465+0000", 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.546e-05 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977560+0000", 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4905e-05 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85080 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.255133936, 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044578665000000003, 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85080 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.37e-07 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933110+0000", 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9009999999999998e-06 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933119+0000", 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7609999999999996e-06 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933125+0000", 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3199999999999996e-06 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977587+0000", 2024-09-21T22:02:14.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044462224000000002 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977629+0000", 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2064999999999998e-05 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977685+0000", 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85081 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.255105937, 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044717826000000002, 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85081 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933137+0000", 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933144+0000", 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9009999999999997e-06 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933150+0000", 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0179999999999998e-06 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977715+0000", 2024-09-21T22:02:14.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044564469000000002 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977765+0000", 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0040000000000002e-05 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977852+0000", 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7820999999999998e-05 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85082 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.255083948999999, 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044866094000000002, 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85082 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:14.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933159+0000", 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1019999999999999e-06 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933165+0000", 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933170+0000", 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9860000000000002e-06 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977880+0000", 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044710059000000003 2024-09-21T22:02:14.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977944+0000", 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4162e-05 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.978023+0000", 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8392000000000004e-05 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:14.274 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:14.276 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:14.276 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:14.275+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:14.376 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:14.375+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:14.381 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:14.381 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:14.381 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:14.381 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:14.390 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:14.477 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:14.475+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:14.493 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:14.494 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:14.494 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:14.494 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:14.494 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:14.503 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:14.587 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:14.585+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.434002003000003, 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.648 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:14.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56963 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 622592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391940923, 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021343747, 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.653 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56963 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2e-07 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253818+0000", 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1160000000000002e-06 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253823+0000", 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253828+0000", 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.274987+0000", 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021158445000000001 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275065+0000", 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8407999999999999e-05 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275159+0000", 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3497000000000003e-05 2024-09-21T22:02:14.656 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56964 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391921606, 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021459051999999999, 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56964 2024-09-21T22:02:14.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253835+0000", 2024-09-21T22:02:14.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253837+0000", 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253842+0000", 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8080000000000001e-06 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253847+0000", 2024-09-21T22:02:14.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6099999999999999e-06 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275188+0000", 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021341057 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275230+0000", 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1941999999999999e-05 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275293+0000", 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3195999999999996e-05 2024-09-21T22:02:14.660 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56965 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391889604999999, 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021632274, 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56965 2024-09-21T22:02:14.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253867+0000", 2024-09-21T22:02:14.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253869+0000", 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253875+0000", 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0970000000000002e-06 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253880+0000", 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:02:14.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275329+0000", 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021448292000000001 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275407+0000", 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7946000000000002e-05 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275499+0000", 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1978000000000006e-05 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.664 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56966 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1310720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391869757999999, 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021740731999999999, 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56966 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.665 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253888+0000", 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0669999999999999e-06 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253894+0000", 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8980000000000001e-06 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253900+0000", 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:02:14.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275526+0000", 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021625912000000001 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275569+0000", 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3043000000000001e-05 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275627+0000", 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7479000000000003e-05 2024-09-21T22:02:14.668 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56967 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391849585999999, 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021928007999999999, 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56967 2024-09-21T22:02:14.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253907+0000", 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.41e-07 2024-09-21T22:02:14.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253908+0000", 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.776e-06 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253914+0000", 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1950000000000002e-06 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253928+0000", 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3974e-05 2024-09-21T22:02:14.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275662+0000", 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021734168000000002 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275740+0000", 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7807999999999998e-05 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275834+0000", 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4746000000000004e-05 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.672 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56968 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391821444000001, 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022029615999999998, 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56968 2024-09-21T22:02:14.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253935+0000", 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:02:14.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253937+0000", 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253943+0000", 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253948+0000", 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:02:14.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275861+0000", 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021913548000000001 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275905+0000", 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3795000000000003e-05 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275964+0000", 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8739000000000001e-05 2024-09-21T22:02:14.676 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56969 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391802774999999, 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022221162999999999, 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56969 2024-09-21T22:02:14.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:02:14.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253955+0000", 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.874e-06 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253961+0000", 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999998e-06 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253965+0000", 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5260000000000004e-06 2024-09-21T22:02:14.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276000+0000", 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022034611999999999 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276078+0000", 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8311000000000003e-05 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276174+0000", 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6139999999999998e-05 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.680 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56984 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391785157000001, 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022340279000000001, 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56984 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.681 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:14.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253973+0000", 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.81e-06 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253979+0000", 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253983+0000", 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276203+0000", 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022219848 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276248+0000", 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4880999999999999e-05 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276311+0000", 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3047999999999997e-05 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.684 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56985 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391767184999999, 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022528538000000001, 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56985 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253991+0000", 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1229999999999998e-06 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253997+0000", 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4759999999999997e-06 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254003+0000", 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.896e-06 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276347+0000", 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022344180000000002 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276424+0000", 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7014000000000005e-05 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276517+0000", 2024-09-21T22:02:14.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3383999999999999e-05 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56986 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391747582000001, 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022636156000000001, 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.689 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56986 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254009+0000", 2024-09-21T22:02:14.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254021+0000", 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2075e-05 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254027+0000", 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2910000000000004e-06 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254032+0000", 2024-09-21T22:02:14.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0969999999999996e-06 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276545+0000", 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022513014000000001 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276588+0000", 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3183000000000003e-05 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276644+0000", 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6165999999999997e-05 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.692 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56987 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 868352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391717111999998, 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022813353000000001, 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.693 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56987 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.694 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254041+0000", 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254047+0000", 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254051+0000", 2024-09-21T22:02:14.695 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6430000000000003e-06 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276680+0000", 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022628945000000001 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276758+0000", 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7775999999999995e-05 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276852+0000", 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4067999999999995e-05 2024-09-21T22:02:14.696 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56988 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1097728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391699697, 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923770999999999, 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56988 2024-09-21T22:02:14.697 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.698 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254058+0000", 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254064+0000", 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2950000000000001e-06 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.699 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254068+0000", 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1479999999999999e-06 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276880+0000", 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022812260000000001 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276923+0000", 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3347999999999999e-05 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.700 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276980+0000", 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6496000000000003e-05 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56989 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1327104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391682691, 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023109826999999999, 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.701 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56989 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.702 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254075+0000", 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.691e-06 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254081+0000", 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.703 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254085+0000", 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.498e-06 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277015+0000", 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929417000000001 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277092+0000", 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6625000000000006e-05 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.704 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277183+0000", 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1453999999999995e-05 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56990 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1556480~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391664544000001, 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023224305000000001, 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.705 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56990 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.706 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254092+0000", 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.22e-07 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254093+0000", 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7099999999999999e-06 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254099+0000", 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:02:14.707 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254103+0000", 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277211+0000", 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023107593999999999 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277254+0000", 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2762000000000002e-05 2024-09-21T22:02:14.708 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277316+0000", 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1876000000000002e-05 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56991 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391647198000001, 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023415498999999999, 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.709 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56991 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.710 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254111+0000", 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.813e-06 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.711 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254116+0000", 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254121+0000", 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5730000000000001e-06 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277351+0000", 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023230621 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277431+0000", 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9818e-05 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277524+0000", 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2986999999999996e-05 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56992 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 2015232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391629709, 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023528238999999999, 2024-09-21T22:02:14.713 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56992 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.714 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254128+0000", 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8330000000000001e-06 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254134+0000", 2024-09-21T22:02:14.715 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5729999999999998e-06 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254139+0000", 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4790000000000004e-06 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277553+0000", 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023413607999999999 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277596+0000", 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3489000000000003e-05 2024-09-21T22:02:14.716 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277654+0000", 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7911999999999997e-05 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57020 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391132624000001, 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023243617000000001, 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.717 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57020 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:14.718 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254624+0000", 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254632+0000", 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1219999999999995e-06 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254640+0000", 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9370000000000004e-06 2024-09-21T22:02:14.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254645+0000", 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3140000000000003e-06 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277690+0000", 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023044477000000001 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277768+0000", 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8594e-05 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.720 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277867+0000", 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8560999999999994e-05 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57021 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391103723000001, 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023344055999999998, 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.721 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57021 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.722 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254653+0000", 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254654+0000", 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254661+0000", 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.723 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254666+0000", 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277894+0000", 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023228029000000001 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277936+0000", 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2589000000000002e-05 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.724 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277996+0000", 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9967999999999999e-05 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57023 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 704512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 27.391084904, 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023525122999999998, 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:14.725 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57023 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.726 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.32e-07 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254679+0000", 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7479999999999993e-06 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254686+0000", 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254690+0000", 2024-09-21T22:02:14.727 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7180000000000004e-06 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278021+0000", 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023330391999999998 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278097+0000", 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6464999999999994e-05 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278196+0000", 2024-09-21T22:02:14.728 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8852999999999997e-05 2024-09-21T22:02:14.729 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.729 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.729 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.729 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:14.729 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:14.729 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:14.730 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:14.730 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:14.728+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:14.822 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:14.830 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:14.829+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:14.881 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:14.881 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:14.881 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:14.881 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:14.889 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:14.931 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:14.929+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:14.944 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:14.944 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:14.960 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:14.976 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:14.976 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:14.992 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:15.010 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:15.011 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:15.028 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:15.028 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:15.032 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:15.030+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:15.035 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:15.035 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:15.044 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:15.044 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:15.060 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:15.133 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:15.132+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:15.187 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:15.187 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:15.196 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:15.234 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:15.233+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:15.300 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:15.300 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:15.309 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:15.354 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:15.352+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:15.413 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:15.413 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:15.422 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:15.435 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:15.434+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:15.535 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:15.534+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:15.565 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:15.565 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:15.573 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:15.658 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:15.656+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:15.717 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:15.718 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:15.726 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:15.768 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:15.766+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:15.816 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:02:15.860 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:15.859+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:15.877 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:15.878 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:15.886 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:15.937 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:15.936+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:15.992 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:15.992 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:16.001 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:16.042 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:16.040+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:16.106 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:16.106 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:16.115 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:16.139 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:16.137+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:16.217 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:16.217 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:16.225 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:16.270 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:16.269+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:16.328 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:16.328 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:16.337 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:16.340 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:16.338+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:16.441 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:16.440+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:16.481 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:16.482 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:16.490 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:16.541 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:16.540+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:16.634 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:16.634 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:16.642 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:16.643 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:16.640+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:16.743 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:16.742+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:16.745 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:16.745 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:16.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:16.810 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:02:16.844 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:16.842+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:16.859 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:02:16.860 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:02:16.860 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-21T22:02:16.860 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T22:02:16.860 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T22:02:16.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-21T22:02:16.916 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:16.916 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:16.926 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:16.971 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:16.970+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:16.985 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:16.985 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T22:02:16.985 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:17.033 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:17.033 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:17.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:17.046 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:17.044+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:17.072 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:17.147 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:17.145+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:17.189 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:17.189 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:17.198 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:17.205 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:17.205 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:17.222 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:17.222 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:17.238 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:17.239 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:17.247 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:17.245+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:17.255 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:17.255 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:17.272 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:17.272 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:17.289 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:17.289 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:17.303 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:17.303 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:17.303 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:17.303 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:17.306 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:17.313 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:17.324 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:17.325 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:17.377 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:17.376+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:17.427 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:17.427 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:17.427 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:17.427 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:17.427 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:17.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:17.477 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:17.476+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:17.550 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:17.548+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:17.581 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:17.581 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:17.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:17.581 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:17.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.581 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:80156 3.5 3:a1396def:::rbd_object_map.1124d81bddfe:head [read 0~94] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.535248660000001, 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6793500620000001, 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 80156 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043816+0000", 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0839999999999999e-06 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043825+0000", 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043847+0000", 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1676999999999999e-05 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043858+0000", 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1199000000000001e-05 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043937+0000", 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9281000000000002e-05 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043950+0000", 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2513e-05 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715287+0000", 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.67133663899999996 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715300+0000", 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3654e-05 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.722928+0000", 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0076280950000001 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723038+0000", 2024-09-21T22:02:17.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110145 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723164+0000", 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012601100000000001 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85050 3.18 3:1fd90dc3:::rbd_data.1124d990a49c.0000000000000001:2d [sparse-read 7929856~42491] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.649106242, 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044083326999999999, 2024-09-21T22:02:17.587 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85050 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4600000000000001e-07 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929958+0000", 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3599999999999999e-06 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929962+0000", 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8060000000000001e-06 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929965+0000", 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973768+0000", 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043802843000000001 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973830+0000", 2024-09-21T22:02:17.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2547999999999998e-05 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974040+0000", 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020997400000000001 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85051 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.649094989, 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044177951999999999, 2024-09-21T22:02:17.591 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85051 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.96e-07 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929970+0000", 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.751e-06 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929977+0000", 2024-09-21T22:02:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5420000000000002e-06 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929981+0000", 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5739999999999997e-06 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973745+0000", 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043763541000000003 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973820+0000", 2024-09-21T22:02:17.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974146+0000", 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00032645299999999999 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85052 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.649075949, 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044346141999999998, 2024-09-21T22:02:17.595 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85052 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6e-07 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929989+0000", 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3820000000000001e-06 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929992+0000", 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1310000000000002e-06 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929994+0000", 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4760000000000001e-06 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974207+0000", 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044212491999999999 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974266+0000", 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9098999999999998e-05 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974333+0000", 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7302e-05 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85053 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.649065901, 2024-09-21T22:02:17.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044518747999999997, 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85053 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:17.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929999+0000", 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.221e-06 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930001+0000", 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.903e-06 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930004+0000", 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3360000000000002e-06 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974399+0000", 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044395260999999998 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974440+0000", 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1254000000000002e-05 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974516+0000", 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5564999999999999e-05 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85054 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2162688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:17.603 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.649054569, 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044703447, 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85054 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930009+0000", 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930011+0000", 2024-09-21T22:02:17.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.883e-06 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930016+0000", 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4369999999999998e-06 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930020+0000", 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3680000000000002e-06 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974543+0000", 2024-09-21T22:02:17.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044523600000000003 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974624+0000", 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0989999999999995e-05 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974712+0000", 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7831999999999995e-05 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85055 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.649039828999999, 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044885911000000001, 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85055 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:17.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.28e-07 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930025+0000", 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3230000000000001e-06 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930032+0000", 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709999999999997e-06 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930035+0000", 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8770000000000002e-06 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974740+0000", 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044704893000000002 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974822+0000", 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2047999999999998e-05 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974909+0000", 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7471000000000003e-05 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85056 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.649025308000001, 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060964000000002, 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.612 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85056 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2600000000000001e-07 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930039+0000", 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1230000000000001e-06 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930043+0000", 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8750000000000002e-06 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930047+0000", 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8840000000000004e-06 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974937+0000", 2024-09-21T22:02:17.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044890473 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975014+0000", 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6574000000000002e-05 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975099+0000", 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4808999999999994e-05 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85057 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.649010161, 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045182878000000003, 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85057 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:17.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930055+0000", 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1040000000000001e-06 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930065+0000", 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0023e-05 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930070+0000", 2024-09-21T22:02:17.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8400000000000002e-06 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975131+0000", 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060718999999999 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975183+0000", 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1910999999999998e-05 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975236+0000", 2024-09-21T22:02:17.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2948000000000002e-05 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85062 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.647119093000001, 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044032922000000002, 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85062 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931945+0000", 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5499999999999998e-07 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931947+0000", 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931953+0000", 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1720000000000004e-06 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931958+0000", 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7169999999999999e-06 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975829+0000", 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043871432000000002 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975894+0000", 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5060000000000004e-05 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975977+0000", 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2626999999999993e-05 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85063 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.647098579, 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044185847, 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.625 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85063 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:17.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931965+0000", 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4900000000000001e-07 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931967+0000", 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2359999999999999e-06 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931977+0000", 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8959999999999998e-06 2024-09-21T22:02:17.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931982+0000", 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976005+0000", 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044023195000000001 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976067+0000", 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1495999999999995e-05 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976150+0000", 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3458e-05 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85064 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.647072095, 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044333939000000003, 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.629 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85064 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:17.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931994+0000", 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932001+0000", 2024-09-21T22:02:17.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7270000000000007e-06 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932005+0000", 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9009999999999996e-06 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976178+0000", 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044172185000000003 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976242+0000", 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4430999999999993e-05 2024-09-21T22:02:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976325+0000", 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2885000000000003e-05 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85065 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7471104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.647051208000001, 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044487967000000003, 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85065 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-07 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932014+0000", 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4610000000000001e-06 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932017+0000", 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8319999999999999e-06 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932020+0000", 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.571e-06 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976351+0000", 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044330688 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976407+0000", 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6023999999999998e-05 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976500+0000", 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3142999999999999e-05 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85066 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.647040177999999, 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044733053000000002, 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.637 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85066 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:17.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1e-07 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932024+0000", 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.108e-06 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932029+0000", 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.335e-06 2024-09-21T22:02:17.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932031+0000", 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976528+0000", 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044496971000000003 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976590+0000", 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2200999999999996e-05 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976756+0000", 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016567200000000001 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85077 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.646064937, 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044123073999999998, 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85077 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932999+0000", 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.37e-07 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933006+0000", 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933013+0000", 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5510000000000002e-06 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933019+0000", 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5679999999999999e-06 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977004+0000", 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043985319000000002 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977071+0000", 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7131000000000005e-05 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977121+0000", 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9925000000000001e-05 2024-09-21T22:02:17.644 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85078 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.646036724, 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044323946000000003, 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85078 2024-09-21T22:02:17.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933027+0000", 2024-09-21T22:02:17.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933029+0000", 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933035+0000", 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933041+0000", 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8300000000000001e-06 2024-09-21T22:02:17.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977158+0000", 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044117682999999998 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977273+0000", 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114307 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977350+0000", 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7466999999999995e-05 2024-09-21T22:02:17.648 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85079 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.646015909000001, 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044512719999999999, 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.649 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85079 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:17.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933050+0000", 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933056+0000", 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.105e-06 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933060+0000", 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.561e-06 2024-09-21T22:02:17.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977399+0000", 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044339296 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977465+0000", 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.546e-05 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977560+0000", 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4905e-05 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.652 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85080 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.645956397999999, 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044578665000000003, 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85080 2024-09-21T22:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.37e-07 2024-09-21T22:02:17.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933110+0000", 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9009999999999998e-06 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933119+0000", 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7609999999999996e-06 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933125+0000", 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3199999999999996e-06 2024-09-21T22:02:17.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977587+0000", 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044462224000000002 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977629+0000", 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2064999999999998e-05 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977685+0000", 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:17.656 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85081 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.645928399000001, 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044717826000000002, 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.657 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85081 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933137+0000", 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933144+0000", 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9009999999999997e-06 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933150+0000", 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0179999999999998e-06 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977715+0000", 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044564469000000002 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977765+0000", 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0040000000000002e-05 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977852+0000", 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7820999999999998e-05 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85082 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.645906411, 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044866094000000002, 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:17.661 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85082 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:17.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933159+0000", 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1019999999999999e-06 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:17.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933165+0000", 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933170+0000", 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9860000000000002e-06 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977880+0000", 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044710059000000003 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977944+0000", 2024-09-21T22:02:17.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4162e-05 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.978023+0000", 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8392000000000004e-05 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:17.665 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:17.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:17.667 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:17.665+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:17.767 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:17.766+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:17.781 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:17.781 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:17.781 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:17.781 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:17.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:17.868 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:17.867+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:17.942 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:17.942 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:17.942 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:17.942 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:17.942 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:17.951 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:17.995 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:17.993+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:18.056 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:18.056 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:18.056 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:18.056 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:18.056 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.056 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:02:18.056 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.842159421999995, 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.057 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.058 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:02:18.059 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.060 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56963 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 622592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:18.061 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.800098341999998, 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021343747, 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56963 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:18.062 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2e-07 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253818+0000", 2024-09-21T22:02:18.063 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1160000000000002e-06 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253823+0000", 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253828+0000", 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.274987+0000", 2024-09-21T22:02:18.064 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021158445000000001 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275065+0000", 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8407999999999999e-05 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275159+0000", 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3497000000000003e-05 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.065 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56964 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.800079024999999, 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021459051999999999, 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56964 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.066 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253835+0000", 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.067 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253837+0000", 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253842+0000", 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8080000000000001e-06 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253847+0000", 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6099999999999999e-06 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.068 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275188+0000", 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021341057 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275230+0000", 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1941999999999999e-05 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275293+0000", 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3195999999999996e-05 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56965 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.800047024000001, 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021632274, 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56965 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253867+0000", 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253869+0000", 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253875+0000", 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0970000000000002e-06 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253880+0000", 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.072 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275329+0000", 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021448292000000001 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275407+0000", 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7946000000000002e-05 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275499+0000", 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1978000000000006e-05 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56966 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1310720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.800027177, 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021740731999999999, 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56966 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.074 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:02:18.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253888+0000", 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0669999999999999e-06 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253894+0000", 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8980000000000001e-06 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253900+0000", 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:02:18.076 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275526+0000", 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021625912000000001 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275569+0000", 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3043000000000001e-05 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275627+0000", 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7479000000000003e-05 2024-09-21T22:02:18.077 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56967 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.800007005000001, 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021928007999999999, 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.078 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56967 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253907+0000", 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.41e-07 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253908+0000", 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.776e-06 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253914+0000", 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1950000000000002e-06 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253928+0000", 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3974e-05 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275662+0000", 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021734168000000002 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275740+0000", 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7807999999999998e-05 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275834+0000", 2024-09-21T22:02:18.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4746000000000004e-05 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56968 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799978863, 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022029615999999998, 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.082 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56968 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253935+0000", 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253937+0000", 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253943+0000", 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253948+0000", 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275861+0000", 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021913548000000001 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275905+0000", 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3795000000000003e-05 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275964+0000", 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8739000000000001e-05 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56969 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799960194000001, 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022221162999999999, 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.086 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56969 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253955+0000", 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.874e-06 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253961+0000", 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999998e-06 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253965+0000", 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5260000000000004e-06 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276000+0000", 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022034611999999999 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276078+0000", 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8311000000000003e-05 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276174+0000", 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6139999999999998e-05 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56984 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:18.090 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799942575999999, 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022340279000000001, 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56984 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253973+0000", 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.81e-06 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253979+0000", 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253983+0000", 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276203+0000", 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022219848 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276248+0000", 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4880999999999999e-05 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276311+0000", 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3047999999999997e-05 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56985 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799924604000001, 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022528538000000001, 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56985 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253991+0000", 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1229999999999998e-06 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253997+0000", 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4759999999999997e-06 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254003+0000", 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.896e-06 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276347+0000", 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022344180000000002 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276424+0000", 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7014000000000005e-05 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276517+0000", 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3383999999999999e-05 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.098 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56986 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799905000999999, 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022636156000000001, 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56986 2024-09-21T22:02:18.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254009+0000", 2024-09-21T22:02:18.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254021+0000", 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2075e-05 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254027+0000", 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2910000000000004e-06 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254032+0000", 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0969999999999996e-06 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276545+0000", 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022513014000000001 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276588+0000", 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3183000000000003e-05 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276644+0000", 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6165999999999997e-05 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56987 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 868352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799874531, 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022813353000000001, 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.103 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56987 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:18.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254041+0000", 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254047+0000", 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254051+0000", 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6430000000000003e-06 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276680+0000", 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022628945000000001 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276758+0000", 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7775999999999995e-05 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276852+0000", 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4067999999999995e-05 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56988 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1097728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799857115999998, 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923770999999999, 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56988 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.108 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:18.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254058+0000", 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254064+0000", 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2950000000000001e-06 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254068+0000", 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1479999999999999e-06 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276880+0000", 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022812260000000001 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276923+0000", 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3347999999999999e-05 2024-09-21T22:02:18.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276980+0000", 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6496000000000003e-05 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56989 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1327104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799840110000002, 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023109826999999999, 2024-09-21T22:02:18.112 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56989 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254075+0000", 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.691e-06 2024-09-21T22:02:18.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254081+0000", 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254085+0000", 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.498e-06 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277015+0000", 2024-09-21T22:02:18.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929417000000001 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277092+0000", 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6625000000000006e-05 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277183+0000", 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1453999999999995e-05 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56990 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1556480~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799821962999999, 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023224305000000001, 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56990 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.117 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254092+0000", 2024-09-21T22:02:18.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.22e-07 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254093+0000", 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7099999999999999e-06 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254099+0000", 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254103+0000", 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277211+0000", 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023107593999999999 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277254+0000", 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2762000000000002e-05 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277316+0000", 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1876000000000002e-05 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56991 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799804616999999, 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023415498999999999, 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.121 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56991 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254111+0000", 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.813e-06 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254116+0000", 2024-09-21T22:02:18.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254121+0000", 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5730000000000001e-06 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277351+0000", 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023230621 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277431+0000", 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9818e-05 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277524+0000", 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2986999999999996e-05 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56992 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 2015232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:18.125 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799787127999998, 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023528238999999999, 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56992 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254128+0000", 2024-09-21T22:02:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8330000000000001e-06 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254134+0000", 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5729999999999998e-06 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254139+0000", 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4790000000000004e-06 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277553+0000", 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023413607999999999 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277596+0000", 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3489000000000003e-05 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277654+0000", 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7911999999999997e-05 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57020 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799290042999999, 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023243617000000001, 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57020 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.130 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254624+0000", 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:02:18.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254632+0000", 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1219999999999995e-06 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254640+0000", 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9370000000000004e-06 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254645+0000", 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3140000000000003e-06 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277690+0000", 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023044477000000001 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277768+0000", 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8594e-05 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277867+0000", 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8560999999999994e-05 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57021 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799261141999999, 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023344055999999998, 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57021 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254653+0000", 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254654+0000", 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254661+0000", 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254666+0000", 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277894+0000", 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023228029000000001 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277936+0000", 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2589000000000002e-05 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277996+0000", 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9967999999999999e-05 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57023 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 704512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 30.799242323000001, 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023525122999999998, 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57023 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.138 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.32e-07 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254679+0000", 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7479999999999993e-06 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254686+0000", 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254690+0000", 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7180000000000004e-06 2024-09-21T22:02:18.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278021+0000", 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023330391999999998 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278097+0000", 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6464999999999994e-05 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278196+0000", 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8852999999999997e-05 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.141 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.142 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.142 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.142 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.142 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:18.143 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:18.143 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:18.141+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:18.243 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:18.242+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:18.287 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:18.288 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:18.288 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:18.288 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:18.296 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:18.344 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:18.343+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:18.439 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:18.439 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:18.439 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:18.439 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:18.439 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:18.444 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:18.443+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:18.448 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:18.546 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:18.545+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 74.538824203999994, 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:18.593 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:18.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:02:18.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:02:18.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:02:18.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.598 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.662109710000003, 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.599 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:02:18.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:02:18.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.662099759999997, 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.603 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:02:18.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.662086357, 2024-09-21T22:02:18.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:02:18.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:02:18.611 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.662076685999999, 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:02:18.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:02:18.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.660080849000003, 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:18.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.660034592999999, 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.621 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:18.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:02:18.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.659997257999997, 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:02:18.625 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.629 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.659963077, 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.633 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.659923204999998, 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.634 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:02:18.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:02:18.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:02:18.637 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.65987792, 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.638 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:02:18.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85825 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2277376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.52878044, 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028813432, 2024-09-21T22:02:18.642 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85825 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061936+0000", 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4790000000000001e-06 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061939+0000", 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1240000000000001e-06 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061941+0000", 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.452e-06 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090598+0000", 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028656966999999998 2024-09-21T22:02:18.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090675+0000", 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6914000000000003e-05 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090745+0000", 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0290999999999995e-05 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.646 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85826 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2342912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.528768321999999, 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028888786999999999, 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85826 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:18.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061946+0000", 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.556e-06 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061949+0000", 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9249999999999999e-06 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061951+0000", 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4739999999999999e-06 2024-09-21T22:02:18.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090758+0000", 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028806486999999999 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090796+0000", 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8466000000000001e-05 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090833+0000", 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6674000000000002e-05 2024-09-21T22:02:18.650 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85827 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2408448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.528758367, 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029053266000000001, 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.651 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85827 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:18.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9999999999999999e-07 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061955+0000", 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.156e-06 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061958+0000", 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9340000000000002e-06 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061961+0000", 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5040000000000001e-06 2024-09-21T22:02:18.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090862+0000", 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028901175000000001 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090937+0000", 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4881000000000004e-05 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091007+0000", 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0415999999999998e-05 2024-09-21T22:02:18.654 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85828 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2473984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.528748687, 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029127014, 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.655 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85828 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061965+0000", 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061968+0000", 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.92e-06 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061971+0000", 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.101e-06 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091020+0000", 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029048398999999999 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091056+0000", 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6718000000000003e-05 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091091+0000", 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4501000000000001e-05 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85829 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2539520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.528699334000001, 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029251899000000001, 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.659 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85829 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062014+0000", 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062016+0000", 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062022+0000", 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062027+0000", 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2180000000000001e-06 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091120+0000", 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029093112000000001 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091195+0000", 2024-09-21T22:02:18.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5499000000000003e-05 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091265+0000", 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9670000000000002e-05 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85830 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2605056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.528679688, 2024-09-21T22:02:18.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029323741, 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85830 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062034+0000", 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2729999999999999e-06 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062038+0000", 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.602e-06 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062042+0000", 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9949999999999999e-06 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091283+0000", 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029241195000000001 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091320+0000", 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7296999999999999e-05 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091356+0000", 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6170000000000001e-05 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85831 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2670592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.528667216000001, 2024-09-21T22:02:18.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029484659999999999, 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85831 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062047+0000", 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062050+0000", 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1099999999999999e-06 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062052+0000", 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4899999999999999e-06 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091385+0000", 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029333016999999999 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091461+0000", 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6019000000000005e-05 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091530+0000", 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8660999999999999e-05 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.671 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85832 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2736128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.528657185, 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029557844999999999, 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85832 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:18.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062057+0000", 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.119e-06 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062060+0000", 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9730000000000002e-06 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062062+0000", 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091542+0000", 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029480309999999999 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091579+0000", 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6254000000000002e-05 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091613+0000", 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4555999999999999e-05 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.675 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85882 3.16 3:6c4a0c3b:::rbd_data.1124f4fa8d1.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.441665472, 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029882499999999999, 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85882 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:18.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149049+0000", 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.635e-06 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149054+0000", 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7939999999999999e-06 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149067+0000", 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2587e-05 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149074+0000", 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.25e-06 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149143+0000", 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9008000000000001e-05 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149216+0000", 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2947000000000005e-05 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149339+0000", 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012293800000000001 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178449+0000", 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029110159 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178861+0000", 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000411808 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178898+0000", 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6745000000000001e-05 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178929+0000", 2024-09-21T22:02:18.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1628999999999998e-05 2024-09-21T22:02:18.681 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.681 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.681 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.681 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:18.681 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:18.681 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:18.682 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:18.682 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:18.680+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:18.783 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:18.782+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:18.828 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:18.828 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:18.828 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:18.828 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:18.832 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:02:18.840 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:18.883 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:18.882+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:18.954 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:18.954 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:18.954 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:18.954 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:18.954 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:18.963 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:18.984 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:18.983+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:19.067 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.222132862000002, 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.068 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.069 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:02:19.070 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:02:19.071 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:02:19.072 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:02:19.073 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.223221348999999, 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.074 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.075 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:02:19.076 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:02:19.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.078 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.079 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.114764592, 2024-09-21T22:02:19.080 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.081 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.082 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.083 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.114755299000002, 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:02:19.084 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:02:19.086 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:02:19.087 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.114731552999999, 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.088 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:19.089 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:02:19.090 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:02:19.091 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.114721000000003, 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.092 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:02:19.094 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:02:19.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.114711597000003, 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:02:19.096 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.097 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.098 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:02:19.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.114700806999998, 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.100 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.101 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:02:19.102 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:02:19.103 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.114667533999999, 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.104 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:19.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:02:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.114656861999997, 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.108 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:19.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:02:19.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.112 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.110527371000003, 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.110128232999998, 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:02:19.120 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.109173642000002, 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.121 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:02:19.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.109150389, 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.125 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:02:19.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.107857719000002, 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.129 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.133 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.107838606000001, 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:02:19.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.107819476000003, 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:02:19.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.107801137999999, 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:02:19.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.145 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 59.107782739000001, 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:02:19.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:19.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:02:19.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:02:19.149 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:41899 3.10 3:0bb333a9:::rbd_data.11247a90fb52.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.310873328, 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015085853, 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.150 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 41899 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754789+0000", 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.372e-06 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754796+0000", 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8249999999999999e-06 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754809+0000", 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3662000000000001e-05 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754816+0000", 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7220000000000002e-06 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754866+0000", 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9945999999999999e-05 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754919+0000", 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3329999999999999e-05 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:19.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.758040+0000", 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031204869999999999 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769752+0000", 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011712530000000001 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769803+0000", 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.117e-05 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769841+0000", 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7982999999999999e-05 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769873+0000", 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1826000000000003e-05 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.155 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:19.157 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:19.157 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:19.155+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:19.257 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:19.255+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:19.260 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:19.260 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:19.261 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:19.269 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:19.336 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:19.381 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:19.380+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:19.413 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:19.413 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:19.413 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:19.413 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:19.413 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:19.421 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:19.457 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:19.457 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:19.465 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:19.463+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:19.474 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:19.474 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:19.490 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:19.490 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:19.505 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:19.506 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:19.522 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:19.522 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:19.526 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:19.526 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:19.526 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:19.526 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:19.526 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.526 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 101.450778543, 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.527 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.528 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.530 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.531 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.532 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:02:19.533 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 74.018742291999999, 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.534 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.535 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.536 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:02:19.537 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:19.538 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 61.665915474999998, 2024-09-21T22:02:19.539 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.540 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.541 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.542 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.543 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 61.665896011999997, 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.544 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:02:19.545 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.546 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.547 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 61.665867935000001, 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.548 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:19.549 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:02:19.550 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:02:19.551 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 61.665846103, 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.552 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.553 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:02:19.554 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:02:19.555 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 61.665825775999998, 2024-09-21T22:02:19.556 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:02:19.558 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:02:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 61.665804813999998, 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.561 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.562 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.563 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.564 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 61.665783826999998, 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.565 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:02:19.566 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:02:19.567 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.568 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29863 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 3031040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 61.630826847999998, 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023866634000000001, 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.569 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29863 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:19.570 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893334+0000", 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893339+0000", 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.571 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893345+0000", 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1469999999999998e-06 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893356+0000", 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0772e-05 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917062+0000", 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023706261999999999 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917108+0000", 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5318000000000002e-05 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917200+0000", 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2238999999999996e-05 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:19.573 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 38.724337032999998, 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:19.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:02:19.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:02:19.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:19.577 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81730 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7127040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.350716637000001, 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023997688999999999, 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.579 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81730 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:19.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173444+0000", 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173450+0000", 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173456+0000", 2024-09-21T22:02:19.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0599999999999996e-06 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173461+0000", 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5279999999999997e-06 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197301+0000", 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023840647 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197353+0000", 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2222000000000002e-05 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197441+0000", 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81734 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.350681204000001, 2024-09-21T22:02:19.583 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024110228000000001, 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81734 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173482+0000", 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.136e-06 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173488+0000", 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3380000000000001e-06 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173493+0000", 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197456+0000", 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023962944999999999 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197495+0000", 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9385000000000003e-05 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197589+0000", 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4097000000000004e-05 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81735 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:19.587 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.350660828999999, 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024317473999999999, 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81735 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173500+0000", 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173502+0000", 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9580000000000001e-06 2024-09-21T22:02:19.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173507+0000", 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6080000000000003e-06 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173516+0000", 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8130000000000002e-06 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197630+0000", 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024114304 2024-09-21T22:02:19.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197717+0000", 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6839e-05 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197817+0000", 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9494000000000007e-05 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.591 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81736 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.350637970000001, 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024493269000000002, 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81736 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.592 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173523+0000", 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173524+0000", 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173531+0000", 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.049e-06 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173539+0000", 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5790000000000004e-06 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197853+0000", 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024313950000000001 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197926+0000", 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2606000000000002e-05 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198015+0000", 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9728000000000006e-05 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.595 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81737 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 3883008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.350615122000001, 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024642094, 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.596 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81737 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173547+0000", 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.013e-06 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173554+0000", 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4559999999999997e-06 2024-09-21T22:02:19.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173558+0000", 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4240000000000003e-06 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198041+0000", 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024483076999999999 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198102+0000", 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1066000000000001e-05 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198187+0000", 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4685000000000007e-05 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81738 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 4571136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:19.600 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.350596272000001, 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024869964000000001, 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81738 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:02:19.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173566+0000", 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.86e-06 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173574+0000", 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3200000000000002e-06 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173578+0000", 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5360000000000003e-06 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198231+0000", 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024653195999999999 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198318+0000", 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6810000000000004e-05 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198434+0000", 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011572 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81739 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.350576095000001, 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024965376000000001, 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.605 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81739 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173590+0000", 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173596+0000", 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1199999999999999e-06 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173600+0000", 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2379999999999999e-06 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198454+0000", 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024854246 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198496+0000", 2024-09-21T22:02:19.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2202e-05 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198549+0000", 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3038999999999998e-05 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81740 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 6537216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.350554157000001, 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025068272999999999, 2024-09-21T22:02:19.609 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81740 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173608+0000", 2024-09-21T22:02:19.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173614+0000", 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173618+0000", 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.459e-06 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198573+0000", 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024954473000000001 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198614+0000", 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.087e-05 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198674+0000", 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0528000000000001e-05 2024-09-21T22:02:19.613 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81749 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7815168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.350535941, 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025172553, 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:19.614 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81749 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:19.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173625+0000", 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.46e-07 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173626+0000", 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.841e-06 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173632+0000", 2024-09-21T22:02:19.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8130000000000001e-06 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173638+0000", 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198697+0000", 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025059100000000001 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198736+0000", 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9319000000000001e-05 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198797+0000", 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0445000000000001e-05 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:19.618 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:19.619 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:19.620 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:19.620 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:19.620 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:19.621 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:19.621 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:19.622 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:19.622 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:19.618+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:02:19.720 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:19.720+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:19.774 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:19.774 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:19.784 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:19.821 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:19.819+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:19.894 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:19.894 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:19.903 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:19.946 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:19.945+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:20.006 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:20.006 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:20.014 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:20.056 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:20.055+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:20.123 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:20.122+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:20.159 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:20.159 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:20.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:20.251 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:20.250+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:20.310 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:20.310 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:20.319 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:20.360 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:20.359+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:20.426 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:20.425+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:20.462 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:20.462 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:20.471 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:20.555 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:20.554+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:20.613 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:20.613 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:20.622 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:20.628 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:20.626+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:20.729 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:20.728+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:20.765 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:20.765 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:20.774 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:20.831 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:20.829+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:20.928 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:20.928 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:20.931 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:20.929+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:20.940 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:21.032 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:21.031+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:21.047 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:21.047 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:21.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:21.133 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:21.132+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:21.199 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:21.199 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:21.208 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:21.253 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:21.252+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:21.310 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:21.310 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:21.319 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:21.361 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:21.360+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:21.434 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:21.434 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:21.435 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:21.433+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:21.443 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:21.536 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:21.534+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:21.587 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:21.587 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:21.596 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:21.623 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:21.637 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:21.635+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:21.730 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:02:21.738 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:21.735+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:21.739 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:21.739 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:21.743 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:21.743 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:21.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:21.765 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:21.765 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:21.782 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:21.782 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:21.798 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:21.798 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:21.816 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:21.816 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:21.832 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:21.832 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:21.838 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:21.836+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:21.854 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:21.854 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:21.880 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:21.880 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:21.905 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:21.905 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:21.905 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:21.905 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:21.915 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:21.957 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:21.955+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:21.995 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:02:21.995 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:02:21.995 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T22:02:21.995 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:02:22.040 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:22.039+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:22.061 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:22.061 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:22.061 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:22.061 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:22.061 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:22.069 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:22.141 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:22.140+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:22.175 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:22.175 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:22.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.121237832999995, 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:02:22.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:02:22.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:02:22.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.181 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.244523338999997, 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.185 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.244513389000005, 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:02:22.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.244499985999994, 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.190 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:02:22.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.244490314999993, 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.195 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:02:22.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.242494477999998, 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.199 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:22.203 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.242448221999993, 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:22.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:02:22.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:02:22.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.242410887000005, 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.211 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.242376706000002, 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:02:22.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:02:22.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:02:22.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:02:22.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.242336834, 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.216 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:02:22.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 64.242291549000001, 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:02:22.220 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:02:22.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85825 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2277376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:22.224 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.111194069, 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028813432, 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85825 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061936+0000", 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4790000000000001e-06 2024-09-21T22:02:22.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061939+0000", 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1240000000000001e-06 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061941+0000", 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.452e-06 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090598+0000", 2024-09-21T22:02:22.227 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028656966999999998 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090675+0000", 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6914000000000003e-05 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090745+0000", 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0290999999999995e-05 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.228 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85826 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2342912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.111181950999999, 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028888786999999999, 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85826 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.229 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:22.230 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061946+0000", 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.556e-06 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061949+0000", 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9249999999999999e-06 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061951+0000", 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4739999999999999e-06 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090758+0000", 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028806486999999999 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090796+0000", 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8466000000000001e-05 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090833+0000", 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6674000000000002e-05 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.232 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85827 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2408448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.111171995999999, 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029053266000000001, 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85827 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.233 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9999999999999999e-07 2024-09-21T22:02:22.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061955+0000", 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.156e-06 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061958+0000", 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9340000000000002e-06 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061961+0000", 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5040000000000001e-06 2024-09-21T22:02:22.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090862+0000", 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028901175000000001 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090937+0000", 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4881000000000004e-05 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091007+0000", 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0415999999999998e-05 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.236 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85828 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2473984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.111162316000001, 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029127014, 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85828 2024-09-21T22:02:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:02:22.238 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061965+0000", 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061968+0000", 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.92e-06 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061971+0000", 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.101e-06 2024-09-21T22:02:22.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091020+0000", 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029048398999999999 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091056+0000", 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6718000000000003e-05 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091091+0000", 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4501000000000001e-05 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.240 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85829 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2539520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.111112963, 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029251899000000001, 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85829 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.241 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062014+0000", 2024-09-21T22:02:22.242 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062016+0000", 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062022+0000", 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062027+0000", 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2180000000000001e-06 2024-09-21T22:02:22.243 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091120+0000", 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029093112000000001 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091195+0000", 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5499000000000003e-05 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091265+0000", 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9670000000000002e-05 2024-09-21T22:02:22.244 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85830 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2605056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.111093317000002, 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029323741, 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.245 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85830 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:22.246 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062034+0000", 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2729999999999999e-06 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062038+0000", 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.602e-06 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062042+0000", 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9949999999999999e-06 2024-09-21T22:02:22.247 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091283+0000", 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029241195000000001 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091320+0000", 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7296999999999999e-05 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091356+0000", 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6170000000000001e-05 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.248 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85831 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2670592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.111080845, 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029484659999999999, 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85831 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.249 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:22.250 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062047+0000", 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062050+0000", 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1099999999999999e-06 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062052+0000", 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4899999999999999e-06 2024-09-21T22:02:22.251 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091385+0000", 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029333016999999999 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091461+0000", 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6019000000000005e-05 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091530+0000", 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8660999999999999e-05 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.252 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85832 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2736128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.111070814000001, 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029557844999999999, 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.253 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85832 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:22.254 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062057+0000", 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.119e-06 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062060+0000", 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9730000000000002e-06 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062062+0000", 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:02:22.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091542+0000", 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029480309999999999 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091579+0000", 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6254000000000002e-05 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091613+0000", 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4555999999999999e-05 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.256 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85882 3.16 3:6c4a0c3b:::rbd_data.1124f4fa8d1.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 18.024079101000002, 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029882499999999999, 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85882 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.257 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149049+0000", 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.635e-06 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.258 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149054+0000", 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7939999999999999e-06 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149067+0000", 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2587e-05 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149074+0000", 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.25e-06 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.259 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149143+0000", 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9008000000000001e-05 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149216+0000", 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2947000000000005e-05 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149339+0000", 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012293800000000001 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178449+0000", 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029110159 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178861+0000", 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000411808 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178898+0000", 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6745000000000001e-05 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178929+0000", 2024-09-21T22:02:22.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1628999999999998e-05 2024-09-21T22:02:22.262 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.262 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.262 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.262 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.262 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.262 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:22.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:22.264 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:22.261+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:22.273 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:02:22.273 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:22.273 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 105, 2024-09-21T22:02:22.273 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "014f3ec5-afd0-4b18-9c74-de91f34d0760", 2024-09-21T22:02:22.273 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-09-21T22:00:24.916784+0000", 2024-09-21T22:02:22.273 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-09-21T22:02:21.849363+0000", 2024-09-21T22:02:22.273 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-09-21T22:00:36.060631+0000", 2024-09-21T22:02:22.273 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-09-21T22:01:35.858445+0000", 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5806080, 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "nodeep-scrub", 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "noscrub", 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 5, 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:02:22.274 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 3, 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 8, 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "luminous", 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:37.034134+0000", 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:22.275 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:22.276 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "17", 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:22.277 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:22.278 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-09-21T22:02:22.279 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 8, 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 8, 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.25, 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:02:22.280 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:42.753049+0000", 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:22.281 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:22.282 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "21", 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 2, 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 21, 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:22.283 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:22.284 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.9900000095367432, 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.9900000095367432, 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2.630000114440918, 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2.630000114440918, 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.286 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "pool_client.0", 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:52.269263+0000", 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:22.287 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.288 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "105", 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 47, 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 105, 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:22.289 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:22.290 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.7400000095367432, 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.7400000095367432, 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.292 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "ebc4f0b9-33fc-4301-b1c0-ac843b19095b", 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 13, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 66, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6808", 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6809", 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6810", 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6811", 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6814", 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6815", 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.296 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6812", 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6813", 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6809/3559797623", 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6811/3559797623", 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6815/3559797623", 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6813/3559797623", 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:22.297 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "1c8f54fe-439f-486e-8b8b-fe892332ada3", 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 0.1484527587890625, 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:02:22.298 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6824", 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6825", 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.299 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6826", 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6827", 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:22.300 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6830", 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6831", 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.301 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6828", 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6829", 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6825/428384344", 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6827/428384344", 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6831/428384344", 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6829/428384344", 2024-09-21T22:02:22.302 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "b202159c-804c-4d22-9aa3-8f590dce8faa", 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:22.303 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6816", 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6817", 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:22.304 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6818", 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6819", 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6822", 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6823", 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6820", 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6821", 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6817/4237051748", 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6819/4237051748", 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6823/4237051748", 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6821/4237051748", 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "28a8c407-a445-4c76-8d7c-d5a249d13e03", 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:22.308 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 85, 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6800", 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:22.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6801", 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6802", 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:22.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6803", 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6806", 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.311 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6807", 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6804", 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6805", 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:22.312 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6801/3004236595", 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6803/3004236595", 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6807/3004236595", 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6805/3004236595", 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605", 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:22.313 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 66, 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6824", 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:22.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6825", 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6826", 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.315 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6827", 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6830", 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6831", 2024-09-21T22:02:22.316 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6828", 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6829", 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.317 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6825/743062291", 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6827/743062291", 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6831/743062291", 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6829/743062291", 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7a0cc26e-a543-4647-bc53-fbecb69b2326", 2024-09-21T22:02:22.318 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 23, 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.319 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6808", 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6809", 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6810", 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6811", 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6814", 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.321 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6815", 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6812", 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6813", 2024-09-21T22:02:22.322 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6809/2410886219", 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6811/2410886219", 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6815/2410886219", 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6813/2410886219", 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:02:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7768eeb7-c6d0-47d8-a400-c47a2154c590", 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 0, 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 0, 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 48, 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6800", 2024-09-21T22:02:22.324 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6801", 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6802", 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.325 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6803", 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6806", 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.326 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6807", 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6804", 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.327 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6805", 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6801/2491178498", 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6803/2491178498", 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6807/2491178498", 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6805/2491178498", 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "30ed992b-2e99-4523-9fdd-8389f75940af", 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 63, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.329 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6816", 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6817", 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6818", 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6819", 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.331 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6822", 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6823", 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6820", 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:22.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6821", 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6817/1580142875", 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6819/1580142875", 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6823/1580142875", 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6821/1580142875", 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.333 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.652871+0000", 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:22.334 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.866866+0000", 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.859757+0000", 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:22.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:34.082180+0000", 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:22.336 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.844484+0000", 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.746321+0000", 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.337 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 65536, 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.324821+0000", 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:22.338 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.093833+0000", 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [ 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: "pgid": "3.5", 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: 3, 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: 2 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:22.339 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:22.340 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [ 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: "snaps": [ 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: "begin": 31, 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: "length": 10 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [ 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: "snaps": [ 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:22.341 INFO:teuthology.orchestra.run.smithi102.stdout: "begin": 31, 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: "length": 1 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:22.342 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:22.344 INFO:tasks.thrashosds.thrasher:j is {'epoch': 105, 'fsid': '014f3ec5-afd0-4b18-9c74-de91f34d0760', 'created': '2024-09-21T22:00:24.916784+0000', 'modified': '2024-09-21T22:02:21.849363+0000', 'last_up_change': '2024-09-21T22:00:36.060631+0000', 'last_in_change': '2024-09-21T22:01:35.858445+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:00:37.034134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:00:42.753049+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:00:52.269263+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 47, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}], 'osds': [{'osd': 0, 'uuid': 'ebc4f0b9-33fc-4301-b1c0-ac843b19095b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6808', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6809', 'nonce': 3559797623}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6810', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6811', 'nonce': 3559797623}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6814', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6815', 'nonce': 3559797623}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6812', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6813', 'nonce': 3559797623}]}, 'public_addr': '172.21.15.102:6809/3559797623', 'cluster_addr': '172.21.15.102:6811/3559797623', 'heartbeat_back_addr': '172.21.15.102:6815/3559797623', 'heartbeat_front_addr': '172.21.15.102:6813/3559797623', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1c8f54fe-439f-486e-8b8b-fe892332ada3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1484527587890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6824', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6825', 'nonce': 428384344}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6826', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6827', 'nonce': 428384344}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6830', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6831', 'nonce': 428384344}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6828', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6829', 'nonce': 428384344}]}, 'public_addr': '172.21.15.102:6825/428384344', 'cluster_addr': '172.21.15.102:6827/428384344', 'heartbeat_back_addr': '172.21.15.102:6831/428384344', 'heartbeat_front_addr': '172.21.15.102:6829/428384344', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'b202159c-804c-4d22-9aa3-8f590dce8faa', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6816', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6817', 'nonce': 4237051748}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6818', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6819', 'nonce': 4237051748}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6822', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6823', 'nonce': 4237051748}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6820', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6821', 'nonce': 4237051748}]}, 'public_addr': '172.21.15.102:6817/4237051748', 'cluster_addr': '172.21.15.102:6819/4237051748', 'heartbeat_back_addr': '172.21.15.102:6823/4237051748', 'heartbeat_front_addr': '172.21.15.102:6821/4237051748', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '28a8c407-a445-4c76-8d7c-d5a249d13e03', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 85, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 3004236595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 3004236595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 3004236595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 3004236595}]}, 'public_addr': '172.21.15.102:6801/3004236595', 'cluster_addr': '172.21.15.102:6803/3004236595', 'heartbeat_back_addr': '172.21.15.102:6807/3004236595', 'heartbeat_front_addr': '172.21.15.102:6805/3004236595', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6824', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6825', 'nonce': 743062291}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6826', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6827', 'nonce': 743062291}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6830', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6831', 'nonce': 743062291}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6828', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6829', 'nonce': 743062291}]}, 'public_addr': '172.21.15.184:6825/743062291', 'cluster_addr': '172.21.15.184:6827/743062291', 'heartbeat_back_addr': '172.21.15.184:6831/743062291', 'heartbeat_front_addr': '172.21.15.184:6829/743062291', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '7a0cc26e-a543-4647-bc53-fbecb69b2326', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6808', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6809', 'nonce': 2410886219}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6810', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6811', 'nonce': 2410886219}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6814', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6815', 'nonce': 2410886219}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6812', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6813', 'nonce': 2410886219}]}, 'public_addr': '172.21.15.184:6809/2410886219', 'cluster_addr': '172.21.15.184:6811/2410886219', 'heartbeat_back_addr': '172.21.15.184:6815/2410886219', 'heartbeat_front_addr': '172.21.15.184:6813/2410886219', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '7768eeb7-c6d0-47d8-a400-c47a2154c590', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6800', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6801', 'nonce': 2491178498}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6802', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6803', 'nonce': 2491178498}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6806', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6807', 'nonce': 2491178498}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6804', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6805', 'nonce': 2491178498}]}, 'public_addr': '172.21.15.184:6801/2491178498', 'cluster_addr': '172.21.15.184:6803/2491178498', 'heartbeat_back_addr': '172.21.15.184:6807/2491178498', 'heartbeat_front_addr': '172.21.15.184:6805/2491178498', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '30ed992b-2e99-4523-9fdd-8389f75940af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6816', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6817', 'nonce': 1580142875}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6818', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6819', 'nonce': 1580142875}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6822', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6823', 'nonce': 1580142875}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6820', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6821', 'nonce': 1580142875}]}, 'public_addr': '172.21.15.184:6817/1580142875', 'cluster_addr': '172.21.15.184:6819/1580142875', 'heartbeat_back_addr': '172.21.15.184:6823/1580142875', 'heartbeat_front_addr': '172.21.15.184:6821/1580142875', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.652871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.866866+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.859757+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:34.082180+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.844484+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.746321+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.324821+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.093833+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.5', 'osds': [3, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 31, 'length': 10}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 31, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:02:22.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:02:22.388 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:22.386+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:22.445 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:22.445 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:22.445 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:22.446 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:22.454 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:22.496 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:22.494+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:22.565 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:22.564+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:22.598 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:22.599 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:22.599 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:22.599 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:22.599 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:22.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:22.658 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:02:22.659 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:02:22.667 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:22.666+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:22.671 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-21T22:02:21.858334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1594064696,"num_objects":1215,"num_object_clones":325,"num_object_copies":2430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1215,"num_whiteouts":349,"num_read":132480,"num_read_kb":754509,"num_write":19871,"num_write_kb":438090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":324,"num_bytes_recovered":30603674,"num_keys_recovered":83,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16512,"ondisk_log_size":16512,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":364284,"kb_used_data":51308,"kb_used_omap":10,"kb_used_meta":312565,"kb_avail":660238596,"statfs":{"total":676457349120,"available":676084322304,"internally_reserved":0,"allocated":52539392,"data_stored":468170697,"data_compressed":15692168,"data_compressed_allocated":36724736,"data_compressed_original":460097058,"omap_allocated":11156,"internal_metadata":320066668},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-30337014,"num_objects":-36,"num_object_clones":-11,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":-8,"num_read":358,"num_read_kb":299,"num_write":39,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039054"},"pg_stats":[{"pgid":"3.1f","version":"104'357","reported_seq":2075,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T22:02:21.002253+0000","last_change":"2024-09-21T22:02:20.857185+0000","last_active":"2024-09-21T22:02:21.002253+0000","last_peered":"2024-09-21T22:02:21.002253+0000","last_clean":"2024-09-21T22:02:21.002253+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:02:21.002253+0000","last_undegraded":"2024-09-21T22:02:21.002253+0000","last_fullsized":"2024-09-21T22:02:21.002253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:49.645351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089864220000000009,"stat_sum":{"num_bytes":15549962,"num_objects":30,"num_object_clones":6,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":2788,"num_read_kb":17686,"num_write":373,"num_write_kb":16602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"9"}]},{"pgid":"3.1e","version":"100'556","reported_seq":2514,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.822853+0000","last_change":"2024-09-21T22:02:16.822853+0000","last_active":"2024-09-21T22:02:16.822853+0000","last_peered":"2024-09-21T22:02:16.822853+0000","last_clean":"2024-09-21T22:02:16.822853+0000","last_became_active":"2024-09-21T22:01:39.893876+0000","last_became_peered":"2024-09-21T22:01:39.893876+0000","last_unstale":"2024-09-21T22:02:16.822853+0000","last_undegraded":"2024-09-21T22:02:16.822853+0000","last_fullsized":"2024-09-21T22:02:16.822853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:32:58.208581+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0068192629999999999,"stat_sum":{"num_bytes":59709259,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":11,"num_read":3377,"num_read_kb":17565,"num_write":740,"num_write_kb":7987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":4275862,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.1d","version":"100'1137","reported_seq":3938,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.922985+0000","last_change":"2024-09-21T22:02:16.828206+0000","last_active":"2024-09-21T22:02:16.922985+0000","last_peered":"2024-09-21T22:02:16.922985+0000","last_clean":"2024-09-21T22:02:16.922985+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:02:16.922985+0000","last_undegraded":"2024-09-21T22:02:16.922985+0000","last_fullsized":"2024-09-21T22:02:16.922985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:12:52.926957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011803899999999999,"stat_sum":{"num_bytes":34763646,"num_objects":47,"num_object_clones":15,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":15,"num_read":8713,"num_read_kb":25571,"num_write":1473,"num_write_kb":17105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.1c","version":"100'439","reported_seq":5787,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.912877+0000","last_change":"2024-09-21T22:02:16.827805+0000","last_active":"2024-09-21T22:02:16.912877+0000","last_peered":"2024-09-21T22:02:16.912877+0000","last_clean":"2024-09-21T22:02:16.912877+0000","last_became_active":"2024-09-21T22:00:54.161171+0000","last_became_peered":"2024-09-21T22:00:54.161171+0000","last_unstale":"2024-09-21T22:02:16.912877+0000","last_undegraded":"2024-09-21T22:02:16.912877+0000","last_fullsized":"2024-09-21T22:02:16.912877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:12:18.572942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093298100000000004,"stat_sum":{"num_bytes":76573355,"num_objects":44,"num_object_clones":13,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":11,"num_read":5866,"num_read_kb":34355,"num_write":521,"num_write_kb":23356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.1b","version":"101'398","reported_seq":2207,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T22:02:20.856247+0000","last_change":"2024-09-21T22:02:20.856409+0000","last_active":"2024-09-21T22:02:20.856247+0000","last_peered":"2024-09-21T22:02:20.856247+0000","last_clean":"2024-09-21T22:02:20.856247+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:02:20.856247+0000","last_undegraded":"2024-09-21T22:02:20.856247+0000","last_fullsized":"2024-09-21T22:02:20.856247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:41:28.334588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089799140000000003,"stat_sum":{"num_bytes":35747873,"num_objects":19,"num_object_clones":5,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":6,"num_read":2374,"num_read_kb":22184,"num_write":503,"num_write_kb":15124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"9"}]},{"pgid":"3.1a","version":"97'684","reported_seq":5107,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.922585+0000","last_change":"2024-09-21T22:02:16.815522+0000","last_active":"2024-09-21T22:02:16.922585+0000","last_peered":"2024-09-21T22:02:16.922585+0000","last_clean":"2024-09-21T22:02:16.922585+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:02:16.922585+0000","last_undegraded":"2024-09-21T22:02:16.922585+0000","last_fullsized":"2024-09-21T22:02:16.922585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:48:02.188037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033697760000000001,"stat_sum":{"num_bytes":20388585,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":13,"num_read":8169,"num_read_kb":14138,"num_write":900,"num_write_kb":7262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.19","version":"98'652","reported_seq":4924,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.809003+0000","last_change":"2024-09-21T22:02:16.809420+0000","last_active":"2024-09-21T22:02:16.809003+0000","last_peered":"2024-09-21T22:02:16.809003+0000","last_clean":"2024-09-21T22:02:16.809003+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:02:16.809003+0000","last_undegraded":"2024-09-21T22:02:16.809003+0000","last_fullsized":"2024-09-21T22:02:16.809003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:12:39.939982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000640878,"stat_sum":{"num_bytes":45705255,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":12,"num_read":6255,"num_read_kb":21154,"num_write":861,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.18","version":"100'342","reported_seq":2894,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.817830+0000","last_change":"2024-09-21T22:02:16.818446+0000","last_active":"2024-09-21T22:02:16.817830+0000","last_peered":"2024-09-21T22:02:16.817830+0000","last_clean":"2024-09-21T22:02:16.817830+0000","last_became_active":"2024-09-21T22:00:54.155140+0000","last_became_peered":"2024-09-21T22:00:54.155140+0000","last_unstale":"2024-09-21T22:02:16.817830+0000","last_undegraded":"2024-09-21T22:02:16.817830+0000","last_fullsized":"2024-09-21T22:02:16.817830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:38:46.528865+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025985740000000002,"stat_sum":{"num_bytes":66827738,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":11,"num_read":3034,"num_read_kb":25024,"num_write":322,"num_write_kb":14558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.17","version":"104'386","reported_seq":3100,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T22:02:20.968466+0000","last_change":"2024-09-21T22:02:20.857429+0000","last_active":"2024-09-21T22:02:20.968466+0000","last_peered":"2024-09-21T22:02:20.968466+0000","last_clean":"2024-09-21T22:02:20.968466+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:02:20.968466+0000","last_undegraded":"2024-09-21T22:02:20.968466+0000","last_fullsized":"2024-09-21T22:02:20.968466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:27:25.036273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0090528009999999992,"stat_sum":{"num_bytes":29011624,"num_objects":41,"num_object_clones":10,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":4345,"num_read_kb":36599,"num_write":367,"num_write_kb":23149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"9"}]},{"pgid":"3.16","version":"99'468","reported_seq":5046,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.828270+0000","last_change":"2024-09-21T22:02:16.828911+0000","last_active":"2024-09-21T22:02:16.828270+0000","last_peered":"2024-09-21T22:02:16.828270+0000","last_clean":"2024-09-21T22:02:16.828270+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:02:16.828270+0000","last_undegraded":"2024-09-21T22:02:16.828270+0000","last_fullsized":"2024-09-21T22:02:16.828270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:35.185846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018827080000000001,"stat_sum":{"num_bytes":67857322,"num_objects":46,"num_object_clones":15,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":14,"num_read":5379,"num_read_kb":30481,"num_write":543,"num_write_kb":12130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.15","version":"100'324","reported_seq":1979,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.817799+0000","last_change":"2024-09-21T22:02:16.817799+0000","last_active":"2024-09-21T22:02:16.817799+0000","last_peered":"2024-09-21T22:02:16.817799+0000","last_clean":"2024-09-21T22:02:16.817799+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:02:16.817799+0000","last_undegraded":"2024-09-21T22:02:16.817799+0000","last_fullsized":"2024-09-21T22:02:16.817799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:51.637543+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.008703466,"stat_sum":{"num_bytes":53554717,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":10,"num_read":2180,"num_read_kb":16266,"num_write":378,"num_write_kb":14123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.14","version":"98'425","reported_seq":2642,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.812729+0000","last_change":"2024-09-21T22:02:16.813164+0000","last_active":"2024-09-21T22:02:16.812729+0000","last_peered":"2024-09-21T22:02:16.812729+0000","last_clean":"2024-09-21T22:02:16.812729+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:02:16.812729+0000","last_undegraded":"2024-09-21T22:02:16.812729+0000","last_fullsized":"2024-09-21T22:02:16.812729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:23:15.583546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012741950000000001,"stat_sum":{"num_bytes":45054421,"num_objects":45,"num_object_clones":14,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":3271,"num_read_kb":22821,"num_write":442,"num_write_kb":9979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"2.7","version":"0'0","reported_seq":128,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.809317+0000","last_change":"2024-09-21T22:01:36.874875+0000","last_active":"2024-09-21T22:02:16.809317+0000","last_peered":"2024-09-21T22:02:16.809317+0000","last_clean":"2024-09-21T22:02:16.809317+0000","last_became_active":"2024-09-21T22:01:36.874561+0000","last_became_peered":"2024-09-21T22:01:36.874561+0000","last_unstale":"2024-09-21T22:02:16.809317+0000","last_undegraded":"2024-09-21T22:02:16.809317+0000","last_fullsized":"2024-09-21T22:02:16.809317+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:00:04.279405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"104'582","reported_seq":3384,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T22:02:20.856940+0000","last_change":"2024-09-21T22:02:20.856940+0000","last_active":"2024-09-21T22:02:20.856940+0000","last_peered":"2024-09-21T22:02:20.856940+0000","last_clean":"2024-09-21T22:02:20.856940+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:02:20.856940+0000","last_undegraded":"2024-09-21T22:02:20.856940+0000","last_fullsized":"2024-09-21T22:02:20.856940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:31.434218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0089334779999999999,"stat_sum":{"num_bytes":57989523,"num_objects":34,"num_object_clones":12,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":9,"num_read":4558,"num_read_kb":30084,"num_write":718,"num_write_kb":21384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"9"}]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.811888+0000","last_change":"2024-09-21T22:01:36.878078+0000","last_active":"2024-09-21T22:02:16.811888+0000","last_peered":"2024-09-21T22:02:16.811888+0000","last_clean":"2024-09-21T22:02:16.811888+0000","last_became_active":"2024-09-21T22:01:36.877817+0000","last_became_peered":"2024-09-21T22:01:36.877817+0000","last_unstale":"2024-09-21T22:02:16.811888+0000","last_undegraded":"2024-09-21T22:02:16.811888+0000","last_fullsized":"2024-09-21T22:02:16.811888+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:28:22.652563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"100'365","reported_seq":2383,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.818314+0000","last_change":"2024-09-21T22:02:16.819820+0000","last_active":"2024-09-21T22:02:16.818314+0000","last_peered":"2024-09-21T22:02:16.818314+0000","last_clean":"2024-09-21T22:02:16.818314+0000","last_became_active":"2024-09-21T22:00:54.162377+0000","last_became_peered":"2024-09-21T22:00:54.162377+0000","last_unstale":"2024-09-21T22:02:16.818314+0000","last_undegraded":"2024-09-21T22:02:16.818314+0000","last_fullsized":"2024-09-21T22:02:16.818314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:49:35.328163+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0039751049999999996,"stat_sum":{"num_bytes":17797803,"num_objects":24,"num_object_clones":5,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":9,"num_read":3234,"num_read_kb":17928,"num_write":339,"num_write_kb":12034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"2.5","version":"0'0","reported_seq":177,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.809310+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:02:16.809310+0000","last_peered":"2024-09-21T22:02:16.809310+0000","last_clean":"2024-09-21T22:02:16.809310+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:02:16.809310+0000","last_undegraded":"2024-09-21T22:02:16.809310+0000","last_fullsized":"2024-09-21T22:02:16.809310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"98'1130","reported_seq":5983,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.819226+0000","last_change":"2024-09-21T22:02:16.820431+0000","last_active":"2024-09-21T22:02:16.819226+0000","last_peered":"2024-09-21T22:02:16.819226+0000","last_clean":"2024-09-21T22:02:16.819226+0000","last_became_active":"2024-09-21T22:00:54.158128+0000","last_became_peered":"2024-09-21T22:00:54.158128+0000","last_unstale":"2024-09-21T22:02:16.819226+0000","last_undegraded":"2024-09-21T22:02:16.819226+0000","last_fullsized":"2024-09-21T22:02:16.819226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1130,"log_dups_size":0,"ondisk_log_size":1130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:34.523478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014956940000000001,"stat_sum":{"num_bytes":79901451,"num_objects":37,"num_object_clones":8,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":10,"num_read":10445,"num_read_kb":38367,"num_write":1634,"num_write_kb":13490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T22:02:20.846836+0000","last_change":"2024-09-21T22:00:54.156721+0000","last_active":"2024-09-21T22:02:20.846836+0000","last_peered":"2024-09-21T22:02:20.846836+0000","last_clean":"2024-09-21T22:02:20.846836+0000","last_became_active":"2024-09-21T22:00:54.156336+0000","last_became_peered":"2024-09-21T22:00:54.156336+0000","last_unstale":"2024-09-21T22:02:20.846836+0000","last_undegraded":"2024-09-21T22:02:20.846836+0000","last_fullsized":"2024-09-21T22:02:20.846836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:54:12.268488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"97'495","reported_seq":2851,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.823167+0000","last_change":"2024-09-21T22:02:16.823674+0000","last_active":"2024-09-21T22:02:16.823167+0000","last_peered":"2024-09-21T22:02:16.823167+0000","last_clean":"2024-09-21T22:02:16.823167+0000","last_became_active":"2024-09-21T22:02:02.725129+0000","last_became_peered":"2024-09-21T22:02:02.725129+0000","last_unstale":"2024-09-21T22:02:16.823167+0000","last_undegraded":"2024-09-21T22:02:16.823167+0000","last_fullsized":"2024-09-21T22:02:16.823167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:55:11.598984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0073207109999999997,"stat_sum":{"num_bytes":52941426,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":11,"num_read":3529,"num_read_kb":19955,"num_write":639,"num_write_kb":14122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":5422902,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.3","version":"100'459","reported_seq":2406,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.903617+0000","last_change":"2024-09-21T22:02:16.814336+0000","last_active":"2024-09-21T22:02:16.903617+0000","last_peered":"2024-09-21T22:02:16.903617+0000","last_clean":"2024-09-21T22:02:16.903617+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:02:16.903617+0000","last_undegraded":"2024-09-21T22:02:16.903617+0000","last_fullsized":"2024-09-21T22:02:16.903617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:20:47.603986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023933349999999999,"stat_sum":{"num_bytes":57822219,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":11,"num_read":2719,"num_read_kb":18614,"num_write":517,"num_write_kb":12417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"2.2","version":"21'2","reported_seq":179,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.826850+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:02:16.826850+0000","last_peered":"2024-09-21T22:02:16.826850+0000","last_clean":"2024-09-21T22:02:16.826850+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:02:16.826850+0000","last_undegraded":"2024-09-21T22:02:16.826850+0000","last_fullsized":"2024-09-21T22:02:16.826850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"100'351","reported_seq":2252,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.822223+0000","last_change":"2024-09-21T22:02:16.822223+0000","last_active":"2024-09-21T22:02:16.822223+0000","last_peered":"2024-09-21T22:02:16.822223+0000","last_clean":"2024-09-21T22:02:16.822223+0000","last_became_active":"2024-09-21T22:00:54.156923+0000","last_became_peered":"2024-09-21T22:00:54.156923+0000","last_unstale":"2024-09-21T22:02:16.822223+0000","last_undegraded":"2024-09-21T22:02:16.822223+0000","last_fullsized":"2024-09-21T22:02:16.822223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:01:50.455441+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0033203040000000001,"stat_sum":{"num_bytes":65953717,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":10,"num_read":2506,"num_read_kb":15791,"num_write":322,"num_write_kb":10215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.818898+0000","last_change":"2024-09-21T22:00:46.188179+0000","last_active":"2024-09-21T22:02:16.818898+0000","last_peered":"2024-09-21T22:02:16.818898+0000","last_clean":"2024-09-21T22:02:16.818898+0000","last_became_active":"2024-09-21T22:00:44.110407+0000","last_became_peered":"2024-09-21T22:00:44.110407+0000","last_unstale":"2024-09-21T22:02:16.818898+0000","last_undegraded":"2024-09-21T22:02:16.818898+0000","last_fullsized":"2024-09-21T22:02:16.818898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:37:32.295887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046236900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"104'217","reported_seq":1451,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T22:02:20.858928+0000","last_change":"2024-09-21T22:02:20.858928+0000","last_active":"2024-09-21T22:02:20.858928+0000","last_peered":"2024-09-21T22:02:20.858928+0000","last_clean":"2024-09-21T22:02:20.858928+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:02:20.858928+0000","last_undegraded":"2024-09-21T22:02:20.858928+0000","last_fullsized":"2024-09-21T22:02:20.858928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:45:39.189963+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.012057382,"stat_sum":{"num_bytes":19166513,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":9,"num_read":1010,"num_read_kb":21081,"num_write":201,"num_write_kb":9611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"9"}]},{"pgid":"2.0","version":"0'0","reported_seq":177,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.808909+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:02:16.808909+0000","last_peered":"2024-09-21T22:02:16.808909+0000","last_clean":"2024-09-21T22:02:16.808909+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:02:16.808909+0000","last_undegraded":"2024-09-21T22:02:16.808909+0000","last_fullsized":"2024-09-21T22:02:16.808909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"98'455","reported_seq":2266,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.816103+0000","last_change":"2024-09-21T22:02:16.816401+0000","last_active":"2024-09-21T22:02:16.816103+0000","last_peered":"2024-09-21T22:02:16.816103+0000","last_clean":"2024-09-21T22:02:16.816103+0000","last_became_active":"2024-09-21T22:00:54.157660+0000","last_became_peered":"2024-09-21T22:00:54.157660+0000","last_unstale":"2024-09-21T22:02:16.816103+0000","last_undegraded":"2024-09-21T22:02:16.816103+0000","last_fullsized":"2024-09-21T22:02:16.816103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:32.783635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0005867,"stat_sum":{"num_bytes":60271210,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":11,"num_read":3484,"num_read_kb":17531,"num_write":397,"num_write_kb":10967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"2.3","version":"19'1","reported_seq":178,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.826757+0000","last_change":"2024-09-21T22:00:46.122354+0000","last_active":"2024-09-21T22:02:16.826757+0000","last_peered":"2024-09-21T22:02:16.826757+0000","last_clean":"2024-09-21T22:02:16.826757+0000","last_became_active":"2024-09-21T22:00:44.110191+0000","last_became_peered":"2024-09-21T22:00:44.110191+0000","last_unstale":"2024-09-21T22:02:16.826757+0000","last_undegraded":"2024-09-21T22:02:16.826757+0000","last_fullsized":"2024-09-21T22:02:16.826757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:21:50.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":328,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.808914+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:02:16.808914+0000","last_peered":"2024-09-21T22:02:16.808914+0000","last_clean":"2024-09-21T22:02:16.808914+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:02:16.808914+0000","last_undegraded":"2024-09-21T22:02:16.808914+0000","last_fullsized":"2024-09-21T22:02:16.808914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"100'581","reported_seq":6791,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.934660+0000","last_change":"2024-09-21T22:02:16.824018+0000","last_active":"2024-09-21T22:02:16.934660+0000","last_peered":"2024-09-21T22:02:16.934660+0000","last_clean":"2024-09-21T22:02:16.934660+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:02:16.934660+0000","last_undegraded":"2024-09-21T22:02:16.934660+0000","last_fullsized":"2024-09-21T22:02:16.934660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:43:51.757318+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0080991039999999993,"stat_sum":{"num_bytes":85178770,"num_objects":56,"num_object_clones":16,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":19,"num_read":8280,"num_read_kb":26427,"num_write":657,"num_write_kb":11542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.9","version":"100'502","reported_seq":3597,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.893910+0000","last_change":"2024-09-21T22:02:16.812646+0000","last_active":"2024-09-21T22:02:16.893910+0000","last_peered":"2024-09-21T22:02:16.893910+0000","last_clean":"2024-09-21T22:02:16.893910+0000","last_became_active":"2024-09-21T22:00:54.160321+0000","last_became_peered":"2024-09-21T22:00:54.160321+0000","last_unstale":"2024-09-21T22:02:16.893910+0000","last_undegraded":"2024-09-21T22:02:16.893910+0000","last_fullsized":"2024-09-21T22:02:16.893910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:59:35.507162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083380499999999996,"stat_sum":{"num_bytes":34591865,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":6,"num_read":5123,"num_read_kb":33303,"num_write":525,"num_write_kb":16655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.a","version":"100'465","reported_seq":1664,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.815945+0000","last_change":"2024-09-21T22:02:16.815945+0000","last_active":"2024-09-21T22:02:16.815945+0000","last_peered":"2024-09-21T22:02:16.815945+0000","last_clean":"2024-09-21T22:02:16.815945+0000","last_became_active":"2024-09-21T22:01:39.894341+0000","last_became_peered":"2024-09-21T22:01:39.894341+0000","last_unstale":"2024-09-21T22:02:16.815945+0000","last_undegraded":"2024-09-21T22:02:16.815945+0000","last_fullsized":"2024-09-21T22:02:16.815945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:52:10.929884+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.004077308,"stat_sum":{"num_bytes":75157121,"num_objects":42,"num_object_clones":10,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":16,"num_read":2794,"num_read_kb":9213,"num_write":474,"num_write_kb":9055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.b","version":"100'294","reported_seq":1582,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.936979+0000","last_change":"2024-09-21T22:02:16.818876+0000","last_active":"2024-09-21T22:02:16.936979+0000","last_peered":"2024-09-21T22:02:16.936979+0000","last_clean":"2024-09-21T22:02:16.936979+0000","last_became_active":"2024-09-21T22:00:54.156515+0000","last_became_peered":"2024-09-21T22:00:54.156515+0000","last_unstale":"2024-09-21T22:02:16.936979+0000","last_undegraded":"2024-09-21T22:02:16.936979+0000","last_fullsized":"2024-09-21T22:02:16.936979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:48:12.954460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029996480000000002,"stat_sum":{"num_bytes":56066038,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":8,"num_read":1242,"num_read_kb":20189,"num_write":316,"num_write_kb":15448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.c","version":"100'793","reported_seq":3038,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.830657+0000","last_change":"2024-09-21T22:02:16.830892+0000","last_active":"2024-09-21T22:02:16.830657+0000","last_peered":"2024-09-21T22:02:16.830657+0000","last_clean":"2024-09-21T22:02:16.830657+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:02:16.830657+0000","last_undegraded":"2024-09-21T22:02:16.830657+0000","last_fullsized":"2024-09-21T22:02:16.830657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:05.785740+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.0038767020000000001,"stat_sum":{"num_bytes":43558981,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":9,"num_read":4470,"num_read_kb":24869,"num_write":1016,"num_write_kb":15147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.d","version":"99'300","reported_seq":4338,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.816492+0000","last_change":"2024-09-21T22:02:16.816745+0000","last_active":"2024-09-21T22:02:16.816492+0000","last_peered":"2024-09-21T22:02:16.816492+0000","last_clean":"2024-09-21T22:02:16.816492+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:02:16.816492+0000","last_undegraded":"2024-09-21T22:02:16.816492+0000","last_fullsized":"2024-09-21T22:02:16.816492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:22:02.113340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007383199,"stat_sum":{"num_bytes":74978200,"num_objects":29,"num_object_clones":8,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":7,"num_read":4476,"num_read_kb":19373,"num_write":263,"num_write_kb":6594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.e","version":"99'722","reported_seq":2377,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.816809+0000","last_change":"2024-09-21T22:02:16.817097+0000","last_active":"2024-09-21T22:02:16.816809+0000","last_peered":"2024-09-21T22:02:16.816809+0000","last_clean":"2024-09-21T22:02:16.816809+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:02:16.816809+0000","last_undegraded":"2024-09-21T22:02:16.816809+0000","last_fullsized":"2024-09-21T22:02:16.816809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:02:16.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077349849999999998,"stat_sum":{"num_bytes":30273337,"num_objects":25,"num_object_clones":4,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":7,"num_read":4455,"num_read_kb":15525,"num_write":1088,"num_write_kb":6695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.f","version":"100'824","reported_seq":2369,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.816422+0000","last_change":"2024-09-21T22:02:16.816422+0000","last_active":"2024-09-21T22:02:16.816422+0000","last_peered":"2024-09-21T22:02:16.816422+0000","last_clean":"2024-09-21T22:02:16.816422+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:02:16.816422+0000","last_undegraded":"2024-09-21T22:02:16.816422+0000","last_fullsized":"2024-09-21T22:02:16.816422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:36:48.676325+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0072622889999999999,"stat_sum":{"num_bytes":90846170,"num_objects":48,"num_object_clones":11,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":8,"num_read":3930,"num_read_kb":17599,"num_write":1142,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.10","version":"104'275","reported_seq":1119,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T22:02:20.856198+0000","last_change":"2024-09-21T22:02:20.856198+0000","last_active":"2024-09-21T22:02:20.856198+0000","last_peered":"2024-09-21T22:02:20.856198+0000","last_clean":"2024-09-21T22:02:20.856198+0000","last_became_active":"2024-09-21T22:01:39.894085+0000","last_became_peered":"2024-09-21T22:01:39.894085+0000","last_unstale":"2024-09-21T22:02:20.856198+0000","last_undegraded":"2024-09-21T22:02:20.856198+0000","last_fullsized":"2024-09-21T22:02:20.856198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:22:59.160942+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0093379650000000002,"stat_sum":{"num_bytes":25869198,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":14,"num_read":779,"num_read_kb":16087,"num_write":263,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"9"}]},{"pgid":"3.11","version":"100'693","reported_seq":3158,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.889694+0000","last_change":"2024-09-21T22:02:16.813478+0000","last_active":"2024-09-21T22:02:16.889694+0000","last_peered":"2024-09-21T22:02:16.889694+0000","last_clean":"2024-09-21T22:02:16.889694+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:02:16.889694+0000","last_undegraded":"2024-09-21T22:02:16.889694+0000","last_fullsized":"2024-09-21T22:02:16.889694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:42:17.456532+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0044512909999999996,"stat_sum":{"num_bytes":41370573,"num_objects":44,"num_object_clones":14,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":14,"num_read":4563,"num_read_kb":48093,"num_write":992,"num_write_kb":22094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"24","length":"6"}]},{"pgid":"3.12","version":"104'428","reported_seq":2034,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T22:02:21.001834+0000","last_change":"2024-09-21T22:02:20.856649+0000","last_active":"2024-09-21T22:02:21.001834+0000","last_peered":"2024-09-21T22:02:21.001834+0000","last_clean":"2024-09-21T22:02:21.001834+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:02:21.001834+0000","last_undegraded":"2024-09-21T22:02:21.001834+0000","last_fullsized":"2024-09-21T22:02:21.001834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:02:22.013502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.008827662,"stat_sum":{"num_bytes":22385152,"num_objects":27,"num_object_clones":9,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":8,"num_read":2583,"num_read_kb":25884,"num_write":524,"num_write_kb":11319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"20","length":"9"}]},{"pgid":"3.13","version":"100'293","reported_seq":2586,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-21T22:02:16.813805+0000","last_change":"2024-09-21T22:02:16.813805+0000","last_active":"2024-09-21T22:02:16.813805+0000","last_peered":"2024-09-21T22:02:16.813805+0000","last_clean":"2024-09-21T22:02:16.813805+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:02:16.813805+0000","last_undegraded":"2024-09-21T22:02:16.813805+0000","last_fullsized":"2024-09-21T22:02:16.813805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:39:12.792974+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0046767789999999998,"stat_sum":{"num_bytes":50611285,"num_objects":44,"num_object_clones":16,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":15,"num_read":2433,"num_read_kb":34652,"num_write":260,"num_write_kb":13161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"24","length":"6"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1593474309,"num_objects":1211,"num_object_clones":325,"num_object_copies":2422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1211,"num_whiteouts":349,"num_read":132364,"num_read_kb":754409,"num_write":19710,"num_write_kb":435672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":324,"num_bytes_recovered":30603674,"num_keys_recovered":83,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44605440,"data_stored":457726630,"data_compressed":15767205,"data_compressed_allocated":36823040,"data_compressed_original":453410392,"omap_allocated":0,"internal_metadata":0},"log_size":16392,"ondisk_log_size":16392,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57180,"kb_used_data":7936,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314660,"statfs":{"total":96636764160,"available":96578211840,"internally_reserved":0,"allocated":8126464,"data_stored":72471754,"data_compressed":2670519,"data_compressed_allocated":5799936,"data_compressed_original":71256987,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":0,"seq":60129542168,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38764,"kb_used_data":7572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333076,"statfs":{"total":96636764160,"available":96597069824,"internally_reserved":0,"allocated":7753728,"data_stored":73729118,"data_compressed":1967687,"data_compressed_allocated":5652480,"data_compressed_original":72713149,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82900,"kb_used_data":11308,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94288940,"statfs":{"total":96636764160,"available":96551874560,"internally_reserved":0,"allocated":11579392,"data_stored":110246120,"data_compressed":3532410,"data_compressed_allocated":8810496,"data_compressed_original":108799231,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55772,"kb_used_data":6536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316068,"statfs":{"total":96636764160,"available":96579653632,"internally_reserved":0,"allocated":6692864,"data_stored":51549751,"data_compressed":2076594,"data_compressed_allocated":4304896,"data_compressed_original":50347075,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43808,"kb_used_data":4248,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328032,"statfs":{"total":96636764160,"available":96591904768,"internally_reserved":0,"allocated":4349952,"data_stored":30119017,"data_compressed":1332194,"data_compressed_allocated":2457600,"data_compressed_original":29159912,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50464,"kb_used_data":5336,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94321376,"statfs":{"total":96636764160,"available":96585089024,"internally_reserved":0,"allocated":5464064,"data_stored":34743859,"data_compressed":1779006,"data_compressed_allocated":3301376,"data_compressed_original":33646893,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35396,"kb_used_data":8372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336444,"statfs":{"total":96636764160,"available":96600518656,"internally_reserved":0,"allocated":8572928,"data_stored":95311078,"data_compressed":2333758,"data_compressed_allocated":6397952,"data_compressed_original":94173811,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7282688,"data_stored":94141025,"data_compressed":2328826,"data_compressed_allocated":6361088,"data_compressed_original":93600371,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4149248,"data_stored":30427171,"data_compressed":1743647,"data_compressed_allocated":3162112,"data_compressed_original":29878573,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3104768,"data_stored":27702855,"data_compressed":1320467,"data_compressed_allocated":2387968,"data_compressed_original":27292136,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5349376,"data_stored":49115906,"data_compressed":2055431,"data_compressed_allocated":4165632,"data_compressed_original":48479299,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9977856,"data_stored":103749877,"data_compressed":3338256,"data_compressed_allocated":8392704,"data_compressed_original":102854938,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6483968,"data_stored":72776142,"data_compressed":1912501,"data_compressed_allocated":5574656,"data_compressed_original":72319933,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1712128,"data_stored":15477582,"data_compressed":532173,"data_compressed_allocated":1368064,"data_compressed_original":15298560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6545408,"data_stored":64336072,"data_compressed":2535904,"data_compressed_allocated":5410816,"data_compressed_original":63686582,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:02:22.673 INFO:tasks.thrashosds.thrasher:Setting 3.1c to [7, 3] 2024-09-21T22:02:22.673 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1c', '7', '3'] 2024-09-21T22:02:22.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1c 7 3 2024-09-21T22:02:22.753 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:22.753 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:22.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.907926240000002, 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:02:22.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:02:22.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:02:22.756 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:02:22.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:02:22.759 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.909014726999999, 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:02:22.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:02:22.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:02:22.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.80055797, 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:02:22.766 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.770 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.800548677000002, 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:02:22.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.772 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:02:22.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:02:22.774 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.800524930999998, 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.776 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:02:22.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:02:22.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.800514378000003, 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.779 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.800504975000003, 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.783 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:02:22.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:02:22.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.800494184999998, 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.787 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:22.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:02:22.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:02:22.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.800460911999998, 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.791 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.792 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.800450240000004, 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.795 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.796320749000003, 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.799 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:02:22.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:02:22.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.795921610999997, 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.803 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:22.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:22.807 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.794967020000001, 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.794943766999999, 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:22.815 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.793651097000001, 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:22.819 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.793631984000001, 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:22.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.823 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.793612854000003, 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.824 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.793594515999999, 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.828 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.832 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 62.793576117000001, 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.836 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:41899 3.10 3:0bb333a9:::rbd_data.11247a90fb52.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 53.996666705999999, 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015085853, 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 41899 2024-09-21T22:02:22.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754789+0000", 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.372e-06 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754796+0000", 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8249999999999999e-06 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754809+0000", 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3662000000000001e-05 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754816+0000", 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7220000000000002e-06 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754866+0000", 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9945999999999999e-05 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754919+0000", 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3329999999999999e-05 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.758040+0000", 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031204869999999999 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769752+0000", 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011712530000000001 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769803+0000", 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.117e-05 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769841+0000", 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7982999999999999e-05 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769873+0000", 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1826000000000003e-05 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:22.842 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:22.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:22.844 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:22.842+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:22.859 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:02:22.944 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:22.943+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:22.997 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:22.997 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:22.998 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:22.998 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:23.006 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:23.050 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:23.048+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:23.110 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:23.110 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:23.110 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:23.110 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:23.110 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:23.119 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:23.160 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:23.158+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:23.246 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:23.244+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 105.189422455, 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.265 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:02:23.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:02:23.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:02:23.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:02:23.272 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.757386203999999, 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:02:23.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:02:23.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:02:23.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.278 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.278 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:23.278 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 65.404559387000006, 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.282 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 65.404539924000005, 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.283 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:02:23.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 65.404511846999995, 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:02:23.287 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:02:23.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.291 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 65.404490014999993, 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:02:23.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:02:23.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 65.404469688000006, 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.296 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 65.404448725999998, 2024-09-21T22:02:23.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:23.304 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 65.404427738999999, 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:23.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:02:23.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:02:23.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29863 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 3031040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 65.369470759999999, 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023866634000000001, 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29863 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.309 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893334+0000", 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893339+0000", 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893345+0000", 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1469999999999998e-06 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893356+0000", 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0772e-05 2024-09-21T22:02:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917062+0000", 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023706261999999999 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917108+0000", 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5318000000000002e-05 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917200+0000", 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2238999999999996e-05 2024-09-21T22:02:23.312 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 42.462980944999998, 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.313 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:02:23.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:23.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81730 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7127040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.089360548999998, 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023997688999999999, 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81730 2024-09-21T22:02:23.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173444+0000", 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173450+0000", 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173456+0000", 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0599999999999996e-06 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173461+0000", 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5279999999999997e-06 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197301+0000", 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023840647 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197353+0000", 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2222000000000002e-05 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197441+0000", 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81734 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.089325116000001, 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024110228000000001, 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81734 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173482+0000", 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.136e-06 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173488+0000", 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3380000000000001e-06 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173493+0000", 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197456+0000", 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023962944999999999 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197495+0000", 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9385000000000003e-05 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197589+0000", 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4097000000000004e-05 2024-09-21T22:02:23.327 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81735 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.089304740999999, 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024317473999999999, 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81735 2024-09-21T22:02:23.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173500+0000", 2024-09-21T22:02:23.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173502+0000", 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9580000000000001e-06 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173507+0000", 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6080000000000003e-06 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173516+0000", 2024-09-21T22:02:23.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8130000000000002e-06 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197630+0000", 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024114304 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197717+0000", 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6839e-05 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197817+0000", 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9494000000000007e-05 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81736 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.089281882000002, 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024493269000000002, 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.332 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81736 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173523+0000", 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173524+0000", 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173531+0000", 2024-09-21T22:02:23.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.049e-06 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173539+0000", 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5790000000000004e-06 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197853+0000", 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024313950000000001 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197926+0000", 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2606000000000002e-05 2024-09-21T22:02:23.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198015+0000", 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9728000000000006e-05 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81737 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 3883008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.089259034000001, 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024642094, 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.336 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81737 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:23.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173547+0000", 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.013e-06 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173554+0000", 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4559999999999997e-06 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173558+0000", 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4240000000000003e-06 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198041+0000", 2024-09-21T22:02:23.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024483076999999999 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198102+0000", 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1066000000000001e-05 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198187+0000", 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4685000000000007e-05 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81738 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 4571136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.089240184000001, 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024869964000000001, 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81738 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173566+0000", 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.86e-06 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173574+0000", 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3200000000000002e-06 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173578+0000", 2024-09-21T22:02:23.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5360000000000003e-06 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198231+0000", 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024653195999999999 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198318+0000", 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6810000000000004e-05 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198434+0000", 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011572 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81739 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.089220007000002, 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024965376000000001, 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.345 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81739 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173590+0000", 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173596+0000", 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1199999999999999e-06 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173600+0000", 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2379999999999999e-06 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198454+0000", 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024854246 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198496+0000", 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2202e-05 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198549+0000", 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3038999999999998e-05 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81740 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 6537216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:23.349 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.089198068999998, 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025068272999999999, 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81740 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:23.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173608+0000", 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173614+0000", 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173618+0000", 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.459e-06 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198573+0000", 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024954473000000001 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198614+0000", 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.087e-05 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198674+0000", 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0528000000000001e-05 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.353 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81749 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7815168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 22.089179853000001, 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025172553, 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81749 2024-09-21T22:02:23.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173625+0000", 2024-09-21T22:02:23.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.46e-07 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173626+0000", 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.841e-06 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173632+0000", 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8130000000000001e-06 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173638+0000", 2024-09-21T22:02:23.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198697+0000", 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025059100000000001 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198736+0000", 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9319000000000001e-05 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:23.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:23.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198797+0000", 2024-09-21T22:02:23.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0445000000000001e-05 2024-09-21T22:02:23.358 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.358 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.358 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.358 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:23.358 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:23.358 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:23.359 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:23.360 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:23.358+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:23.461 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:23.459+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:23.465 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:23.465 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:23.465 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:23.465 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:23.474 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:23.562 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:23.561+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:23.617 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:23.617 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:23.617 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:23.617 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:23.617 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:23.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:23.663 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:23.661+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:23.763 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:23.762+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:23.770 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:23.770 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:23.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:23.770 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:23.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.770 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.770 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:23.770 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528872657999997, 2024-09-21T22:02:23.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.774 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528850638999998, 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:02:23.778 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528830057999997, 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.779 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:02:23.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528801459999997, 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.783 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:23.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:02:23.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:02:23.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528779055000001, 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:02:23.787 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.791 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528759039999997, 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.795 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528738837000006, 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:02:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528719577999993, 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.800 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:23.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:02:23.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:02:23.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528693511, 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.804 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:23.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.52867286, 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.808 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:02:23.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:02:23.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528614680999993, 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:02:23.812 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528559901999998, 2024-09-21T22:02:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:02:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528525446000003, 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:02:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:02:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528504115999993, 2024-09-21T22:02:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:02:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:02:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528482955000001, 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:02:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528452431000005, 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:02:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:02:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528428071999997, 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:02:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:02:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:02:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528406767000007, 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528385377000006, 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.528364010000004, 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:02:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:02:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:02:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:23.855 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:23.856 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:23.873 INFO:teuthology.orchestra.run.smithi102.stderr:set 3.1c pg_upmap mapping to [7,3] 2024-09-21T22:02:23.873 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:23.872+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:23.894 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:23.970 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:23.970 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:23.970 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:23.970 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:23.970 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:23.969+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:23.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:24.057 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:24.057 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:24.066 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:24.065+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:24.074 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:24.074 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:24.090 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:24.090 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:24.106 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:24.106 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:24.123 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:24.123 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:24.125 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:24.125 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:24.134 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:24.140 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:24.140 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:24.157 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:24.157 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:24.167 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:24.165+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:24.174 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:24.174 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:24.243 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:24.243 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:24.251 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:24.268 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:24.267+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:24.355 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:24.355 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:24.363 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:24.370 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:24.368+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:24.465 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:24.466 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:24.470 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:24.469+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:24.474 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:24.570 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:24.569+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:24.617 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:24.617 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:24.626 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:24.710 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:24.709+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:24.772 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:24.773 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:24.773 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:24.771+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:24.781 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:24.873 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:24.871+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:24.882 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:02:24.927 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:24.927 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:24.937 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:24.980 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:24.979+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:25.044 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:25.044 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:25.053 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:25.095 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:25.094+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:25.170 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:25.170 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:25.175 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:25.173+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:25.179 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:25.276 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:25.274+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:25.324 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:25.324 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:25.333 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:25.377 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:25.376+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:25.477 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:25.477 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:25.477 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:25.476+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:25.486 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:25.578 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:25.577+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:25.590 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:25.590 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:25.600 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:25.679 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:25.678+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:25.701 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:25.702 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:25.710 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:25.719 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:02:25.780 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:25.779+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:25.835 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:25.835 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:25.846 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:25.890 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:25.888+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:25.959 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:25.959 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:25.967 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:25.984 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:25.983+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:26.084 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:26.083+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:26.113 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:26.113 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:26.122 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:26.185 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:26.183+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:26.185 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:26.225 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:26.225 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:26.234 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:26.286 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:26.285+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:26.307 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:26.307 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:26.323 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:26.323 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:26.339 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:26.339 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:26.355 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:26.355 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:26.371 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:26.371 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:26.378 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:26.379 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:26.387 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:26.386+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:26.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:26.388 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:26.388 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:26.404 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:26.404 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:26.422 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:26.422 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:26.487 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:26.486+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:26.491 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:26.491 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:26.500 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:26.588 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:26.587+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:26.604 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:26.604 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:26.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:26.604 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:26.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.604 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:02:26.604 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:26.604 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 108.528355158, 2024-09-21T22:02:26.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:02:26.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:02:26.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:02:26.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:02:26.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 81.096318906999997, 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.611 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:26.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:26.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:02:26.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:26.616 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 68.743492090000004, 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:26.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 68.743472627000003, 2024-09-21T22:02:26.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:02:26.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:02:26.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.624 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 68.743444550000007, 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:26.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:02:26.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:02:26.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 68.743422718000005, 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.629 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:02:26.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 68.743402391000004, 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.633 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.637 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 68.743381428999996, 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.641 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 68.743360441999997, 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.642 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:02:26.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29863 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 3031040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:26.646 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 68.708403462999996, 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023866634000000001, 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29863 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893333+0000", 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893334+0000", 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893339+0000", 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5010000000000004e-06 2024-09-21T22:02:26.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893345+0000", 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1469999999999998e-06 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.893356+0000", 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0772e-05 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917062+0000", 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023706261999999999 2024-09-21T22:02:26.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917108+0000", 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5318000000000002e-05 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.917200+0000", 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2238999999999996e-05 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.801913648000003, 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:02:26.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:26.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81730 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7127040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.428293252, 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023997688999999999, 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.656 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81730 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173444+0000", 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173450+0000", 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173456+0000", 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0599999999999996e-06 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173461+0000", 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5279999999999997e-06 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197301+0000", 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023840647 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197353+0000", 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2222000000000002e-05 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197441+0000", 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81734 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:26.660 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.428257818999999, 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024110228000000001, 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81734 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:26.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173482+0000", 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.136e-06 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173488+0000", 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3380000000000001e-06 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173493+0000", 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197456+0000", 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023962944999999999 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197495+0000", 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9385000000000003e-05 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197589+0000", 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4097000000000004e-05 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81735 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.428237444000001, 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024317473999999999, 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81735 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.665 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173500+0000", 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:02:26.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173502+0000", 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9580000000000001e-06 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173507+0000", 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6080000000000003e-06 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173516+0000", 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8130000000000002e-06 2024-09-21T22:02:26.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197630+0000", 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024114304 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197717+0000", 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6839e-05 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197817+0000", 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9494000000000007e-05 2024-09-21T22:02:26.668 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81736 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.428214584999999, 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024493269000000002, 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.669 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81736 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173523+0000", 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173524+0000", 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173531+0000", 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.049e-06 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.671 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173539+0000", 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5790000000000004e-06 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197853+0000", 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024313950000000001 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197926+0000", 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2606000000000002e-05 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198015+0000", 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9728000000000006e-05 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81737 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 3883008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.428191736999999, 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024642094, 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.673 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81737 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173547+0000", 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.013e-06 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173554+0000", 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4559999999999997e-06 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173558+0000", 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4240000000000003e-06 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198041+0000", 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024483076999999999 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198102+0000", 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1066000000000001e-05 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198187+0000", 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4685000000000007e-05 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81738 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 4571136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.428172886999999, 2024-09-21T22:02:26.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024869964000000001, 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81738 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173566+0000", 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.86e-06 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173574+0000", 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3200000000000002e-06 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173578+0000", 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5360000000000003e-06 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198231+0000", 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024653195999999999 2024-09-21T22:02:26.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198318+0000", 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6810000000000004e-05 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198434+0000", 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011572 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81739 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.428152709999999, 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024965376000000001, 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81739 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173590+0000", 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173596+0000", 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1199999999999999e-06 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173600+0000", 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2379999999999999e-06 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.684 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198454+0000", 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024854246 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198496+0000", 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2202e-05 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198549+0000", 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3038999999999998e-05 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81740 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 6537216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.428130771999999, 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025068272999999999, 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81740 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.686 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:26.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173608+0000", 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173614+0000", 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173618+0000", 2024-09-21T22:02:26.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.459e-06 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198573+0000", 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024954473000000001 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198614+0000", 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.087e-05 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.689 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198674+0000", 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0528000000000001e-05 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81749 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7815168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 25.428112555999999, 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025172553, 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:26.690 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81749 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173625+0000", 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.46e-07 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173626+0000", 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.841e-06 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173632+0000", 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8130000000000001e-06 2024-09-21T22:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173638+0000", 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198697+0000", 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025059100000000001 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198736+0000", 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9319000000000001e-05 2024-09-21T22:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:26.694 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:26.694 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:26.694 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198797+0000", 2024-09-21T22:02:26.694 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0445000000000001e-05 2024-09-21T22:02:26.694 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.694 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.694 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.694 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:26.694 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:26.694 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:26.695 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:26.696 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:26.694+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:26.796 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:26.794+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:26.803 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:26.803 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:26.803 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:26.803 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:26.811 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:26.897 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:26.895+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:26.916 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:26.916 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:26.916 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:26.916 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:26.916 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:26.925 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:26.998 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:26.996+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788435251999999, 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.030 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788413233, 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.034 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:27.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:02:27.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788392651999999, 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:02:27.038 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:27.042 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788364053999999, 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:27.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:02:27.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:02:27.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:02:27.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788341649000003, 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.047 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:02:27.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:02:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788321633999999, 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.051 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788301430999994, 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.055 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788282171999995, 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.059 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:02:27.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:02:27.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788256105000002, 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:02:27.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:27.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:27.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.066 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788235454000002, 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:02:27.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.070 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788177274999995, 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:02:27.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:02:27.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:02:27.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788122496, 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788088040000005, 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.079 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:27.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:02:27.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.082 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788066709999995, 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.083 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.086 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788045549000003, 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:27.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:02:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.788015024999993, 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.091 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:02:27.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.787990665999999, 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.095 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:27.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:02:27.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.787969360999995, 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.787947970999994, 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.103 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:02:27.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 71.787926604000006, 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.107 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:02:27.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:02:27.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:02:27.111 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.111 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.111 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.111 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.111 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.111 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:27.112 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:27.112 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:27.111+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:27.212 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:27.211+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:27.255 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:27.255 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:27.255 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:27.255 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:27.264 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:27.313 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:27.312+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:27.366 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:27.366 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:27.366 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:27.366 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:27.366 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:27.375 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:27.414 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:27.412+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:27.515 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:27.514+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:27.519 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:27.519 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:27.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:27.519 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:27.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.519 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.519 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553875298999998, 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553854057999999, 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.527 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553832830000005, 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:02:27.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553809224000005, 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.532 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:02:27.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553789933999994, 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.536 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:27.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553757688000005, 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:02:27.540 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553733718999993, 2024-09-21T22:02:27.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:02:27.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.548 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553714154999994, 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:02:27.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.552 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553693722999995, 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:02:27.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.556 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553672599999999, 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:02:27.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:02:27.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553653384, 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.561 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:02:27.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:02:27.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553632911999998, 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:02:27.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:02:27.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553612197000007, 2024-09-21T22:02:27.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:02:27.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553592441000006, 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553572725999999, 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:02:27.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553552816000007, 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.582 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:02:27.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:02:27.585 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553531832999994, 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.586 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553511149000002, 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:02:27.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553485245000005, 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 69.553464328000004, 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:27.602 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:27.603 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:27.616 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:27.615+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:27.717 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:27.716+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:27.736 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:02:27.754 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:27.754 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:27.754 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:27.754 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:27.765 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:27.818 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:27.816+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:27.917 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:27.917 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:27.917 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:27.917 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:27.917 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:27.919 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:27.918+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:27.926 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:28.020 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:28.019+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.163287487999995, 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:02:28.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:02:28.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.163267494999999, 2024-09-21T22:02:28.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:02:28.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:02:28.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.163148059999997, 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162881354000007, 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:02:28.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:02:28.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:28.052 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162851192000005, 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:28.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.056 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162825655999995, 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.057 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162803127999993, 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.061 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:28.065 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162779508, 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:28.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:02:28.069 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162759159000004, 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162736745000004, 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.074 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:02:28.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162560678000006, 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.079 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:02:28.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:02:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:02:28.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162531670000007, 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.083 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162509838999995, 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.087 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:28.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162352694000006, 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:02:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162320223999998, 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.096 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162298692999997, 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.100 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162277376000006, 2024-09-21T22:02:28.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162251933999997, 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:02:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:02:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162231234999993, 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.162210603000005, 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:02:28.117 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.121 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:28.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:28.123 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:28.121+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:28.223 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:28.222+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:28.267 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:28.268 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:28.268 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:28.268 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:28.277 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:28.361 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:28.360+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:28.420 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:28.420 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:28.420 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:28.420 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:28.420 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:28.424 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:28.423+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:28.429 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:28.434 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:28.525 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:28.524+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:28.577 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:80156 3.5 3:a1396def:::rbd_object_map.1124d81bddfe:head [read 0~94] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 29.531698552000002, 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6793500620000001, 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 80156 2024-09-21T22:02:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043816+0000", 2024-09-21T22:02:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0839999999999999e-06 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043825+0000", 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043847+0000", 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1676999999999999e-05 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043858+0000", 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1199000000000001e-05 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043937+0000", 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9281000000000002e-05 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043950+0000", 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2513e-05 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715287+0000", 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.67133663899999996 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715300+0000", 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3654e-05 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.722928+0000", 2024-09-21T22:02:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0076280950000001 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723038+0000", 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110145 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723164+0000", 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012601100000000001 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85050 3.18 3:1fd90dc3:::rbd_data.1124d990a49c.0000000000000001:2d [sparse-read 7929856~42491] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.645556134, 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044083326999999999, 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85050 2024-09-21T22:02:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4600000000000001e-07 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929958+0000", 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3599999999999999e-06 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929962+0000", 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8060000000000001e-06 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929965+0000", 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973768+0000", 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043802843000000001 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973830+0000", 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2547999999999998e-05 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974040+0000", 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020997400000000001 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85051 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.645544880999999, 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044177951999999999, 2024-09-21T22:02:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85051 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.96e-07 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929970+0000", 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.751e-06 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929977+0000", 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5420000000000002e-06 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929981+0000", 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5739999999999997e-06 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973745+0000", 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043763541000000003 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973820+0000", 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974146+0000", 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00032645299999999999 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.592 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85052 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.645525841000001, 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044346141999999998, 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85052 2024-09-21T22:02:28.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6e-07 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929989+0000", 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3820000000000001e-06 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929992+0000", 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1310000000000002e-06 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929994+0000", 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4760000000000001e-06 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974207+0000", 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044212491999999999 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974266+0000", 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9098999999999998e-05 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974333+0000", 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7302e-05 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85053 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.645515793000001, 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044518747999999997, 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85053 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929999+0000", 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.221e-06 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930001+0000", 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.903e-06 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930004+0000", 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3360000000000002e-06 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974399+0000", 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044395260999999998 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974440+0000", 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1254000000000002e-05 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974516+0000", 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5564999999999999e-05 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85054 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2162688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.645504461000002, 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044703447, 2024-09-21T22:02:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85054 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930009+0000", 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930011+0000", 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.883e-06 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930016+0000", 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4369999999999998e-06 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930020+0000", 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3680000000000002e-06 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974543+0000", 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044523600000000003 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974624+0000", 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0989999999999995e-05 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974712+0000", 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7831999999999995e-05 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85055 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.645489721000001, 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044885911000000001, 2024-09-21T22:02:28.605 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85055 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.28e-07 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930025+0000", 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3230000000000001e-06 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930032+0000", 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709999999999997e-06 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930035+0000", 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8770000000000002e-06 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974740+0000", 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044704893000000002 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974822+0000", 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2047999999999998e-05 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974909+0000", 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7471000000000003e-05 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85056 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:28.609 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.6454752, 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060964000000002, 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85056 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2600000000000001e-07 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930039+0000", 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1230000000000001e-06 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930043+0000", 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8750000000000002e-06 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930047+0000", 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8840000000000004e-06 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974937+0000", 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044890473 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975014+0000", 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6574000000000002e-05 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975099+0000", 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4808999999999994e-05 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.613 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85057 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.645460053000001, 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045182878000000003, 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85057 2024-09-21T22:02:28.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:28.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930055+0000", 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1040000000000001e-06 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930065+0000", 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0023e-05 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930070+0000", 2024-09-21T22:02:28.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8400000000000002e-06 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975131+0000", 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060718999999999 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975183+0000", 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1910999999999998e-05 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975236+0000", 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2948000000000002e-05 2024-09-21T22:02:28.617 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85062 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.643568985000002, 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044032922000000002, 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.618 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85062 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931945+0000", 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5499999999999998e-07 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931947+0000", 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931953+0000", 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1720000000000004e-06 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931958+0000", 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7169999999999999e-06 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975829+0000", 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043871432000000002 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975894+0000", 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5060000000000004e-05 2024-09-21T22:02:28.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975977+0000", 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2626999999999993e-05 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85063 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.643548470999999, 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044185847, 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.622 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85063 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:28.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931965+0000", 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4900000000000001e-07 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931967+0000", 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2359999999999999e-06 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931977+0000", 2024-09-21T22:02:28.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8959999999999998e-06 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931982+0000", 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976005+0000", 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044023195000000001 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976067+0000", 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1495999999999995e-05 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976150+0000", 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3458e-05 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85064 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.643521987, 2024-09-21T22:02:28.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044333939000000003, 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85064 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931994+0000", 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932001+0000", 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7270000000000007e-06 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932005+0000", 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9009999999999996e-06 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976178+0000", 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044172185000000003 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976242+0000", 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4430999999999993e-05 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976325+0000", 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2885000000000003e-05 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.630 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85065 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7471104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.643501100000002, 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044487967000000003, 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85065 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-07 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932014+0000", 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4610000000000001e-06 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932017+0000", 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8319999999999999e-06 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932020+0000", 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.571e-06 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976351+0000", 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044330688 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976407+0000", 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6023999999999998e-05 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976500+0000", 2024-09-21T22:02:28.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3142999999999999e-05 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85066 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.643490069999999, 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044733053000000002, 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.635 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85066 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1e-07 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932024+0000", 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.108e-06 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932029+0000", 2024-09-21T22:02:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.335e-06 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932031+0000", 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976528+0000", 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044496971000000003 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976590+0000", 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2200999999999996e-05 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976756+0000", 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016567200000000001 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85077 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.639 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.642514829, 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044123073999999998, 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85077 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:28.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932999+0000", 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.37e-07 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933006+0000", 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933013+0000", 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5510000000000002e-06 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933019+0000", 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5679999999999999e-06 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977004+0000", 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043985319000000002 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977071+0000", 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7131000000000005e-05 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977121+0000", 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9925000000000001e-05 2024-09-21T22:02:28.643 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85078 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.642486615999999, 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044323946000000003, 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.644 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85078 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933027+0000", 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933029+0000", 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933035+0000", 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933041+0000", 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8300000000000001e-06 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977158+0000", 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044117682999999998 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977273+0000", 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114307 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977350+0000", 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7466999999999995e-05 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85079 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.642465801, 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044512719999999999, 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85079 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:28.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933050+0000", 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933056+0000", 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.105e-06 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933060+0000", 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.561e-06 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977399+0000", 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044339296 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977465+0000", 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.546e-05 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977560+0000", 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4905e-05 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85080 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:28.652 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.64240629, 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044578665000000003, 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85080 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.37e-07 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933110+0000", 2024-09-21T22:02:28.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9009999999999998e-06 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933119+0000", 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7609999999999996e-06 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933125+0000", 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3199999999999996e-06 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977587+0000", 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044462224000000002 2024-09-21T22:02:28.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977629+0000", 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2064999999999998e-05 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977685+0000", 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.656 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85081 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.642378291, 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044717826000000002, 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85081 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933137+0000", 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933144+0000", 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9009999999999997e-06 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933150+0000", 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0179999999999998e-06 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977715+0000", 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044564469000000002 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977765+0000", 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0040000000000002e-05 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977852+0000", 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7820999999999998e-05 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.660 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85082 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 24.642356303, 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044866094000000002, 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85082 2024-09-21T22:02:28.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:28.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933159+0000", 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1019999999999999e-06 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933165+0000", 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933170+0000", 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9860000000000002e-06 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977880+0000", 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044710059000000003 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977944+0000", 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4162e-05 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.978023+0000", 2024-09-21T22:02:28.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8392000000000004e-05 2024-09-21T22:02:28.665 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.665 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.665 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.665 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:28.665 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:28.665 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:28.667 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:28.667 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:28.667 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:28.668 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:28.668 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:28.668 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:28.668 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:28.669 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:28.669 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:28.670 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:28.664+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:28.674 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:28.675 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:28.691 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:28.708 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:28.709 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:28.720 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:02:28.767 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:28.765+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:28.800 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:28.800 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:28.812 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:28.867 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:28.866+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:28.896 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:02:28.896 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:02:28.896 INFO:tasks.thrashosds.thrasher:Removing osd 2, in_osds are: [0, 1, 2, 3, 4, 5, 7] 2024-09-21T22:02:28.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 2 2024-09-21T22:02:28.957 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:28.957 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:28.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:28.968 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:28.966+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:29.068 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:29.068 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:29.069 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:29.068+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:29.077 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:29.170 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:29.168+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:29.180 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:29.180 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:29.182 INFO:tasks.ceph.mon.a.smithi102.stderr:2024-09-21T22:02:29.181+0000 7f46e9689640 -1 mon.a@0(leader).osd e112 definitely_dead 0 2024-09-21T22:02:29.188 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:29.273 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:29.271+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:29.332 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:29.332 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:29.340 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:29.382 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:29.380+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:29.472 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:29.471+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:29.482 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:29.483 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:29.491 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:29.574 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:29.573+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:29.592 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:29.592 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:29.601 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:29.675 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:29.673+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:29.703 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:29.703 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:29.712 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:29.714 INFO:teuthology.orchestra.run.smithi102.stderr:marked out osd.2. 2024-09-21T22:02:29.798 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:29.796+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:29.859 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:29.859 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:29.868 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:29.877 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:29.876+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:29.978 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:29.976+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:30.011 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:30.011 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:30.020 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:30.104 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:30.102+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:30.163 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:30.163 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:30.173 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:30.215 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:30.213+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:30.281 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:30.280+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:30.318 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:30.318 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:30.327 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:30.382 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:30.381+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:30.435 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:30.436 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:30.444 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:30.488 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:30.487+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:30.547 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:30.547 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:30.556 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:30.583 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:30.582+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:30.684 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:30.684+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:30.699 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:30.699 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:30.708 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:30.720 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:30.736 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:02:30.793 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:30.792+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:30.858 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:30.858 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:30.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:30.873 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:30.874 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:30.890 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:30.891 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:30.891 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:30.890+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:30.909 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:30.909 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:30.925 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:30.925 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:30.943 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:30.960 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:30.961 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:30.977 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:30.977 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:30.980 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:30.980 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:30.980 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:30.980 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:30.980 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:30.989 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:30.986+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:30.991 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:30.994 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:30.995 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:31.092 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:31.091+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:31.100 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:31.100 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:31.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:31.100 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134356045999994, 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.101 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:02:31.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:02:31.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134334804999995, 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.105 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:02:31.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:02:31.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134313577, 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:02:31.109 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134289971000001, 2024-09-21T22:02:31.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:02:31.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:02:31.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134270681000004, 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:02:31.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:02:31.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:02:31.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134238435, 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134214466000003, 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.126 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:31.130 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134194902000004, 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:31.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:02:31.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:02:31.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134174470000005, 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:02:31.138 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134153346999994, 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.139 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134134130999996, 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.143 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:02:31.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:02:31.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.147 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134113658999993, 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.148 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:02:31.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:02:31.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134092944000002, 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:02:31.152 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134073188000002, 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:02:31.156 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:31.160 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134053472999994, 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134033563000003, 2024-09-21T22:02:31.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.134012580000004, 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:02:31.168 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:31.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:02:31.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.133991895999998, 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:02:31.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:02:31.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.133965992, 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.176 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:02:31.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:02:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.133945075, 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:02:31.180 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:02:31.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:02:31.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:02:31.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:02:31.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.184 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.184 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.184 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:31.185 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:31.193 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:31.190+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:31.292 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:31.291+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:31.329 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:31.329 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:31.330 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:31.330 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:31.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:31.393 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:31.392+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:31.480 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:31.480 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:31.480 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:31.480 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:31.480 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:31.489 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:31.494 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:31.492+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:31.593 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:31.593 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:31.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:31.593 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:31.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.593 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.721442534000005, 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:02:31.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.721422540999995, 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.598 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:31.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.721303105999993, 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.604 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:31.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:31.608 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.721036400000003, 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.721006238000001, 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:02:31.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:02:31.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:02:31.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720980702000006, 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.617 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:02:31.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720958174000003, 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.621 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:02:31.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:02:31.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720934553999996, 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.629 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720914205, 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:02:31.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720891791, 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:02:31.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:02:31.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720715724000002, 2024-09-21T22:02:31.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:02:31.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:02:31.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.642 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720686716000003, 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:02:31.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:02:31.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720664885000005, 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:02:31.647 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:02:31.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.651 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720507740000002, 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:31.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.655 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720475269999994, 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.656 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:31.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720453739000007, 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.660 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720432422000002, 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.664 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:02:31.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.667 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720406980000007, 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:02:31.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:31.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.671 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720386281000003, 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.672 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:31.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 73.720365649000001, 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:31.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:02:31.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:02:31.680 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.680 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.680 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.680 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.680 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.680 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:31.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:31.682 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:31.679+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:31.721 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:02:31.782 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:31.781+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:31.805 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:31.805 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:31.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.805 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "MOSDPGRecoveryDeleteReply(3.1e e115,114 3:7bed1c0b:::rbd_data.1124dde4f7d8.000000000000001b:head,60'95)", 2024-09-21T22:02:31.805 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:31.804364+0000", 2024-09-21T22:02:31.805 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00016033, 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000174678, 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:31.804364+0000", 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:31.804364+0000", 2024-09-21T22:02:31.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:31.804365+0000", 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4199999999999995e-07 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:31.804368+0000", 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5020000000000001e-06 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:31.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:31.804378+0000", 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5999999999999996e-06 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:31.804383+0000", 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4099999999999999e-06 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:31.804428+0000", 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4184999999999998e-05 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:31.809 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:31.809 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 1 2024-09-21T22:02:31.809 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:31.815 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:31.900 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:31.899+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:31.971 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:31.971 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:31.972 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:31.972 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:31.972 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:31.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:31.984 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:31.982+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:32.084 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:32.082+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:32.126 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:80156 3.5 3:a1396def:::rbd_object_map.1124d81bddfe:head [read 0~94] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-21T22:02:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 33.080127552, 2024-09-21T22:02:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6793500620000001, 2024-09-21T22:02:32.126 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 80156 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043816+0000", 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0839999999999999e-06 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043825+0000", 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043847+0000", 2024-09-21T22:02:32.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1676999999999999e-05 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043858+0000", 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1199000000000001e-05 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043937+0000", 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9281000000000002e-05 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043950+0000", 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2513e-05 2024-09-21T22:02:32.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715287+0000", 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.67133663899999996 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715300+0000", 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3654e-05 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.722928+0000", 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0076280950000001 2024-09-21T22:02:32.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723038+0000", 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110145 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723164+0000", 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012601100000000001 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85050 3.18 3:1fd90dc3:::rbd_data.1124d990a49c.0000000000000001:2d [sparse-read 7929856~42491] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.193985133999998, 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044083326999999999, 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85050 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4600000000000001e-07 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929958+0000", 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3599999999999999e-06 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929962+0000", 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8060000000000001e-06 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929965+0000", 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973768+0000", 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043802843000000001 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973830+0000", 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2547999999999998e-05 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974040+0000", 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020997400000000001 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85051 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.193973881000002, 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044177951999999999, 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85051 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.96e-07 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929970+0000", 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.751e-06 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929977+0000", 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5420000000000002e-06 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929981+0000", 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5739999999999997e-06 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973745+0000", 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043763541000000003 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973820+0000", 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974146+0000", 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00032645299999999999 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.139 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85052 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.193954841, 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044346141999999998, 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85052 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.140 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6e-07 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929989+0000", 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3820000000000001e-06 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929992+0000", 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1310000000000002e-06 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929994+0000", 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4760000000000001e-06 2024-09-21T22:02:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974207+0000", 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044212491999999999 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974266+0000", 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9098999999999998e-05 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974333+0000", 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7302e-05 2024-09-21T22:02:32.143 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85053 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.193944793, 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044518747999999997, 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85053 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929999+0000", 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.221e-06 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930001+0000", 2024-09-21T22:02:32.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.903e-06 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930004+0000", 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3360000000000002e-06 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974399+0000", 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044395260999999998 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974440+0000", 2024-09-21T22:02:32.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1254000000000002e-05 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974516+0000", 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5564999999999999e-05 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85054 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2162688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.193933461, 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044703447, 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.148 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85054 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930009+0000", 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930011+0000", 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.883e-06 2024-09-21T22:02:32.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930016+0000", 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4369999999999998e-06 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930020+0000", 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3680000000000002e-06 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974543+0000", 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044523600000000003 2024-09-21T22:02:32.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974624+0000", 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0989999999999995e-05 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974712+0000", 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7831999999999995e-05 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85055 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.193918720999999, 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044885911000000001, 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85055 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.28e-07 2024-09-21T22:02:32.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930025+0000", 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3230000000000001e-06 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930032+0000", 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709999999999997e-06 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930035+0000", 2024-09-21T22:02:32.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8770000000000002e-06 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974740+0000", 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044704893000000002 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974822+0000", 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2047999999999998e-05 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974909+0000", 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7471000000000003e-05 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85056 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.193904199999999, 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060964000000002, 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.157 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85056 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2600000000000001e-07 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930039+0000", 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1230000000000001e-06 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930043+0000", 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8750000000000002e-06 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930047+0000", 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8840000000000004e-06 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974937+0000", 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044890473 2024-09-21T22:02:32.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975014+0000", 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6574000000000002e-05 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975099+0000", 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4808999999999994e-05 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85057 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.193889052999999, 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045182878000000003, 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85057 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.162 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:32.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930055+0000", 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1040000000000001e-06 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930065+0000", 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0023e-05 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930070+0000", 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8400000000000002e-06 2024-09-21T22:02:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975131+0000", 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060718999999999 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975183+0000", 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1910999999999998e-05 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975236+0000", 2024-09-21T22:02:32.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2948000000000002e-05 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85062 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.191997985, 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044032922000000002, 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.166 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85062 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:32.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931945+0000", 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5499999999999998e-07 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931947+0000", 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931953+0000", 2024-09-21T22:02:32.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1720000000000004e-06 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931958+0000", 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7169999999999999e-06 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975829+0000", 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043871432000000002 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975894+0000", 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5060000000000004e-05 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975977+0000", 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2626999999999993e-05 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85063 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.191977471000001, 2024-09-21T22:02:32.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044185847, 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85063 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931965+0000", 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4900000000000001e-07 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931967+0000", 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2359999999999999e-06 2024-09-21T22:02:32.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931977+0000", 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8959999999999998e-06 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931982+0000", 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976005+0000", 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044023195000000001 2024-09-21T22:02:32.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976067+0000", 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1495999999999995e-05 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976150+0000", 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3458e-05 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85064 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.191950986999998, 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044333939000000003, 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85064 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931994+0000", 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932001+0000", 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7270000000000007e-06 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932005+0000", 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9009999999999996e-06 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976178+0000", 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044172185000000003 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976242+0000", 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4430999999999993e-05 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976325+0000", 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2885000000000003e-05 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.178 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85065 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7471104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.1919301, 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044487967000000003, 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.179 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85065 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-07 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932014+0000", 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4610000000000001e-06 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932017+0000", 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8319999999999999e-06 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932020+0000", 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.571e-06 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976351+0000", 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044330688 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976407+0000", 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6023999999999998e-05 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976500+0000", 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3142999999999999e-05 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85066 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.191919070000001, 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044733053000000002, 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.183 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85066 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:32.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1e-07 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932024+0000", 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.108e-06 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932029+0000", 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.335e-06 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932031+0000", 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976528+0000", 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044496971000000003 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976590+0000", 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2200999999999996e-05 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976756+0000", 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016567200000000001 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85077 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.190943828999998, 2024-09-21T22:02:32.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044123073999999998, 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85077 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932999+0000", 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.37e-07 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933006+0000", 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933013+0000", 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5510000000000002e-06 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933019+0000", 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5679999999999999e-06 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977004+0000", 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043985319000000002 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977071+0000", 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7131000000000005e-05 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977121+0000", 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9925000000000001e-05 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85078 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:32.191 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.190915616000002, 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044323946000000003, 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85078 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933027+0000", 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933029+0000", 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:02:32.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933035+0000", 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933041+0000", 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8300000000000001e-06 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977158+0000", 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044117682999999998 2024-09-21T22:02:32.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977273+0000", 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114307 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977350+0000", 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7466999999999995e-05 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85079 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.190894800999999, 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044512719999999999, 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85079 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:32.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933050+0000", 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933056+0000", 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.105e-06 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933060+0000", 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.561e-06 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977399+0000", 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044339296 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977465+0000", 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.546e-05 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977560+0000", 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4905e-05 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85080 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.190835289999999, 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044578665000000003, 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.200 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85080 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.37e-07 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933110+0000", 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9009999999999998e-06 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933119+0000", 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7609999999999996e-06 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933125+0000", 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3199999999999996e-06 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977587+0000", 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044462224000000002 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977629+0000", 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2064999999999998e-05 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977685+0000", 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85081 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.190807290999999, 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044717826000000002, 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.204 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85081 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933137+0000", 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933144+0000", 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9009999999999997e-06 2024-09-21T22:02:32.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933150+0000", 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0179999999999998e-06 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977715+0000", 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044564469000000002 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977765+0000", 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0040000000000002e-05 2024-09-21T22:02:32.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977852+0000", 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7820999999999998e-05 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85082 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.190785302999998, 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044866094000000002, 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:32.208 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85082 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:32.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933159+0000", 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1019999999999999e-06 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:32.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933165+0000", 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933170+0000", 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9860000000000002e-06 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977880+0000", 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044710059000000003 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977944+0000", 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4162e-05 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.978023+0000", 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8392000000000004e-05 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:32.212 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:32.214 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:32.214 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:32.212+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:32.314 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:32.312+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:32.326 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:32.326 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:32.326 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:32.326 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:32.336 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:32.415 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:32.413+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:32.484 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:32.485 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:32.485 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:32.485 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:32.485 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:32.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:32.538 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:32.537+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:32.607 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 93.393506884000004, 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.608 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:02:32.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:02:32.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56963 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 622592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351445804000001, 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021343747, 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.613 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56963 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2e-07 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253818+0000", 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1160000000000002e-06 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253823+0000", 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253828+0000", 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.274987+0000", 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021158445000000001 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275065+0000", 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8407999999999999e-05 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275159+0000", 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3497000000000003e-05 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56964 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:32.617 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351426486999998, 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021459051999999999, 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56964 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:32.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253835+0000", 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253837+0000", 2024-09-21T22:02:32.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:02:32.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253842+0000", 2024-09-21T22:02:32.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8080000000000001e-06 2024-09-21T22:02:32.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253847+0000", 2024-09-21T22:02:32.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6099999999999999e-06 2024-09-21T22:02:32.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275188+0000", 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021341057 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275230+0000", 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1941999999999999e-05 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275293+0000", 2024-09-21T22:02:32.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3195999999999996e-05 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56965 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351394485999997, 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021632274, 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.623 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56965 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253867+0000", 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253869+0000", 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253875+0000", 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0970000000000002e-06 2024-09-21T22:02:32.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253880+0000", 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275329+0000", 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021448292000000001 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275407+0000", 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7946000000000002e-05 2024-09-21T22:02:32.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275499+0000", 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1978000000000006e-05 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56966 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1310720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351374638999999, 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021740731999999999, 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.627 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56966 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253888+0000", 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0669999999999999e-06 2024-09-21T22:02:32.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253894+0000", 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8980000000000001e-06 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253900+0000", 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275526+0000", 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021625912000000001 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275569+0000", 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3043000000000001e-05 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275627+0000", 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7479000000000003e-05 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.631 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56967 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351354467, 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021928007999999999, 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56967 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.632 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253907+0000", 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.41e-07 2024-09-21T22:02:32.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253908+0000", 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.776e-06 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253914+0000", 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1950000000000002e-06 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253928+0000", 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3974e-05 2024-09-21T22:02:32.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275662+0000", 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021734168000000002 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275740+0000", 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7807999999999998e-05 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275834+0000", 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4746000000000004e-05 2024-09-21T22:02:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56968 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351326325000002, 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022029615999999998, 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.636 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56968 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253935+0000", 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253937+0000", 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253943+0000", 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253948+0000", 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275861+0000", 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021913548000000001 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275905+0000", 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3795000000000003e-05 2024-09-21T22:02:32.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275964+0000", 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8739000000000001e-05 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56969 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351307656000003, 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022221162999999999, 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.640 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56969 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253955+0000", 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.874e-06 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253961+0000", 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999998e-06 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253965+0000", 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5260000000000004e-06 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276000+0000", 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022034611999999999 2024-09-21T22:02:32.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276078+0000", 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8311000000000003e-05 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276174+0000", 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6139999999999998e-05 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56984 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351290038000002, 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022340279000000001, 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56984 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253973+0000", 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.81e-06 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253979+0000", 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253983+0000", 2024-09-21T22:02:32.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276203+0000", 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022219848 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276248+0000", 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4880999999999999e-05 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276311+0000", 2024-09-21T22:02:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3047999999999997e-05 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56985 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351272066, 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022528538000000001, 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56985 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253991+0000", 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1229999999999998e-06 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253997+0000", 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4759999999999997e-06 2024-09-21T22:02:32.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254003+0000", 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.896e-06 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276347+0000", 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022344180000000002 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276424+0000", 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7014000000000005e-05 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276517+0000", 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3383999999999999e-05 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56986 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351252463000002, 2024-09-21T22:02:32.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022636156000000001, 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56986 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254009+0000", 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254021+0000", 2024-09-21T22:02:32.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2075e-05 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254027+0000", 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2910000000000004e-06 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254032+0000", 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0969999999999996e-06 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276545+0000", 2024-09-21T22:02:32.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022513014000000001 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276588+0000", 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3183000000000003e-05 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276644+0000", 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6165999999999997e-05 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56987 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 868352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351221993000003, 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022813353000000001, 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56987 2024-09-21T22:02:32.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:32.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254041+0000", 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254047+0000", 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254051+0000", 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6430000000000003e-06 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276680+0000", 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022628945000000001 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276758+0000", 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7775999999999995e-05 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276852+0000", 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4067999999999995e-05 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56988 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1097728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351204578000001, 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923770999999999, 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.662 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56988 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254058+0000", 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254064+0000", 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2950000000000001e-06 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254068+0000", 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1479999999999999e-06 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276880+0000", 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022812260000000001 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276923+0000", 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3347999999999999e-05 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276980+0000", 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6496000000000003e-05 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.666 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56989 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1327104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351187572000001, 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023109826999999999, 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56989 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.667 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254075+0000", 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.691e-06 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254081+0000", 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254085+0000", 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.498e-06 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277015+0000", 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929417000000001 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277092+0000", 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6625000000000006e-05 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277183+0000", 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1453999999999995e-05 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.670 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56990 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1556480~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351169425000002, 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023224305000000001, 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56990 2024-09-21T22:02:32.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254092+0000", 2024-09-21T22:02:32.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.22e-07 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254093+0000", 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7099999999999999e-06 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254099+0000", 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254103+0000", 2024-09-21T22:02:32.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277211+0000", 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023107593999999999 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277254+0000", 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2762000000000002e-05 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277316+0000", 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1876000000000002e-05 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56991 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351152079000002, 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023415498999999999, 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.675 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56991 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:32.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254111+0000", 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.813e-06 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.677 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254116+0000", 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254121+0000", 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5730000000000001e-06 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277351+0000", 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023230621 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.678 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277431+0000", 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9818e-05 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277524+0000", 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2986999999999996e-05 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56992 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 2015232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.679 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.351134590000001, 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023528238999999999, 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56992 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:32.680 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.681 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254128+0000", 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8330000000000001e-06 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254134+0000", 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5729999999999998e-06 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254139+0000", 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4790000000000004e-06 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.682 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277553+0000", 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023413607999999999 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277596+0000", 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3489000000000003e-05 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277654+0000", 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7911999999999997e-05 2024-09-21T22:02:32.683 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57020 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.350637505000002, 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023243617000000001, 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.684 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57020 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.685 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254624+0000", 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254632+0000", 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1219999999999995e-06 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254640+0000", 2024-09-21T22:02:32.686 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9370000000000004e-06 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254645+0000", 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3140000000000003e-06 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277690+0000", 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023044477000000001 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.687 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277768+0000", 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8594e-05 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277867+0000", 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8560999999999994e-05 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57021 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.688 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.350608604000001, 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023344055999999998, 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57021 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:32.689 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254653+0000", 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254654+0000", 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254661+0000", 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254666+0000", 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.691 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277894+0000", 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023228029000000001 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277936+0000", 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2589000000000002e-05 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277996+0000", 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9967999999999999e-05 2024-09-21T22:02:32.692 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57023 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 704512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 45.350589784999997, 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023525122999999998, 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.693 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57023 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.32e-07 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254679+0000", 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7479999999999993e-06 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254686+0000", 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:02:32.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254690+0000", 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7180000000000004e-06 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278021+0000", 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023330391999999998 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278097+0000", 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6464999999999994e-05 2024-09-21T22:02:32.696 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.697 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.697 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:32.697 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278196+0000", 2024-09-21T22:02:32.697 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8852999999999997e-05 2024-09-21T22:02:32.697 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.697 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.697 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.697 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.697 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.697 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:32.699 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:32.699 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:32.696+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:32.800 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:32.798+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:32.846 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:32.846 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:32.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.846 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:90863 3.4 3.acc612c4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-21T22:02:32.846 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:32.749188+0000", 2024-09-21T22:02:32.846 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.095775134999999997, 2024-09-21T22:02:32.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.095797495999999996, 2024-09-21T22:02:32.846 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.846 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.846 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "waiting for peered", 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 90863 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.749188+0000", 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.749188+0000", 2024-09-21T22:02:32.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.749189+0000", 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8589999999999999e-06 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.749198+0000", 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5480000000000002e-06 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.749215+0000", 2024-09-21T22:02:32.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6528000000000002e-05 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.749222+0000", 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.749307+0000", 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4115000000000004e-05 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.749317+0000", 2024-09-21T22:02:32.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0231000000000001e-05 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.754887+0000", 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0055701450000000003 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.754897+0000", 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8570000000000007e-06 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:90864 3.4 3.acc612c4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:32.753594+0000", 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.091368749999999999, 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.091437555000000004, 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "waiting for peered", 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 90864 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.753594+0000", 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.753594+0000", 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.753595+0000", 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3480000000000001e-06 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.753600+0000", 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999996e-06 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.753609+0000", 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2629999999999992e-06 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.753619+0000", 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.5140000000000007e-06 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.755213+0000", 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0015948 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:32.755222+0000", 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8310000000000007e-06 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: ], 2024-09-21T22:02:32.854 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 2 2024-09-21T22:02:32.855 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:32.856 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:32.940 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:32.938+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:33.001 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:33.001 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:33.001 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:33.001 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:33.001 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:33.001 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:32.999+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:33.006 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:33.009 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:33.102 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:33.100+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:33.127 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:33.127 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:33.144 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:33.144 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:33.154 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:33.154 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:33.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 89.100395005999999, 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.155 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:02:33.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:02:33.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:02:33.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.160 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.223680512000001, 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:02:33.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:02:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.164 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.223670561999995, 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.165 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:33.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:02:33.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:02:33.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.223657158999998, 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.169 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.223647487999997, 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.173 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:02:33.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:02:33.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.221651651000002, 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:02:33.177 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:33.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:02:33.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:33.181 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.221605394999997, 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.185 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.221568059999996, 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:02:33.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:02:33.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.189 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.221533879000006, 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:02:33.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:02:33.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:02:33.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.193 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.221494007000004, 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.194 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 75.221448722000005, 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.198 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:02:33.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85825 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2277376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 29.090351242000001, 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028813432, 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.202 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85825 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:33.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061936+0000", 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4790000000000001e-06 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061939+0000", 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1240000000000001e-06 2024-09-21T22:02:33.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061941+0000", 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.452e-06 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090598+0000", 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028656966999999998 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090675+0000", 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6914000000000003e-05 2024-09-21T22:02:33.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090745+0000", 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0290999999999995e-05 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85826 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2342912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 29.090339124, 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028888786999999999, 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.206 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85826 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061946+0000", 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.556e-06 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061949+0000", 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9249999999999999e-06 2024-09-21T22:02:33.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061951+0000", 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4739999999999999e-06 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090758+0000", 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028806486999999999 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090796+0000", 2024-09-21T22:02:33.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8466000000000001e-05 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090833+0000", 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6674000000000002e-05 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85827 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2408448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 29.090329169, 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029053266000000001, 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.210 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85827 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:33.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9999999999999999e-07 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061955+0000", 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.156e-06 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061958+0000", 2024-09-21T22:02:33.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9340000000000002e-06 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061961+0000", 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5040000000000001e-06 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090862+0000", 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028901175000000001 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090937+0000", 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4881000000000004e-05 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091007+0000", 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0415999999999998e-05 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85828 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2473984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 29.090319488999999, 2024-09-21T22:02:33.214 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029127014, 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85828 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.215 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061965+0000", 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.216 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061968+0000", 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.92e-06 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061971+0000", 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.101e-06 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091020+0000", 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029048398999999999 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.217 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091056+0000", 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6718000000000003e-05 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091091+0000", 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4501000000000001e-05 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85829 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2539520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 29.090270136000001, 2024-09-21T22:02:33.218 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029251899000000001, 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85829 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.219 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062014+0000", 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062016+0000", 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.220 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062022+0000", 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062027+0000", 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2180000000000001e-06 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091120+0000", 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029093112000000001 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.221 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091195+0000", 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5499000000000003e-05 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091265+0000", 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9670000000000002e-05 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85830 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2605056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:33.222 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 29.090250489999999, 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029323741, 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85830 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.223 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062034+0000", 2024-09-21T22:02:33.224 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2729999999999999e-06 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062038+0000", 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.602e-06 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062042+0000", 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9949999999999999e-06 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091283+0000", 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029241195000000001 2024-09-21T22:02:33.225 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091320+0000", 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7296999999999999e-05 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091356+0000", 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6170000000000001e-05 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85831 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2670592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 29.090238018000001, 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029484659999999999, 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85831 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.227 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.228 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062047+0000", 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062050+0000", 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1099999999999999e-06 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062052+0000", 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4899999999999999e-06 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091385+0000", 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029333016999999999 2024-09-21T22:02:33.229 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091461+0000", 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6019000000000005e-05 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091530+0000", 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8660999999999999e-05 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.230 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85832 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2736128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 29.090227986999999, 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029557844999999999, 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85832 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:33.231 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.232 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.232 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.232 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.233 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:33.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.233 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.233 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.233 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.233 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:33.233 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062057+0000", 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.119e-06 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062060+0000", 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9730000000000002e-06 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062062+0000", 2024-09-21T22:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091542+0000", 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029480309999999999 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091579+0000", 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6254000000000002e-05 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091613+0000", 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4555999999999999e-05 2024-09-21T22:02:33.235 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85882 3.16 3:6c4a0c3b:::rbd_data.1124f4fa8d1.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 29.003236273999999, 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029882499999999999, 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85882 2024-09-21T22:02:33.236 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149049+0000", 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.635e-06 2024-09-21T22:02:33.237 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149054+0000", 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7939999999999999e-06 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149067+0000", 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2587e-05 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149074+0000", 2024-09-21T22:02:33.238 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.25e-06 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149143+0000", 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9008000000000001e-05 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149216+0000", 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2947000000000005e-05 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149339+0000", 2024-09-21T22:02:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012293800000000001 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178449+0000", 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029110159 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178861+0000", 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000411808 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:33.240 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178898+0000", 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6745000000000001e-05 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178929+0000", 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1628999999999998e-05 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:33.241 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:33.242 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:33.242 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:33.243 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:33.243 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:33.243 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:33.244 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:33.244 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:33.244 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:33.245 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:33.245 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:33.245 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:33.245 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:33.246 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:33.246 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:33.240+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:33.343 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:33.341+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:33.386 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:33.386 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:33.395 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:33.444 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:33.442+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:33.498 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:33.498 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:33.507 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:33.545 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:33.543+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:33.645 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:33.643+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:33.650 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:33.650 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:33.659 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:33.739 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:02:33.783 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:33.781+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:33.815 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:33.816 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:33.825 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:33.846 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:33.844+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:33.931 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:33.931 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:33.939 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:33.983 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:33.981+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:34.042 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:34.042 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:34.048 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:34.046+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:34.051 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:34.148 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:34.147+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:34.155 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:34.155 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:34.164 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:34.249 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:34.248+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:34.267 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:34.268 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:34.276 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:34.351 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:34.349+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:34.380 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:34.380 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:34.390 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:34.474 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:34.472+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:34.533 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:34.533 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:34.542 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:34.583 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:34.581+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:34.653 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:34.652+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:34.684 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:34.684 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:34.693 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:34.720 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:02:34.736 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7] out_osds: [6, 2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:02:34.736 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:02:34.736 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-21T22:02:34.736 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-21T22:02:34.779 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:34.777+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:34.814 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:34.814 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:34.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:34.865 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:34.863+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:34.917 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:02:34.917 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:02:34.917 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:02:34.918 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:02:34.918 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:02:34.918 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:02:34.918 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:02:34.918 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:02:34.918 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:02:34.918 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:02:34.918 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:02:34.918 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:02:34.920 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:02:34.921 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:02:34.921 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-21T22:02:34.955 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:34.954+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:34.970 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:34.970 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:34.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:35.055 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:02:35.055 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:02:35.055 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:02:35.056 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:02:35.056 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:02:35.056 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:02:35.056 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:02:35.056 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:02:35.056 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:02:35.056 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:02:35.056 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:02:35.056 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:02:35.056 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:35.053+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:35.058 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:02:35.059 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:02:35.059 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-21T22:02:35.085 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:35.086 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:35.095 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:35.157 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:35.155+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:35.219 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:02:35.219 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:02:35.220 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:02:35.220 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:02:35.220 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:02:35.220 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:02:35.220 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:02:35.220 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:02:35.220 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:02:35.220 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:02:35.220 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:02:35.220 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:02:35.222 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:02:35.223 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:02:35.223 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-21T22:02:35.242 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:35.242 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:35.252 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:35.253 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:35.257 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:35.256+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:35.357 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:02:35.357 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:02:35.357 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:02:35.357 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:02:35.357 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:02:35.357 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:02:35.357 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:02:35.357 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:02:35.357 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:02:35.358 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:02:35.358 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:02:35.358 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:02:35.358 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:35.357+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:35.361 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:02:35.361 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:02:35.361 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-21T22:02:35.401 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:35.401 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:35.410 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:35.416 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:35.416 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:35.434 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:35.434 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:35.451 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:35.459 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:35.457+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:35.467 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:35.468 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:35.485 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:35.485 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:35.502 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:35.502 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:35.519 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:35.519 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:35.524 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:35.524 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:35.524 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:35.524 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:35.524 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:35.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:35.536 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:02:35.536 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:02:35.536 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:02:35.536 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:02:35.536 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:02:35.536 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:02:35.537 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:02:35.537 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:02:35.537 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:02:35.537 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:02:35.537 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:02:35.537 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:02:35.537 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:35.538 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:35.539 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:02:35.539 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:02:35.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-21T22:02:35.591 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:35.589+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:35.643 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:35.643 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:35.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:35.643 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:35.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.643 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:80156 3.5 3:a1396def:::rbd_object_map.1124d81bddfe:head [read 0~94] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-21T22:02:35.643 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:35.643 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.596831395000002, 2024-09-21T22:02:35.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6793500620000001, 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 80156 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:35.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043816+0000", 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0839999999999999e-06 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043825+0000", 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043847+0000", 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1676999999999999e-05 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043858+0000", 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1199000000000001e-05 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043937+0000", 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9281000000000002e-05 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043950+0000", 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2513e-05 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715287+0000", 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.67133663899999996 2024-09-21T22:02:35.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715300+0000", 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3654e-05 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.722928+0000", 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0076280950000001 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723038+0000", 2024-09-21T22:02:35.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110145 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723164+0000", 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012601100000000001 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85050 3.18 3:1fd90dc3:::rbd_data.1124d990a49c.0000000000000001:2d [sparse-read 7929856~42491] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:35.649 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.710688977, 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044083326999999999, 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85050 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:35.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4600000000000001e-07 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929958+0000", 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3599999999999999e-06 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929962+0000", 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8060000000000001e-06 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929965+0000", 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973768+0000", 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043802843000000001 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973830+0000", 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2547999999999998e-05 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974040+0000", 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020997400000000001 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.653 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85051 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.710677724, 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044177951999999999, 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.654 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85051 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.96e-07 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929970+0000", 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.751e-06 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929977+0000", 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5420000000000002e-06 2024-09-21T22:02:35.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929981+0000", 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5739999999999997e-06 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973745+0000", 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043763541000000003 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973820+0000", 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974146+0000", 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00032645299999999999 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85052 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.710658683999998, 2024-09-21T22:02:35.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044346141999999998, 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85052 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6e-07 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929989+0000", 2024-09-21T22:02:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3820000000000001e-06 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929992+0000", 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1310000000000002e-06 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929994+0000", 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4760000000000001e-06 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974207+0000", 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044212491999999999 2024-09-21T22:02:35.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974266+0000", 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9098999999999998e-05 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974333+0000", 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7302e-05 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85053 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.710648635999998, 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044518747999999997, 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85053 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.663 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:02:35.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929999+0000", 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.221e-06 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930001+0000", 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.903e-06 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930004+0000", 2024-09-21T22:02:35.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3360000000000002e-06 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974399+0000", 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044395260999999998 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974440+0000", 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1254000000000002e-05 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974516+0000", 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5564999999999999e-05 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85054 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2162688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.710637303999999, 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044703447, 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.667 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85054 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930009+0000", 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930011+0000", 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.883e-06 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930016+0000", 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4369999999999998e-06 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930020+0000", 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3680000000000002e-06 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974543+0000", 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044523600000000003 2024-09-21T22:02:35.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974624+0000", 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0989999999999995e-05 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974712+0000", 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7831999999999995e-05 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85055 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.710622564000001, 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044885911000000001, 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85055 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.28e-07 2024-09-21T22:02:35.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930025+0000", 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3230000000000001e-06 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930032+0000", 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709999999999997e-06 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930035+0000", 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8770000000000002e-06 2024-09-21T22:02:35.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974740+0000", 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044704893000000002 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974822+0000", 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2047999999999998e-05 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974909+0000", 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7471000000000003e-05 2024-09-21T22:02:35.675 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85056 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.710608043000001, 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060964000000002, 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.676 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85056 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2600000000000001e-07 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930039+0000", 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1230000000000001e-06 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930043+0000", 2024-09-21T22:02:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8750000000000002e-06 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930047+0000", 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8840000000000004e-06 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974937+0000", 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044890473 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975014+0000", 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6574000000000002e-05 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975099+0000", 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4808999999999994e-05 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85057 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.710592896000001, 2024-09-21T22:02:35.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045182878000000003, 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85057 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930055+0000", 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1040000000000001e-06 2024-09-21T22:02:35.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930065+0000", 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0023e-05 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930070+0000", 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8400000000000002e-06 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975131+0000", 2024-09-21T22:02:35.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060718999999999 2024-09-21T22:02:35.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975183+0000", 2024-09-21T22:02:35.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1910999999999998e-05 2024-09-21T22:02:35.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975236+0000", 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2948000000000002e-05 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85062 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.686 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.708701827999999, 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044032922000000002, 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85062 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931945+0000", 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5499999999999998e-07 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931947+0000", 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931953+0000", 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1720000000000004e-06 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931958+0000", 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7169999999999999e-06 2024-09-21T22:02:35.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975829+0000", 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043871432000000002 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975894+0000", 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5060000000000004e-05 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975977+0000", 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2626999999999993e-05 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85063 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.708681314, 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044185847, 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.691 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85063 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931965+0000", 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4900000000000001e-07 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931967+0000", 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2359999999999999e-06 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931977+0000", 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8959999999999998e-06 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931982+0000", 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976005+0000", 2024-09-21T22:02:35.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044023195000000001 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976067+0000", 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1495999999999995e-05 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976150+0000", 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3458e-05 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85064 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.70865483, 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044333939000000003, 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85064 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.696 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:35.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931994+0000", 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932001+0000", 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7270000000000007e-06 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932005+0000", 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9009999999999996e-06 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976178+0000", 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044172185000000003 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976242+0000", 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4430999999999993e-05 2024-09-21T22:02:35.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976325+0000", 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2885000000000003e-05 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85065 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7471104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.708633942999999, 2024-09-21T22:02:35.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044487967000000003, 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85065 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-07 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932014+0000", 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4610000000000001e-06 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932017+0000", 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8319999999999999e-06 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932020+0000", 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.571e-06 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976351+0000", 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044330688 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976407+0000", 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6023999999999998e-05 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976500+0000", 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3142999999999999e-05 2024-09-21T22:02:35.704 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85066 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.708622912999999, 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044733053000000002, 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.705 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85066 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1e-07 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932024+0000", 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.108e-06 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932029+0000", 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.335e-06 2024-09-21T22:02:35.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932031+0000", 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976528+0000", 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044496971000000003 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976590+0000", 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2200999999999996e-05 2024-09-21T22:02:35.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976756+0000", 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016567200000000001 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85077 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.707647672, 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044123073999999998, 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.709 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85077 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932999+0000", 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.37e-07 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933006+0000", 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933013+0000", 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5510000000000002e-06 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933019+0000", 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5679999999999999e-06 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977004+0000", 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043985319000000002 2024-09-21T22:02:35.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977071+0000", 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7131000000000005e-05 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977121+0000", 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9925000000000001e-05 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85078 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.707619459, 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044323946000000003, 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85078 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933027+0000", 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933029+0000", 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933035+0000", 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933041+0000", 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8300000000000001e-06 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977158+0000", 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044117682999999998 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977273+0000", 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114307 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977350+0000", 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7466999999999995e-05 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.717 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85079 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.707598644000001, 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044512719999999999, 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.718 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85079 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933050+0000", 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933056+0000", 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.105e-06 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933060+0000", 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.561e-06 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977399+0000", 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044339296 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977465+0000", 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.546e-05 2024-09-21T22:02:35.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977560+0000", 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4905e-05 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85080 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.707539133000001, 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044578665000000003, 2024-09-21T22:02:35.722 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85080 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.37e-07 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933110+0000", 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9009999999999998e-06 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933119+0000", 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7609999999999996e-06 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933125+0000", 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3199999999999996e-06 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977587+0000", 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044462224000000002 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977629+0000", 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2064999999999998e-05 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977685+0000", 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.726 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85081 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.707511134000001, 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044717826000000002, 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85081 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:35.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933137+0000", 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933144+0000", 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9009999999999997e-06 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933150+0000", 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0179999999999998e-06 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977715+0000", 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044564469000000002 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977765+0000", 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0040000000000002e-05 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977852+0000", 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7820999999999998e-05 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85082 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.707489146, 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044866094000000002, 2024-09-21T22:02:35.731 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85082 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:35.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933159+0000", 2024-09-21T22:02:35.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1019999999999999e-06 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933165+0000", 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933170+0000", 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9860000000000002e-06 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:35.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977880+0000", 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044710059000000003 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977944+0000", 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4162e-05 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.978023+0000", 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8392000000000004e-05 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.735 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.736 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:35.736 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:35.736 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:35.737 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:35.738 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:no valid command found; 10 closest matches: 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:0 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:1 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:2 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:abort 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:assert 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:bench [] [] [] [] 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs debug_inject_read_zeros 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs files list 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:bluefs stats 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:bluestore allocator dump block 2024-09-21T22:02:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: invalid command 2024-09-21T22:02:35.740 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-21T22:02:35.740 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:35.735+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:35.838 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:35.836+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:35.858 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:35.858 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:35.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:35.858 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_repop(client.4388.0:91289 3.1d e119/23 3:be0d2986:::rbd_object_map.112428dc3761:head v 119'1240, mlcod=119'1238)", 2024-09-21T22:02:35.858 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:35.856863+0000", 2024-09-21T22:02:35.858 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 0.00049501899999999997, 2024-09-21T22:02:35.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00051152100000000002, 2024-09-21T22:02:35.858 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:35.856863+0000", 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:35.856863+0000", 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:35.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:35.856863+0000", 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9100000000000004e-07 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:35.856867+0000", 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8299999999999998e-06 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:35.856875+0000", 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8250000000000005e-06 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:35.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:35.856879+0000", 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9339999999999999e-06 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:35.856917+0000", 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8021000000000001e-05 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:35.856929+0000", 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2378000000000001e-05 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:35.861 INFO:teuthology.orchestra.run.smithi184.stdout: ], 2024-09-21T22:02:35.862 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 1 2024-09-21T22:02:35.862 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:35.867 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:35.939 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:35.938+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:36.011 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:36.012 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:36.012 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:36.012 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:36.012 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:36.020 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:36.040 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:36.038+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:36.125 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:36.125 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:36.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:36.125 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:36.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.125 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:02:36.125 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:36.125 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.911204974, 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:36.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:02:36.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:02:36.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56963 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 622592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.869143893999997, 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021343747, 2024-09-21T22:02:36.130 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56963 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2e-07 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253818+0000", 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1160000000000002e-06 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253823+0000", 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253828+0000", 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.274987+0000", 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021158445000000001 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275065+0000", 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8407999999999999e-05 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275159+0000", 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3497000000000003e-05 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56964 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.134 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.869124577000001, 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021459051999999999, 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56964 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253835+0000", 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253837+0000", 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253842+0000", 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8080000000000001e-06 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253847+0000", 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6099999999999999e-06 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275188+0000", 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021341057 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275230+0000", 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1941999999999999e-05 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275293+0000", 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3195999999999996e-05 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.138 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56965 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.869092576, 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021632274, 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56965 2024-09-21T22:02:36.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253867+0000", 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253869+0000", 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253875+0000", 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0970000000000002e-06 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253880+0000", 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275329+0000", 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021448292000000001 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275407+0000", 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7946000000000002e-05 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.142 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275499+0000", 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1978000000000006e-05 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56966 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1310720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.869072729000003, 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021740731999999999, 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.143 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56966 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:36.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253888+0000", 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0669999999999999e-06 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253894+0000", 2024-09-21T22:02:36.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8980000000000001e-06 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253900+0000", 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275526+0000", 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021625912000000001 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.146 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275569+0000", 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3043000000000001e-05 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275627+0000", 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7479000000000003e-05 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.147 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56967 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.148 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:36.148 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.869052557000003, 2024-09-21T22:02:36.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021928007999999999, 2024-09-21T22:02:36.148 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56967 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:36.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253907+0000", 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.41e-07 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253908+0000", 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.776e-06 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253914+0000", 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1950000000000002e-06 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253928+0000", 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3974e-05 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275662+0000", 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021734168000000002 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275740+0000", 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7807999999999998e-05 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275834+0000", 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4746000000000004e-05 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56968 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.869024414999998, 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022029615999999998, 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.153 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56968 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253935+0000", 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253937+0000", 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.155 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253943+0000", 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253948+0000", 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275861+0000", 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021913548000000001 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275905+0000", 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3795000000000003e-05 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275964+0000", 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8739000000000001e-05 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56969 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.157 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.869005745999999, 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022221162999999999, 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56969 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:36.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253955+0000", 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.874e-06 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253961+0000", 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999998e-06 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253965+0000", 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5260000000000004e-06 2024-09-21T22:02:36.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276000+0000", 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022034611999999999 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276078+0000", 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8311000000000003e-05 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276174+0000", 2024-09-21T22:02:36.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6139999999999998e-05 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56984 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868988127999998, 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022340279000000001, 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.162 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56984 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253973+0000", 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.81e-06 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253979+0000", 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.164 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253983+0000", 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276203+0000", 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022219848 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276248+0000", 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4880999999999999e-05 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276311+0000", 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3047999999999997e-05 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56985 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868970156000003, 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022528538000000001, 2024-09-21T22:02:36.166 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56985 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253991+0000", 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1229999999999998e-06 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253997+0000", 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4759999999999997e-06 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254003+0000", 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.896e-06 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276347+0000", 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022344180000000002 2024-09-21T22:02:36.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276424+0000", 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7014000000000005e-05 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276517+0000", 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3383999999999999e-05 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.170 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56986 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868950552999998, 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022636156000000001, 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56986 2024-09-21T22:02:36.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254009+0000", 2024-09-21T22:02:36.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254021+0000", 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2075e-05 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254027+0000", 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2910000000000004e-06 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254032+0000", 2024-09-21T22:02:36.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0969999999999996e-06 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276545+0000", 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022513014000000001 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276588+0000", 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3183000000000003e-05 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276644+0000", 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6165999999999997e-05 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56987 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 868352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868920082999999, 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022813353000000001, 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.175 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56987 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254041+0000", 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.177 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254047+0000", 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254051+0000", 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6430000000000003e-06 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276680+0000", 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022628945000000001 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276758+0000", 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7775999999999995e-05 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276852+0000", 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4067999999999995e-05 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56988 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1097728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:36.179 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868902667999997, 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923770999999999, 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56988 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254058+0000", 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254064+0000", 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2950000000000001e-06 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254068+0000", 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1479999999999999e-06 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276880+0000", 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022812260000000001 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276923+0000", 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3347999999999999e-05 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276980+0000", 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6496000000000003e-05 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56989 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1327104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:36.183 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868885661999997, 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023109826999999999, 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56989 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254075+0000", 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.691e-06 2024-09-21T22:02:36.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254081+0000", 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254085+0000", 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.498e-06 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277015+0000", 2024-09-21T22:02:36.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929417000000001 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277092+0000", 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6625000000000006e-05 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277183+0000", 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1453999999999995e-05 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56990 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1556480~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868867514999998, 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023224305000000001, 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56990 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.188 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254092+0000", 2024-09-21T22:02:36.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.22e-07 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254093+0000", 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7099999999999999e-06 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254099+0000", 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254103+0000", 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277211+0000", 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023107593999999999 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277254+0000", 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2762000000000002e-05 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277316+0000", 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1876000000000002e-05 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56991 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868850168999998, 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023415498999999999, 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56991 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254111+0000", 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.813e-06 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254116+0000", 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254121+0000", 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5730000000000001e-06 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277351+0000", 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023230621 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277431+0000", 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9818e-05 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277524+0000", 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2986999999999996e-05 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56992 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 2015232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:36.196 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868832679999997, 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023528238999999999, 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56992 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.197 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254128+0000", 2024-09-21T22:02:36.198 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8330000000000001e-06 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254134+0000", 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5729999999999998e-06 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254139+0000", 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4790000000000004e-06 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.199 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277553+0000", 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023413607999999999 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277596+0000", 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3489000000000003e-05 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277654+0000", 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7911999999999997e-05 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.200 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57020 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868335594999998, 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023243617000000001, 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57020 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.201 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254624+0000", 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.202 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254632+0000", 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1219999999999995e-06 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254640+0000", 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9370000000000004e-06 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254645+0000", 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3140000000000003e-06 2024-09-21T22:02:36.203 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277690+0000", 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023044477000000001 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277768+0000", 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8594e-05 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277867+0000", 2024-09-21T22:02:36.204 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8560999999999994e-05 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57021 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868306693999997, 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023344055999999998, 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.205 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57021 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.206 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254653+0000", 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254654+0000", 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254661+0000", 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.207 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254666+0000", 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277894+0000", 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023228029000000001 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277936+0000", 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2589000000000002e-05 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.208 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277996+0000", 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9967999999999999e-05 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57023 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 704512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 48.868287875, 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023525122999999998, 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.209 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57023 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.210 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.32e-07 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254679+0000", 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7479999999999993e-06 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254686+0000", 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.211 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254690+0000", 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7180000000000004e-06 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278021+0000", 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023330391999999998 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278097+0000", 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6464999999999994e-05 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.213 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.213 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278196+0000", 2024-09-21T22:02:36.213 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8852999999999997e-05 2024-09-21T22:02:36.213 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.213 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.213 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.213 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.213 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.213 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:36.214 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:36.215 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:36.212+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:36.315 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:36.313+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:36.318 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:36.318 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:36.318 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:36.319 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:36.327 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:36.416 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:36.415+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:36.471 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:36.472 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:36.472 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:36.472 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:36.472 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:36.480 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:36.517 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:36.515+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:36.586 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:36.586 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:36.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:36.586 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:36.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.586 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:02:36.586 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:36.586 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.531984201, 2024-09-21T22:02:36.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:02:36.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:36.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.655269707000002, 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.592 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:36.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:36.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:02:36.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.596 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.655259756999996, 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.597 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.655246353999999, 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.601 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:02:36.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:02:36.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.655236682999998, 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:02:36.605 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:36.609 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.653240846000003, 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:02:36.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.653194589999998, 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.614 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.653157254999996, 2024-09-21T22:02:36.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.622 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.653123074000007, 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.623 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.653083202000005, 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.627 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:02:36.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.631 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.653037917000006, 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:02:36.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85825 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2277376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.521940436999998, 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028813432, 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85825 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061936+0000", 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4790000000000001e-06 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061939+0000", 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1240000000000001e-06 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061941+0000", 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.452e-06 2024-09-21T22:02:36.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090598+0000", 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028656966999999998 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090675+0000", 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6914000000000003e-05 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090745+0000", 2024-09-21T22:02:36.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0290999999999995e-05 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85826 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2342912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.521928318999997, 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028888786999999999, 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.640 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85826 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061946+0000", 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.556e-06 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061949+0000", 2024-09-21T22:02:36.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9249999999999999e-06 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061951+0000", 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4739999999999999e-06 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090758+0000", 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028806486999999999 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090796+0000", 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8466000000000001e-05 2024-09-21T22:02:36.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090833+0000", 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6674000000000002e-05 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85827 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2408448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.521918364000001, 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029053266000000001, 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.644 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85827 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9999999999999999e-07 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061955+0000", 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.156e-06 2024-09-21T22:02:36.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061958+0000", 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9340000000000002e-06 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061961+0000", 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5040000000000001e-06 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090862+0000", 2024-09-21T22:02:36.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028901175000000001 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090937+0000", 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4881000000000004e-05 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091007+0000", 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0415999999999998e-05 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85828 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2473984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.521908684000003, 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029127014, 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85828 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.649 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:02:36.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061965+0000", 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061968+0000", 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.92e-06 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061971+0000", 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.101e-06 2024-09-21T22:02:36.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091020+0000", 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029048398999999999 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091056+0000", 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6718000000000003e-05 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091091+0000", 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4501000000000001e-05 2024-09-21T22:02:36.652 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85829 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2539520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.521859331000002, 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029251899000000001, 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.653 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85829 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062014+0000", 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062016+0000", 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062022+0000", 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:36.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062027+0000", 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2180000000000001e-06 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091120+0000", 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029093112000000001 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091195+0000", 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5499000000000003e-05 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091265+0000", 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9670000000000002e-05 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85830 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2605056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.521839685000003, 2024-09-21T22:02:36.657 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029323741, 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85830 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.658 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.659 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062034+0000", 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2729999999999999e-06 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062038+0000", 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.602e-06 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062042+0000", 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9949999999999999e-06 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.660 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091283+0000", 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029241195000000001 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091320+0000", 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7296999999999999e-05 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091356+0000", 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6170000000000001e-05 2024-09-21T22:02:36.661 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85831 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2670592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.521827213000002, 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029484659999999999, 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.662 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85831 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:36.663 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062047+0000", 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.664 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062050+0000", 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1099999999999999e-06 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062052+0000", 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4899999999999999e-06 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091385+0000", 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029333016999999999 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091461+0000", 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6019000000000005e-05 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091530+0000", 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8660999999999999e-05 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.666 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85832 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2736128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.521817181999999, 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029557844999999999, 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85832 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.667 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:36.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062057+0000", 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.119e-06 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062060+0000", 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9730000000000002e-06 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062062+0000", 2024-09-21T22:02:36.669 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091542+0000", 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029480309999999999 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091579+0000", 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6254000000000002e-05 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.670 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091613+0000", 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4555999999999999e-05 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85882 3.16 3:6c4a0c3b:::rbd_data.1124f4fa8d1.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 32.434825469000003, 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029882499999999999, 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:36.671 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85882 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.672 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149049+0000", 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.635e-06 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149054+0000", 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7939999999999999e-06 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.673 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149067+0000", 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2587e-05 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149074+0000", 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.25e-06 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149143+0000", 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9008000000000001e-05 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.674 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149216+0000", 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2947000000000005e-05 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149339+0000", 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012293800000000001 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178449+0000", 2024-09-21T22:02:36.675 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029110159 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178861+0000", 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000411808 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178898+0000", 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6745000000000001e-05 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178929+0000", 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1628999999999998e-05 2024-09-21T22:02:36.676 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.677 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.677 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.677 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:36.677 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:36.677 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:36.678 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:36.679 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:36.676+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:36.738 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:02:36.778 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:36.776+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:36.833 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:36.833 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:36.833 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:36.833 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:36.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:36.879 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:36.877+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:36.980 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:36.978+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:36.989 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:36.990 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:36.990 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:36.990 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:36.990 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:36.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:37.082 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:37.080+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 78.258152788000004, 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.259241274999994, 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:02:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.150784517999995, 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.120 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.150775225000004, 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.121 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.150751478999993, 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.126 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.127 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.128 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.150740925999997, 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.129 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:37.130 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:02:37.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:02:37.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.150731523000005, 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.133 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.134 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.135 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.136 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.150720733, 2024-09-21T22:02:37.137 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.138 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.139 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:02:37.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.141 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.15068746, 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.142 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.143 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:02:37.145 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.150676787999998, 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:02:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:02:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.146547296999998, 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:02:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.146148159000006, 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:02:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.145193567999996, 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:02:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:02:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.145170315000001, 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:02:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.143877645000003, 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:02:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:02:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:02:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.143858531999996, 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:02:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.143839401999998, 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.143821063999994, 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 77.143802664999995, 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:41899 3.10 3:0bb333a9:::rbd_data.11247a90fb52.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 68.346893253999994, 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015085853, 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 41899 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754789+0000", 2024-09-21T22:02:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.372e-06 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754796+0000", 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8249999999999999e-06 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754809+0000", 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3662000000000001e-05 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754816+0000", 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7220000000000002e-06 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754866+0000", 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9945999999999999e-05 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754919+0000", 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3329999999999999e-05 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.758040+0000", 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031204869999999999 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769752+0000", 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011712530000000001 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769803+0000", 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.117e-05 2024-09-21T22:02:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769841+0000", 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7982999999999999e-05 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769873+0000", 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1826000000000003e-05 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.195 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:37.197 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:37.197 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:37.195+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:37.297 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:37.295+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:37.301 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:37.301 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:37.301 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:37.301 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:37.310 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:37.398 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:37.396+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:37.453 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:37.453 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:37.453 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:37.453 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:37.453 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:37.462 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:37.499 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:37.497+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:37.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 119.490334187, 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.566 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.567 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.568 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.569 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.570 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.571 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.572 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.058297936000002, 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:37.573 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.575 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.576 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.577 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:37.578 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 79.705471118999995, 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.579 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.580 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.581 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.582 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 79.705451655999994, 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.583 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.584 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.585 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:02:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 79.705423578999998, 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:02:37.587 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.588 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.589 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:02:37.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.591 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 79.705401746999996, 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.592 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.593 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.594 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:02:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 79.705381419999995, 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.598 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.599 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 79.705360458000001, 2024-09-21T22:02:37.600 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.601 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.602 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.603 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:37.604 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 79.705339471000002, 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.605 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:02:37.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.607 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:37.608 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 56.763892677000001, 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:02:37.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.611 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:37.612 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.613 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81730 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7127040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 36.390272281000001, 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023997688999999999, 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81730 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.614 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173444+0000", 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173450+0000", 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173456+0000", 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0599999999999996e-06 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173461+0000", 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5279999999999997e-06 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.616 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197301+0000", 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023840647 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197353+0000", 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2222000000000002e-05 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197441+0000", 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.617 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81734 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 36.390236848000001, 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024110228000000001, 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81734 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173482+0000", 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.136e-06 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173488+0000", 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3380000000000001e-06 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173493+0000", 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197456+0000", 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023962944999999999 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197495+0000", 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9385000000000003e-05 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197589+0000", 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4097000000000004e-05 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.621 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81735 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 36.390216473000002, 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024317473999999999, 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81735 2024-09-21T22:02:37.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.623 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173500+0000", 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173502+0000", 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9580000000000001e-06 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173507+0000", 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6080000000000003e-06 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.624 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173516+0000", 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8130000000000002e-06 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197630+0000", 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024114304 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197717+0000", 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6839e-05 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.625 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197817+0000", 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9494000000000007e-05 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81736 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 36.390193613999998, 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024493269000000002, 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.626 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81736 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:37.627 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173523+0000", 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173524+0000", 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173531+0000", 2024-09-21T22:02:37.628 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.049e-06 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173539+0000", 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5790000000000004e-06 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197853+0000", 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024313950000000001 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.629 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197926+0000", 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2606000000000002e-05 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198015+0000", 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9728000000000006e-05 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81737 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 3883008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:37.630 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 36.390170765999997, 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024642094, 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81737 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.631 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.632 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173547+0000", 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.013e-06 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173554+0000", 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4559999999999997e-06 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173558+0000", 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4240000000000003e-06 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.633 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198041+0000", 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024483076999999999 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198102+0000", 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1066000000000001e-05 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198187+0000", 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4685000000000007e-05 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.634 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81738 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 4571136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 36.390151916000001, 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024869964000000001, 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81738 2024-09-21T22:02:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:37.636 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173566+0000", 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.86e-06 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173574+0000", 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3200000000000002e-06 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173578+0000", 2024-09-21T22:02:37.637 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5360000000000003e-06 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198231+0000", 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024653195999999999 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198318+0000", 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6810000000000004e-05 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.638 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198434+0000", 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011572 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81739 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 36.390131738999997, 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024965376000000001, 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.639 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81739 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.640 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173590+0000", 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173596+0000", 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1199999999999999e-06 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.641 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173600+0000", 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2379999999999999e-06 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198454+0000", 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024854246 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198496+0000", 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2202e-05 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.642 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198549+0000", 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3038999999999998e-05 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81740 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 6537216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 36.390109801000001, 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025068272999999999, 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.643 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81740 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.644 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173608+0000", 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173614+0000", 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:02:37.645 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173618+0000", 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.459e-06 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198573+0000", 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024954473000000001 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198614+0000", 2024-09-21T22:02:37.646 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.087e-05 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198674+0000", 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0528000000000001e-05 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81749 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7815168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 36.390091585, 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025172553, 2024-09-21T22:02:37.647 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81749 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.648 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173625+0000", 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.46e-07 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173626+0000", 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.841e-06 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.649 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173632+0000", 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8130000000000001e-06 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173638+0000", 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198697+0000", 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025059100000000001 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198736+0000", 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9319000000000001e-05 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198797+0000", 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0445000000000001e-05 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:90311 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:37.651 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 10.826054064000001, 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.98809498799999995, 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 90311 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.652 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6599999999999995e-07 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737667+0000", 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.442e-06 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:37.653 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737677+0000", 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0132000000000001e-05 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737682+0000", 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0010000000000001e-06 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737760+0000", 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8349999999999994e-05 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.654 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737772+0000", 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1209999999999999e-05 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:27.725508+0000", 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.98773678200000004 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:27.725615+0000", 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000107091 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:37.655 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:37.656 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:27.725757+0000", 2024-09-21T22:02:37.656 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00014121399999999999 2024-09-21T22:02:37.656 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.656 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.656 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.656 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:37.656 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:37.656 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:37.657 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:37.655+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:37.658 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:37.672 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:37.689 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:37.706 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:37.706 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:37.722 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:37.722 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:37.739 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:37.756 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:37.758 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:37.756+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:37.763 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:37.763 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:37.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:37.772 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:37.773 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:37.780 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:02:37.799 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:37.799 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:37.859 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:37.857+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:37.886 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:37.886 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:37.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:37.960 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:37.959+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:37.999 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:37.999 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:38.008 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:38.061 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:38.059+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:38.111 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:38.111 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:38.120 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:38.161 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:38.159+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:38.262 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:38.262 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:38.263 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:38.260+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:38.272 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:38.364 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:38.362+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:38.414 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:38.414 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:38.423 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:38.464 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:38.463+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:38.526 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:38.526 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:38.535 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:38.578 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:38.576+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:38.637 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:38.637 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:38.646 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:38.687 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:38.685+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:38.767 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:38.765+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:38.795 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:38.795 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:38.804 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:38.868 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:38.866+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:38.953 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:38.954 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:38.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:38.969 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:38.967+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:39.064 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:39.064 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:39.069 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:39.067+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:39.073 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:39.171 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:39.169+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:39.216 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:39.216 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:39.225 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:39.272 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:39.270+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:39.329 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:39.329 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:39.338 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:39.372 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:39.370+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:39.442 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:39.442 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:39.450 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:39.473 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:39.471+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:39.554 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:39.554 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:39.563 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:39.608 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:39.606+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:39.666 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:39.666 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:39.674 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:39.672+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:39.675 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:39.774 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:39.772+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:39.799 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:02:39.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:39.823 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:39.823 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:39.832 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:39.885 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:39.883+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:39.970 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:39.970 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:39.975 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:39.973+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:39.978 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:39.978 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:39.987 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:39.988 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:39.988 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:40.004 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:40.020 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:40.020 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:40.036 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:40.037 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:40.053 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:40.053 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:40.069 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:40.069 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:40.076 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:40.074+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:40.086 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:40.086 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:40.132 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:40.132 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:40.132 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:40.132 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:40.141 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:40.185 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:40.183+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:40.243 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:40.243 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:40.243 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:40.243 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:40.243 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:40.252 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:40.278 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:40.276+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:40.378 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:40.377+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 81.550402081000001, 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:02:40.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:40.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.400 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.551490568000006, 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:02:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:02:40.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.409 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.443033811000006, 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:02:40.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.413 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.443024518000001, 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.414 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:02:40.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:02:40.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.417 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.443000772000005, 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.418 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:02:40.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:02:40.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.442990218999995, 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.422 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.442980816000002, 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.426 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.442970025999998, 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.431 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.434 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.442936752999998, 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.435 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.438 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.442926080999996, 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:02:40.439 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:40.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:02:40.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:02:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.438796589999995, 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:02:40.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.444 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.445 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.446 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.438397452000004, 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.447 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:02:40.448 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.449 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.450 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.437442860999994, 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.452 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.453 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.454 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.437419607999999, 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.455 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.456 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.457 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.458 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.436126938000001, 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.459 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.460 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:02:40.461 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.462 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.436107824999993, 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.463 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:02:40.464 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.465 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.466 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.436088694999995, 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.467 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:02:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.436070357000006, 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:02:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 80.436051957999993, 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:02:40.476 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:02:40.477 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.478 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:41899 3.10 3:0bb333a9:::rbd_data.11247a90fb52.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 71.639142547000006, 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015085853, 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 41899 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.479 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754789+0000", 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.372e-06 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.480 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754796+0000", 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8249999999999999e-06 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754809+0000", 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3662000000000001e-05 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754816+0000", 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7220000000000002e-06 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754866+0000", 2024-09-21T22:02:40.481 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9945999999999999e-05 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754919+0000", 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3329999999999999e-05 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.758040+0000", 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031204869999999999 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769752+0000", 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011712530000000001 2024-09-21T22:02:40.482 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769803+0000", 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.117e-05 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769841+0000", 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7982999999999999e-05 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769873+0000", 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1826000000000003e-05 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.484 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.484 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.484 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.484 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:40.485 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:40.485 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:40.483+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:40.585 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:40.583+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:40.629 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:40.629 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:40.629 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:40.629 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:40.638 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:40.722 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:40.720+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:40.740 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7] out_osds: [6, 2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:02:40.740 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:02:40.740 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-21T22:02:40.740 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:02:40.781 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:40.781 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:40.781 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:40.781 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:40.781 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:40.787 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:40.785+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:40.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:40.803 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:02:40.888 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:40.887+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:40.940 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:40.940 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:40.940 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:40.940 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:40.940 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.940 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:02:40.940 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:40.940 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 122.864413817, 2024-09-21T22:02:40.940 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:02:40.940 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.941 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.943 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:02:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:02:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:02:40.946 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 95.432377566, 2024-09-21T22:02:40.947 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.948 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.949 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:02:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:02:40.951 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:02:40.952 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:40.953 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 83.079550749000006, 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.954 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.955 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.956 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:02:40.957 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 83.079531286000005, 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.958 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:40.959 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.960 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.962 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 83.079503208999995, 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.963 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.964 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:02:40.965 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.966 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 83.079481376999993, 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.967 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:40.968 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.969 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:02:40.970 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.971 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 83.079461050000006, 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.972 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:02:40.973 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:02:40.974 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.975 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 83.079440087999998, 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.976 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.977 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:02:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.979 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:40.980 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 83.079419100999999, 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.981 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:02:40.982 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:02:40.983 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 60.137972306999998, 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.985 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.986 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.987 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.988 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.989 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81730 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7127040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 39.764351910999999, 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023997688999999999, 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.990 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81730 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:40.991 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173444+0000", 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173450+0000", 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173456+0000", 2024-09-21T22:02:40.992 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0599999999999996e-06 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173461+0000", 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5279999999999997e-06 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197301+0000", 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023840647 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197353+0000", 2024-09-21T22:02:40.993 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2222000000000002e-05 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197441+0000", 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81734 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 39.764316477999998, 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024110228000000001, 2024-09-21T22:02:40.994 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81734 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.995 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173482+0000", 2024-09-21T22:02:40.997 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.136e-06 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173488+0000", 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3380000000000001e-06 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173493+0000", 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197456+0000", 2024-09-21T22:02:40.998 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023962944999999999 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197495+0000", 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9385000000000003e-05 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197589+0000", 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4097000000000004e-05 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81735 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 39.764296103, 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024317473999999999, 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81735 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173500+0000", 2024-09-21T22:02:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173502+0000", 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9580000000000001e-06 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173507+0000", 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6080000000000003e-06 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173516+0000", 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8130000000000002e-06 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197630+0000", 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024114304 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197717+0000", 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6839e-05 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197817+0000", 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9494000000000007e-05 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81736 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 39.764273244000002, 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024493269000000002, 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81736 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.005 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173523+0000", 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173524+0000", 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.006 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173531+0000", 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.049e-06 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173539+0000", 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5790000000000004e-06 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197853+0000", 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024313950000000001 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.007 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197926+0000", 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2606000000000002e-05 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198015+0000", 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9728000000000006e-05 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81737 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 3883008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:41.008 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 39.764250396000001, 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024642094, 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81737 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:41.009 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.010 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173547+0000", 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.013e-06 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173554+0000", 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4559999999999997e-06 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173558+0000", 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4240000000000003e-06 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:41.011 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198041+0000", 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024483076999999999 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198102+0000", 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1066000000000001e-05 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198187+0000", 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4685000000000007e-05 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.012 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81738 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 4571136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 39.764231545999998, 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024869964000000001, 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81738 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:41.013 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:41.014 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173566+0000", 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.86e-06 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173574+0000", 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3200000000000002e-06 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173578+0000", 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5360000000000003e-06 2024-09-21T22:02:41.015 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198231+0000", 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024653195999999999 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198318+0000", 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6810000000000004e-05 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198434+0000", 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011572 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.016 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81739 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 39.764211369000002, 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024965376000000001, 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81739 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.017 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.018 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173590+0000", 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173596+0000", 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1199999999999999e-06 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173600+0000", 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2379999999999999e-06 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.019 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198454+0000", 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024854246 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198496+0000", 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2202e-05 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198549+0000", 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3038999999999998e-05 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:41.020 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81740 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 6537216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 39.764189430999998, 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025068272999999999, 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81740 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:41.021 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.022 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173608+0000", 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173614+0000", 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173618+0000", 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.459e-06 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.023 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198573+0000", 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024954473000000001 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198614+0000", 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.087e-05 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198674+0000", 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0528000000000001e-05 2024-09-21T22:02:41.024 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81749 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7815168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 39.764171214999998, 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025172553, 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81749 2024-09-21T22:02:41.025 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173625+0000", 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.46e-07 2024-09-21T22:02:41.026 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173626+0000", 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.841e-06 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173632+0000", 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8130000000000001e-06 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173638+0000", 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.027 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198697+0000", 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025059100000000001 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198736+0000", 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9319000000000001e-05 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198797+0000", 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0445000000000001e-05 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.028 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:90311 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 14.200133694, 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.98809498799999995, 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 90311 2024-09-21T22:02:41.029 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6599999999999995e-07 2024-09-21T22:02:41.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737667+0000", 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.442e-06 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737677+0000", 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0132000000000001e-05 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737682+0000", 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0010000000000001e-06 2024-09-21T22:02:41.031 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737760+0000", 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8349999999999994e-05 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737772+0000", 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1209999999999999e-05 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:27.725508+0000", 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.98773678200000004 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.032 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:27.725615+0000", 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000107091 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:27.725757+0000", 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00014121399999999999 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:41.033 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:41.034 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:41.035 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:41.032+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 124, 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "014f3ec5-afd0-4b18-9c74-de91f34d0760", 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-09-21T22:00:24.916784+0000", 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-09-21T22:02:40.787910+0000", 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-09-21T22:00:36.060631+0000", 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-09-21T22:02:29.712852+0000", 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5801984, 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "noscrub", 2024-09-21T22:02:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 5, 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 3, 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 8, 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "luminous", 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-09-21T22:02:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:37.034134+0000", 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "17", 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-09-21T22:02:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 8, 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 8, 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.25, 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:02:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:42.753049+0000", 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "21", 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 2, 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 21, 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:02:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 3, 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 3, 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.75, 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2.25, 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2.25, 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "pool_client.0", 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:52.269263+0000", 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "124", 2024-09-21T22:02:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 47, 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 124, 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2, 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2, 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.75, 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.5, 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.5, 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.89355659484863281, 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "ebc4f0b9-33fc-4301-b1c0-ac843b19095b", 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 13, 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 116, 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6808", 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6809", 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6810", 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6811", 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6814", 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6815", 2024-09-21T22:02:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6812", 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6813", 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6809/3559797623", 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6811/3559797623", 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6815/3559797623", 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6813/3559797623", 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "1c8f54fe-439f-486e-8b8b-fe892332ada3", 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 0.1484527587890625, 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 115, 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6824", 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6825", 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6826", 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6827", 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6830", 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6831", 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6828", 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6829", 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6825/428384344", 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6827/428384344", 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6831/428384344", 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6829/428384344", 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "b202159c-804c-4d22-9aa3-8f590dce8faa", 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 0, 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 0, 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 115, 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6816", 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6817", 2024-09-21T22:02:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6818", 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6819", 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6822", 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6823", 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6820", 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6821", 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6817/4237051748", 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6819/4237051748", 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6823/4237051748", 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6821/4237051748", 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "28a8c407-a445-4c76-8d7c-d5a249d13e03", 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 116, 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6800", 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6801", 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6802", 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6803", 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6806", 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6807", 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6804", 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6805", 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6801/3004236595", 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6803/3004236595", 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6807/3004236595", 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6805/3004236595", 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605", 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 116, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6824", 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6825", 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6826", 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6827", 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6830", 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6831", 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6828", 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6829", 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6825/743062291", 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6827/743062291", 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6831/743062291", 2024-09-21T22:02:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6829/743062291", 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7a0cc26e-a543-4647-bc53-fbecb69b2326", 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 116, 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6808", 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6809", 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6810", 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6811", 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6814", 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6815", 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6812", 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6813", 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6809/2410886219", 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6811/2410886219", 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6815/2410886219", 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6813/2410886219", 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7768eeb7-c6d0-47d8-a400-c47a2154c590", 2024-09-21T22:02:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 0, 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 0, 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 48, 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6800", 2024-09-21T22:02:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6801", 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6802", 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6803", 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6806", 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6807", 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6804", 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6805", 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6801/2491178498", 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6803/2491178498", 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6807/2491178498", 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6805/2491178498", 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "30ed992b-2e99-4523-9fdd-8389f75940af", 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 113, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6816", 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6817", 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6818", 2024-09-21T22:02:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6819", 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6822", 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6823", 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6820", 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6821", 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6817/1580142875", 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6819/1580142875", 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6823/1580142875", 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6821/1580142875", 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.652871+0000", 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.866866+0000", 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 65536, 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.859757+0000", 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:34.082180+0000", 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.844484+0000", 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.746321+0000", 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 65536, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.324821+0000", 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.093833+0000", 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [ 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "pgid": "3.5", 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: 3, 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: 2 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "pgid": "3.1c", 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:02:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: 7, 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: 3 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-09-21T22:02:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [ 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "snaps": [ 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "begin": 18, 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "length": 9 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [ 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "snaps": [ 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "begin": 18, 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "length": 1 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-09-21T22:02:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-09-21T22:02:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:02:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:02:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-09-21T22:02:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.126 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:41.127 INFO:tasks.thrashosds.thrasher:j is {'epoch': 124, 'fsid': '014f3ec5-afd0-4b18-9c74-de91f34d0760', 'created': '2024-09-21T22:00:24.916784+0000', 'modified': '2024-09-21T22:02:40.787910+0000', 'last_up_change': '2024-09-21T22:00:36.060631+0000', 'last_in_change': '2024-09-21T22:02:29.712852+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:00:37.034134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:00:42.753049+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.75, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:00:52.269263+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 47, 'snap_epoch': 124, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8935565948486328, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}], 'osds': [{'osd': 0, 'uuid': 'ebc4f0b9-33fc-4301-b1c0-ac843b19095b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6808', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6809', 'nonce': 3559797623}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6810', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6811', 'nonce': 3559797623}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6814', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6815', 'nonce': 3559797623}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6812', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6813', 'nonce': 3559797623}]}, 'public_addr': '172.21.15.102:6809/3559797623', 'cluster_addr': '172.21.15.102:6811/3559797623', 'heartbeat_back_addr': '172.21.15.102:6815/3559797623', 'heartbeat_front_addr': '172.21.15.102:6813/3559797623', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1c8f54fe-439f-486e-8b8b-fe892332ada3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1484527587890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6824', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6825', 'nonce': 428384344}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6826', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6827', 'nonce': 428384344}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6830', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6831', 'nonce': 428384344}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6828', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6829', 'nonce': 428384344}]}, 'public_addr': '172.21.15.102:6825/428384344', 'cluster_addr': '172.21.15.102:6827/428384344', 'heartbeat_back_addr': '172.21.15.102:6831/428384344', 'heartbeat_front_addr': '172.21.15.102:6829/428384344', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'b202159c-804c-4d22-9aa3-8f590dce8faa', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6816', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6817', 'nonce': 4237051748}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6818', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6819', 'nonce': 4237051748}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6822', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6823', 'nonce': 4237051748}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6820', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6821', 'nonce': 4237051748}]}, 'public_addr': '172.21.15.102:6817/4237051748', 'cluster_addr': '172.21.15.102:6819/4237051748', 'heartbeat_back_addr': '172.21.15.102:6823/4237051748', 'heartbeat_front_addr': '172.21.15.102:6821/4237051748', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '28a8c407-a445-4c76-8d7c-d5a249d13e03', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 3004236595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 3004236595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 3004236595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 3004236595}]}, 'public_addr': '172.21.15.102:6801/3004236595', 'cluster_addr': '172.21.15.102:6803/3004236595', 'heartbeat_back_addr': '172.21.15.102:6807/3004236595', 'heartbeat_front_addr': '172.21.15.102:6805/3004236595', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6824', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6825', 'nonce': 743062291}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6826', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6827', 'nonce': 743062291}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6830', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6831', 'nonce': 743062291}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6828', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6829', 'nonce': 743062291}]}, 'public_addr': '172.21.15.184:6825/743062291', 'cluster_addr': '172.21.15.184:6827/743062291', 'heartbeat_back_addr': '172.21.15.184:6831/743062291', 'heartbeat_front_addr': '172.21.15.184:6829/743062291', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '7a0cc26e-a543-4647-bc53-fbecb69b2326', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6808', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6809', 'nonce': 2410886219}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6810', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6811', 'nonce': 2410886219}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6814', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6815', 'nonce': 2410886219}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6812', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6813', 'nonce': 2410886219}]}, 'public_addr': '172.21.15.184:6809/2410886219', 'cluster_addr': '172.21.15.184:6811/2410886219', 'heartbeat_back_addr': '172.21.15.184:6815/2410886219', 'heartbeat_front_addr': '172.21.15.184:6813/2410886219', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '7768eeb7-c6d0-47d8-a400-c47a2154c590', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6800', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6801', 'nonce': 2491178498}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6802', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6803', 'nonce': 2491178498}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6806', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6807', 'nonce': 2491178498}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6804', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6805', 'nonce': 2491178498}]}, 'public_addr': '172.21.15.184:6801/2491178498', 'cluster_addr': '172.21.15.184:6803/2491178498', 'heartbeat_back_addr': '172.21.15.184:6807/2491178498', 'heartbeat_front_addr': '172.21.15.184:6805/2491178498', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '30ed992b-2e99-4523-9fdd-8389f75940af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6816', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6817', 'nonce': 1580142875}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6818', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6819', 'nonce': 1580142875}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6822', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6823', 'nonce': 1580142875}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6820', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6821', 'nonce': 1580142875}]}, 'public_addr': '172.21.15.184:6817/1580142875', 'cluster_addr': '172.21.15.184:6819/1580142875', 'heartbeat_back_addr': '172.21.15.184:6823/1580142875', 'heartbeat_front_addr': '172.21.15.184:6821/1580142875', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.652871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.866866+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.859757+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:34.082180+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.844484+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.746321+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.324821+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.093833+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.5', 'osds': [3, 2]}, {'pgid': '3.1c', 'osds': [7, 3]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 18, 'length': 9}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 18, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:02:41.127 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-21T22:02:41.139 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:41.139 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:41.140 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:41.140 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:41.140 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:41.138+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:41.148 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:41.236 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:41.235+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:41.292 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:41.292 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:41.292 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:41.292 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:41.292 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:41.301 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:41.337 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:41.336+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:41.405 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:41.405 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:41.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:41.405 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:41.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.405 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.164009535999995, 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:02:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:02:41.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:02:41.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163987516999995, 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.410 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:41.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163966935999994, 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.414 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:41.418 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163938337999994, 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:02:41.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.422 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163915932999998, 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:02:41.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163895917999994, 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.427 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163875715000003, 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:41.435 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163856456000005, 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163830388999997, 2024-09-21T22:02:41.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:02:41.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:41.443 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163809737999998, 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163751559000005, 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:02:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:02:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163696779999995, 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163662324000001, 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:02:41.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:02:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.459 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163640994000005, 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:02:41.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:02:41.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.463 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163619832999998, 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163589309000002, 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:02:41.467 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:02:41.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163564949999994, 2024-09-21T22:02:41.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:02:41.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:02:41.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163543645000004, 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.475 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.476 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163522255000004, 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.479 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.163500888000002, 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.483 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:02:41.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:02:41.486 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.487 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.487 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.487 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.487 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.487 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:41.488 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:41.488 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:41.487+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:41.588 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:41.586+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:41.591 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:41.591 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:41.591 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:41.591 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:41.600 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:41.689 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:41.687+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:41.743 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:41.743 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:41.743 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:41.743 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:41.743 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:41.752 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:41.793 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:41.791+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:41.891 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:41.890+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:41.921 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:41.921 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:41.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:41.921 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:41.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.921 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.921 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.955211528999996, 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:02:41.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:02:41.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.955190287999997, 2024-09-21T22:02:41.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:02:41.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.930 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.955169060000003, 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:02:41.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:41.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.955145454000004, 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.935 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:41.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:02:41.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:02:41.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.955126164000006, 2024-09-21T22:02:41.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:41.943 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.955093918000003, 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:41.947 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.955069949000006, 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:41.951 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.955050385000007, 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:02:41.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:02:41.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.955 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.955029952999993, 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:02:41.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:02:41.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.955008829999997, 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:02:41.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:02:41.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.954989613999999, 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:41.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:02:41.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:41.967 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.954969141999996, 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.971 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.954948427000005, 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.954928671000005, 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.954908955999997, 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.954889046000005, 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:02:41.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.987 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.954868063000006, 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.991 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.954847379, 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:02:41.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:41.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:02:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:02:41.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.954821475000003, 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:02:41.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:02:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:02:41.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:02:41.999 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 83.954800558000002, 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:42.000 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:42.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:42.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:42.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:42.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:02:42.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:02:42.004 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:42.004 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:42.004 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:42.004 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:42.004 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:42.004 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:42.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:42.006 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:42.003+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:42.097 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:42.141 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:42.139+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:42.152 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:42.152 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:42.152 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:42.152 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:42.161 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:42.206 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:42.205+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:42.219 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:42.219 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:42.237 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:42.237 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:42.253 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:42.253 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:42.270 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:42.270 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:42.287 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:42.287 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:42.304 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:42.304 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:42.306 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:42.307 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:42.307 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:42.305+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:42.316 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:42.321 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:42.321 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:42.338 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:42.339 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:42.407 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:42.406+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:42.425 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:42.425 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:42.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:42.508 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:42.507+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:42.577 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:42.577 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:42.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:42.630 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:42.628+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:42.690 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:42.690 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:42.698 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:42.710 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:42.708+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:42.811 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:42.809+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:42.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:02:42.850 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:42.850 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:42.861 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:42.912 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:42.910+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:42.970 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:42.970 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:42.979 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:43.013 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:43.011+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:43.113 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:43.111+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:43.122 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:43.122 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:43.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:43.214 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:43.213+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:43.234 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:43.234 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:43.243 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:43.327 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:43.325+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:43.387 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:43.387 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:43.396 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:43.437 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:43.435+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:43.517 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:43.515+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:43.539 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:43.539 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:43.547 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:43.618 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:43.616+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:43.650 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:43.650 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:43.659 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:43.719 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:43.717+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:43.762 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:43.762 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:43.771 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:43.817 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:02:43.856 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:43.854+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:43.921 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:43.919+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:43.925 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:43.926 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:43.935 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:44.021 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:44.020+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:44.078 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:44.078 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:44.087 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:44.128 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:44.126+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:44.223 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:44.221+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:44.230 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:44.230 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:44.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:44.323 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:44.321+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:44.343 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:44.343 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:44.350 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:44.352 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:44.424 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:44.422+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:44.470 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:44.486 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:44.486 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:44.495 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:44.495 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:44.502 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:44.502 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:44.504 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:44.518 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:44.518 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:44.524 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:44.522+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:44.535 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:44.536 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:44.553 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:44.553 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:44.569 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:44.569 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:44.586 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:44.586 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:44.615 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:44.615 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:44.615 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:44.615 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:44.624 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:44.625 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:44.624+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:44.726 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:44.724+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:44.778 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:44.788 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:44.827 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:44.825+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:44.928 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:44.926+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:44.935 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.935 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15653 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.694194392, 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023933159999999998, 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15653 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239187+0000", 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0499999999999999e-07 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239189+0000", 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.03e-06 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239196+0000", 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7070000000000003e-06 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239201+0000", 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0270000000000003e-06 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.262999+0000", 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023798651000000001 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263061+0000", 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1956000000000001e-05 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263120+0000", 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8384000000000002e-05 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15654 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 655360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.694172373000001, 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024202446999999998, 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15654 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239209+0000", 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1899999999999998e-07 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239211+0000", 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0320000000000002e-06 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239218+0000", 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239223+0000", 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1159999999999998e-06 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263208+0000", 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023985685999999999 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263299+0000", 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0625999999999996e-05 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263411+0000", 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011208 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15655 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.694151792, 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024327422000000001, 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15655 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239229+0000", 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239230+0000", 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:44.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239232+0000", 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239238+0000", 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.669e-06 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239243+0000", 2024-09-21T22:02:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7990000000000001e-06 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263443+0000", 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024200251999999998 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263497+0000", 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4070999999999998e-05 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263557+0000", 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9280000000000002e-05 2024-09-21T22:02:44.947 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15656 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.694123193999999, 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024545507000000001, 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.948 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15656 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239258+0000", 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3900000000000004e-07 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239261+0000", 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2759999999999999e-06 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239268+0000", 2024-09-21T22:02:44.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8680000000000001e-06 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239272+0000", 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9200000000000003e-06 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263599+0000", 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024326621999999999 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263691+0000", 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2335000000000003e-05 2024-09-21T22:02:44.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263803+0000", 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111847 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15657 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.694100789000004, 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024676032000000001, 2024-09-21T22:02:44.952 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15657 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239280+0000", 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239281+0000", 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239283+0000", 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1330000000000002e-06 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239289+0000", 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1330000000000004e-06 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239294+0000", 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0470000000000001e-06 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263844+0000", 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024550099999999998 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263895+0000", 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0531000000000001e-05 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263956+0000", 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1628e-05 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15658 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.694080774, 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024903191000000002, 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15658 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239300+0000", 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239301+0000", 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.13e-07 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239303+0000", 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3209999999999999e-06 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239309+0000", 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239314+0000", 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9099999999999996e-06 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.263999+0000", 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024684562 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264090+0000", 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1552999999999996e-05 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264203+0000", 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113007 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15659 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2424832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.694060570999994, 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025015755000000001, 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15659 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239320+0000", 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239321+0000", 2024-09-21T22:02:44.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.77e-07 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239323+0000", 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.951e-06 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239329+0000", 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1689999999999997e-06 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239334+0000", 2024-09-21T22:02:44.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7110000000000003e-06 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264236+0000", 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024901932000000002 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264279+0000", 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3624000000000001e-05 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264336+0000", 2024-09-21T22:02:44.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6990999999999997e-05 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15660 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.694041311999996, 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025239391999999999, 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15660 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239340+0000", 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.08e-07 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239346+0000", 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3720000000000001e-06 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239353+0000", 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239359+0000", 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1800000000000001e-06 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264374+0000", 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025014418 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264461+0000", 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7256000000000006e-05 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264579+0000", 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011805 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15661 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.694015245000003, 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025350989000000001, 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.969 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15661 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:44.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239366+0000", 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1399999999999997e-07 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239368+0000", 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.995e-06 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239375+0000", 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2024-09-21T22:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239379+0000", 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264611+0000", 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025232002 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264655+0000", 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3587000000000001e-05 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264717+0000", 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1725999999999998e-05 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15662 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693994594000003, 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025570256999999999, 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.973 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15662 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239386+0000", 2024-09-21T22:02:44.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239387+0000", 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.89e-07 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239393+0000", 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.823e-06 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239399+0000", 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3990000000000001e-06 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239405+0000", 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6810000000000003e-06 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264756+0000", 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025351545999999999 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264844+0000", 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7497000000000006e-05 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264957+0000", 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112922 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15663 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 3997696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693936414999996, 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025645925, 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15663 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239445+0000", 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7800000000000001e-07 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239457+0000", 2024-09-21T22:02:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1929999999999999e-05 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239466+0000", 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7430000000000008e-06 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239490+0000", 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.368e-05 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.264990+0000", 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025500511999999999 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265034+0000", 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.367e-05 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265090+0000", 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6712000000000002e-05 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15664 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4456448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693881636, 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025830654000000002, 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15664 2024-09-21T22:02:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239499+0000", 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239500+0000", 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9699999999999996e-07 2024-09-21T22:02:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239503+0000", 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7489999999999999e-06 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239519+0000", 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6155999999999999e-05 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239526+0000", 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7039999999999997e-06 2024-09-21T22:02:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265130+0000", 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025604768 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265219+0000", 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8765999999999997e-05 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265330+0000", 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110914 2024-09-21T22:02:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15665 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693847180000006, 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025919708999999999, 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15665 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239534+0000", 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7399999999999998e-07 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239537+0000", 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5809999999999999e-06 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239544+0000", 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8770000000000004e-06 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239549+0000", 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2410000000000003e-06 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265353+0000", 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025803943999999999 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265398+0000", 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4734999999999998e-05 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265453+0000", 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15666 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5373952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693825849999996, 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026140967000000001, 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.990 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15666 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239555+0000", 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239557+0000", 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9829999999999999e-06 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239564+0000", 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1290000000000001e-06 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239568+0000", 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7119999999999999e-06 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265499+0000", 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025930515000000001 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265587+0000", 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7781999999999994e-05 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265696+0000", 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109474 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15667 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693804689000004, 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026249686000000001, 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.994 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15667 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239576+0000", 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239577+0000", 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239579+0000", 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0370000000000001e-06 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239585+0000", 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999997e-06 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239590+0000", 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9110000000000001e-06 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265728+0000", 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026137443 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265772+0000", 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4808000000000002e-05 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:44.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265826+0000", 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3474999999999999e-05 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15668 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6029312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693774164999994, 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026456302000000001, 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:44.998 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15668 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:44.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239607+0000", 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6700000000000003e-07 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239610+0000", 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5689999999999999e-06 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239617+0000", 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9419999999999998e-06 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239623+0000", 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2779999999999999e-06 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265865+0000", 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026241899999999999 2024-09-21T22:02:45.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.265955+0000", 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0142000000000005e-05 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266063+0000", 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107904 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.002 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15669 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6488064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693749806, 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026558966, 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15669 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239631+0000", 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239632+0000", 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000005e-07 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239634+0000", 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1849999999999998e-06 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239640+0000", 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1859999999999997e-06 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239646+0000", 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8780000000000003e-06 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266095+0000", 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026449113999999999 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266138+0000", 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2453000000000002e-05 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266190+0000", 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2611000000000002e-05 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15670 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 6946816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693728500999995, 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026773062, 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15670 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239652+0000", 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239653+0000", 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239655+0000", 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2309999999999999e-06 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239662+0000", 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2400000000000001e-06 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239668+0000", 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2059999999999998e-06 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266228+0000", 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026560146 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266316+0000", 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8403e-05 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266426+0000", 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109424 2024-09-21T22:02:45.010 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15671 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7143424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693707110999995, 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026887225000000001, 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.011 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15671 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239674+0000", 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5999999999999999e-07 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239676+0000", 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.99e-06 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239683+0000", 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3879999999999997e-06 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239689+0000", 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2160000000000003e-06 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266456+0000", 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026767177 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266507+0000", 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0859999999999998e-05 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266561+0000", 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4134e-05 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:15672 3.6 3:64c1af43:::rbd_data.112457ad1d60.0000000000000002:f [sparse-read 7602176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 89.693685744000007, 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.027091329000000001, 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 15672 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239695+0000", 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239696+0000", 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2e-07 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239698+0000", 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9250000000000002e-06 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239704+0000", 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2319999999999998e-06 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.239709+0000", 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9030000000000003e-06 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266589+0000", 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026880452999999999 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266678+0000", 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9270000000000004e-05 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:15.266787+0000", 2024-09-21T22:02:45.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108126 2024-09-21T22:02:45.019 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.019 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.019 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.019 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.019 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.019 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:45.020 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:45.029 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:45.028+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:45.130 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:45.129+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:45.162 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:45.162 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:45.162 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:45.162 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:45.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:45.231 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:45.230+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:45.274 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:45.274 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:45.274 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:45.274 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:45.274 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:45.283 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:45.332 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:45.330+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:45.387 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31334 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2879488~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.422086051999997, 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047818368, 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.388 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31334 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963366+0000", 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963367+0000", 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9799999999999999e-07 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963369+0000", 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2089999999999999e-06 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963376+0000", 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963381+0000", 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5700000000000003e-06 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011037+0000", 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047656153999999999 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011107+0000", 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9918000000000004e-05 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011185+0000", 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7804000000000002e-05 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31335 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2920448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:45.392 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.422064810999998, 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047989572000000001, 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31335 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963387+0000", 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963388+0000", 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8200000000000001e-07 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963390+0000", 2024-09-21T22:02:45.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.447e-06 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963398+0000", 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2819999999999999e-06 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963402+0000", 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4499999999999997e-06 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011212+0000", 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047809450000000003 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011293+0000", 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1960999999999997e-05 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011377+0000", 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3599999999999999e-05 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.396 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31336 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.422043583000004, 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048160516, 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.397 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31336 2024-09-21T22:02:45.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.398 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963409+0000", 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9400000000000001e-07 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963414+0000", 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963422+0000", 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6109999999999996e-06 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963426+0000", 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2024-09-21T22:02:45.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011406+0000", 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.047979695000000003 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011485+0000", 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8638000000000002e-05 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011569+0000", 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4452999999999999e-05 2024-09-21T22:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31337 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3002368~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.422019977000005, 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048324425999999997, 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.402 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31337 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963432+0000", 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963433+0000", 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963435+0000", 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9819999999999998e-06 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963442+0000", 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8329999999999996e-06 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963446+0000", 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6800000000000001e-06 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011598+0000", 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048152243999999997 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011675+0000", 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6557999999999994e-05 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011757+0000", 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1757999999999999e-05 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31338 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3043328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.422000686999993, 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048492299000000003, 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.406 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31338 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963452+0000", 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4299999999999999e-07 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963454+0000", 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8509999999999999e-06 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963463+0000", 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0080000000000008e-06 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963476+0000", 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.34e-05 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011785+0000", 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048308828999999998 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011857+0000", 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2428999999999994e-05 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011944+0000", 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6439000000000004e-05 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31339 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.410 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421968441000004, 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048664882999999999, 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31339 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963484+0000", 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963490+0000", 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5790000000000003e-06 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963497+0000", 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963502+0000", 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8969999999999999e-06 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.011971+0000", 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048468493000000001 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012047+0000", 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5931000000000002e-05 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012149+0000", 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102225 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.414 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31340 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3125248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421944472000007, 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048829234999999999, 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.415 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31340 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963508+0000", 2024-09-21T22:02:45.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6699999999999999e-07 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963510+0000", 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0339999999999999e-06 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963517+0000", 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8689999999999998e-06 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963521+0000", 2024-09-21T22:02:45.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3370000000000001e-06 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012178+0000", 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048656545000000002 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012254+0000", 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5604000000000003e-05 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012337+0000", 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3479000000000005e-05 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31341 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3166208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421924907999994, 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048994175000000001, 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.419 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31341 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963527+0000", 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963528+0000", 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5100000000000001e-07 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963530+0000", 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1289999999999999e-06 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963538+0000", 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6930000000000007e-06 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963542+0000", 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3800000000000004e-06 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012365+0000", 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048822657999999998 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012440+0000", 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5364999999999994e-05 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012522+0000", 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599000000000003e-05 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31342 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421904475999995, 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049153528000000002, 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31342 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:45.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963548+0000", 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.84e-07 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963550+0000", 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.249e-06 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963557+0000", 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0850000000000002e-06 2024-09-21T22:02:45.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963562+0000", 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012549+0000", 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.048987493 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012620+0000", 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709000000000004e-05 2024-09-21T22:02:45.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012701+0000", 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1519000000000003e-05 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31343 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3248128~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421883352999998, 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049306986999999997, 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.427 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963569+0000", 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9900000000000001e-07 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963571+0000", 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.086e-06 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963578+0000", 2024-09-21T22:02:45.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8929999999999999e-06 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963583+0000", 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5560000000000001e-06 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012729+0000", 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049145718999999997 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012797+0000", 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8728999999999999e-05 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012876+0000", 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8604999999999997e-05 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31344 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3289088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421864137, 2024-09-21T22:02:45.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049464132000000001, 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31344 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963588+0000", 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1800000000000002e-07 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963590+0000", 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.905e-06 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963598+0000", 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963603+0000", 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.853e-06 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012903+0000", 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049300638000000001 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.012973+0000", 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9395999999999998e-05 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013052+0000", 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9636999999999997e-05 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31345 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3330048~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421843664999997, 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049624346, 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31345 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963609+0000", 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963611+0000", 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1270000000000001e-06 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963619+0000", 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3030000000000002e-06 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963623+0000", 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9169999999999997e-06 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013080+0000", 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049456854000000001 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013151+0000", 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0905e-05 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013233+0000", 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1798000000000005e-05 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31346 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3371008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421822950000006, 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049776303000000001, 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31346 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963629+0000", 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963630+0000", 2024-09-21T22:02:45.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8099999999999998e-07 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963632+0000", 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0329999999999998e-06 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963638+0000", 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6000000000000003e-06 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963643+0000", 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013260+0000", 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049616511000000002 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013327+0000", 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7522999999999997e-05 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013406+0000", 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8495e-05 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31347 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3411968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421803194000006, 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049939994000000001, 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.444 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31347 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963649+0000", 2024-09-21T22:02:45.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.53e-07 2024-09-21T22:02:45.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963652+0000", 2024-09-21T22:02:45.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0949999999999998e-06 2024-09-21T22:02:45.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963658+0000", 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963664+0000", 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5480000000000001e-06 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013433+0000", 2024-09-21T22:02:45.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049769736000000002 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013505+0000", 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2224000000000005e-05 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013589+0000", 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3628999999999995e-05 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31348 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3452928~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421783478999998, 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050094721000000002, 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31348 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.449 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963669+0000", 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2399999999999999e-07 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963671+0000", 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0269999999999998e-06 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963678+0000", 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5540000000000003e-06 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963683+0000", 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8160000000000001e-06 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013617+0000", 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.049934083999999997 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013689+0000", 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1950000000000001e-05 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013764+0000", 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4966e-05 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31349 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3493888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.453 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421763569000007, 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050266225999999997, 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31349 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963689+0000", 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2100000000000002e-07 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963691+0000", 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.046e-06 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963698+0000", 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8970000000000002e-06 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963703+0000", 2024-09-21T22:02:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013792+0000", 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050089347999999999 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013866+0000", 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3932999999999998e-05 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013955+0000", 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8653999999999995e-05 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31350 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3534848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421742585999993, 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050420125000000003, 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.458 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31350 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963710+0000", 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0600000000000001e-07 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963712+0000", 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0719999999999998e-06 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963719+0000", 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1219999999999997e-06 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963724+0000", 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6770000000000003e-06 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.013981+0000", 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050256858000000001 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014049+0000", 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7861000000000006e-05 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014130+0000", 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1129000000000002e-05 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31351 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3575808~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.462 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421721902000002, 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050582408000000002, 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31351 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:45.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963730+0000", 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963731+0000", 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963737+0000", 2024-09-21T22:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0120000000000002e-06 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963744+0000", 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4869999999999996e-06 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963749+0000", 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.792e-06 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014158+0000", 2024-09-21T22:02:45.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050409057 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014233+0000", 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5338000000000003e-05 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014313+0000", 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9331000000000003e-05 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31352 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3616768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421695998000004, 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050737549, 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31352 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963756+0000", 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963757+0000", 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.58e-07 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963759+0000", 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2299999999999998e-06 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963766+0000", 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5000000000000002e-06 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963771+0000", 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2024-09-21T22:02:45.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014341+0000", 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050570162000000002 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014409+0000", 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7910000000000005e-05 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014494+0000", 2024-09-21T22:02:45.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4617999999999995e-05 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:31353 3.19 3:9f1301fc:::rbd_data.1124c77189a0.0000000000000003:10 [read 3657728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 87.421675081000004, 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050892461, 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31353 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963777+0000", 2024-09-21T22:02:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963778+0000", 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.03e-07 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963780+0000", 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.092e-06 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963787+0000", 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.963791+0000", 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014520+0000", 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.050728969999999998 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014590+0000", 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9449000000000005e-05 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:18.014670+0000", 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9894000000000005e-05 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.475 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.476 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:45.477 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:45.477 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:45.476+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:45.578 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:45.577+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:45.621 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:45.622 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:45.622 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:45.622 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:45.630 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:45.678 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:45.676+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:45.732 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:45.733 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:45.733 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:45.733 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:45.733 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:45.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:45.779 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:45.778+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:45.839 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:02:45.880 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:45.878+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:45.896 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:45.896 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:45.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:45.896 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.024709857999994, 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:02:45.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:02:45.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.024689864999999, 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.903 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:45.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:02:45.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:45.907 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.024570429999997, 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:02:45.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:02:45.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.024303724000006, 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:02:45.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:02:45.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.024273562000005, 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.916 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.920 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.024248025999995, 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:45.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:02:45.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.024225498000007, 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.925 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:45.929 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.024201878, 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:02:45.933 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.024181529000003, 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.934 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.024159115000003, 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.938 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:02:45.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.023983048000005, 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:02:45.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.023954040000007, 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.947 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.951 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.023932208999994, 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:02:45.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:02:45.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:02:45.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.956 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.956 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.956 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.023775064000006, 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:02:45.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.023742593999998, 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:02:45.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:02:45.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.023721062999996, 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.967 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:45.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.971 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.023699746000005, 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:02:45.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.023674303999996, 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:02:45.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.023653605000007, 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:02:45.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:02:45.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:02:45.986 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.023632973000005, 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:45.987 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:45.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:02:45.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:45.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:02:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:02:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:45.992 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:45.992 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:45.994 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:45.994 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:45.991+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:46.094 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:46.093+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:46.099 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:46.099 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:46.099 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:46.099 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:46.108 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:46.128 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7] out_osds: [6, 2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:02:46.128 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:02:46.128 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-21T22:02:46.128 INFO:tasks.thrashosds.thrasher:Setting osd 3 primary_affinity to 0.185402 2024-09-21T22:02:46.129 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 0.18540221160321346 2024-09-21T22:02:46.195 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:46.194+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:46.213 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:46.213 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:46.222 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:46.296 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:46.295+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:46.330 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:46.330 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:46.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:46.330 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:80156 3.5 3:a1396def:::rbd_object_map.1124d81bddfe:head [read 0~94] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 47.284409670999999, 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6793500620000001, 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.331 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 80156 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043816+0000", 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0839999999999999e-06 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043825+0000", 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043847+0000", 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1676999999999999e-05 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043858+0000", 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1199000000000001e-05 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043937+0000", 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9281000000000002e-05 2024-09-21T22:02:46.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043950+0000", 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2513e-05 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715287+0000", 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.67133663899999996 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:46.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715300+0000", 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3654e-05 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.722928+0000", 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0076280950000001 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723038+0000", 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110145 2024-09-21T22:02:46.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723164+0000", 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012601100000000001 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85050 3.18 3:1fd90dc3:::rbd_data.1124d990a49c.0000000000000001:2d [sparse-read 7929856~42491] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:46.337 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.398267253, 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044083326999999999, 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85050 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4600000000000001e-07 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929958+0000", 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3599999999999999e-06 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929962+0000", 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8060000000000001e-06 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929965+0000", 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973768+0000", 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043802843000000001 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973830+0000", 2024-09-21T22:02:46.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2547999999999998e-05 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974040+0000", 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020997400000000001 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85051 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:46.342 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.398256000000003, 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044177951999999999, 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85051 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.96e-07 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929970+0000", 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.751e-06 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929977+0000", 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5420000000000002e-06 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929981+0000", 2024-09-21T22:02:46.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5739999999999997e-06 2024-09-21T22:02:46.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973745+0000", 2024-09-21T22:02:46.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043763541000000003 2024-09-21T22:02:46.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973820+0000", 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974146+0000", 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00032645299999999999 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.347 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85052 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.398236959999998, 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044346141999999998, 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85052 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6e-07 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929989+0000", 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3820000000000001e-06 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929992+0000", 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1310000000000002e-06 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929994+0000", 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4760000000000001e-06 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974207+0000", 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044212491999999999 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974266+0000", 2024-09-21T22:02:46.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9098999999999998e-05 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974333+0000", 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7302e-05 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85053 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.352 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.398226911999998, 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044518747999999997, 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85053 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929999+0000", 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.221e-06 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930001+0000", 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.903e-06 2024-09-21T22:02:46.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930004+0000", 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3360000000000002e-06 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974399+0000", 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044395260999999998 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974440+0000", 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1254000000000002e-05 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974516+0000", 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5564999999999999e-05 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.357 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85054 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2162688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.398215579999999, 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044703447, 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85054 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930009+0000", 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930011+0000", 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.883e-06 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930016+0000", 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4369999999999998e-06 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930020+0000", 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3680000000000002e-06 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974543+0000", 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044523600000000003 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974624+0000", 2024-09-21T22:02:46.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0989999999999995e-05 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974712+0000", 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7831999999999995e-05 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85055 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.362 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.398200840000001, 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044885911000000001, 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85055 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.28e-07 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930025+0000", 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3230000000000001e-06 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930032+0000", 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709999999999997e-06 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930035+0000", 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8770000000000002e-06 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974740+0000", 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044704893000000002 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974822+0000", 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2047999999999998e-05 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974909+0000", 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7471000000000003e-05 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85056 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.367 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.398186318999997, 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060964000000002, 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85056 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:46.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2600000000000001e-07 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930039+0000", 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1230000000000001e-06 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930043+0000", 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8750000000000002e-06 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930047+0000", 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8840000000000004e-06 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974937+0000", 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044890473 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975014+0000", 2024-09-21T22:02:46.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6574000000000002e-05 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975099+0000", 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4808999999999994e-05 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85057 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:46.372 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.398171171999998, 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045182878000000003, 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85057 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930055+0000", 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1040000000000001e-06 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930065+0000", 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0023e-05 2024-09-21T22:02:46.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930070+0000", 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8400000000000002e-06 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975131+0000", 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060718999999999 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975183+0000", 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1910999999999998e-05 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975236+0000", 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2948000000000002e-05 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.377 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85062 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.396280103999999, 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044032922000000002, 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85062 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.378 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931945+0000", 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5499999999999998e-07 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931947+0000", 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931953+0000", 2024-09-21T22:02:46.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1720000000000004e-06 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931958+0000", 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7169999999999999e-06 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975829+0000", 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043871432000000002 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975894+0000", 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5060000000000004e-05 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975977+0000", 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2626999999999993e-05 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.383 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85063 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.383 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:46.383 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.39625959, 2024-09-21T22:02:46.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044185847, 2024-09-21T22:02:46.383 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.383 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.383 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.383 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.383 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.384 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.384 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85063 2024-09-21T22:02:46.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.384 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931965+0000", 2024-09-21T22:02:46.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4900000000000001e-07 2024-09-21T22:02:46.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931967+0000", 2024-09-21T22:02:46.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2359999999999999e-06 2024-09-21T22:02:46.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931977+0000", 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8959999999999998e-06 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931982+0000", 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976005+0000", 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044023195000000001 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976067+0000", 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1495999999999995e-05 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976150+0000", 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3458e-05 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85064 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.396233105999997, 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044333939000000003, 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85064 2024-09-21T22:02:46.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931994+0000", 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932001+0000", 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7270000000000007e-06 2024-09-21T22:02:46.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932005+0000", 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9009999999999996e-06 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976178+0000", 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044172185000000003 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976242+0000", 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4430999999999993e-05 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976325+0000", 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2885000000000003e-05 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.393 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85065 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7471104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.396212218999999, 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044487967000000003, 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85065 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-07 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932014+0000", 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4610000000000001e-06 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932017+0000", 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8319999999999999e-06 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932020+0000", 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.571e-06 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976351+0000", 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044330688 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976407+0000", 2024-09-21T22:02:46.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6023999999999998e-05 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976500+0000", 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3142999999999999e-05 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85066 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.398 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.396201189000003, 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044733053000000002, 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85066 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1e-07 2024-09-21T22:02:46.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932024+0000", 2024-09-21T22:02:46.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.108e-06 2024-09-21T22:02:46.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932029+0000", 2024-09-21T22:02:46.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.335e-06 2024-09-21T22:02:46.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932031+0000", 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976528+0000", 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044496971000000003 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976590+0000", 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2200999999999996e-05 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976756+0000", 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016567200000000001 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85077 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.403 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.395225947999997, 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044123073999999998, 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85077 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932999+0000", 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.37e-07 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933006+0000", 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933013+0000", 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5510000000000002e-06 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933019+0000", 2024-09-21T22:02:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5679999999999999e-06 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977004+0000", 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043985319000000002 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977071+0000", 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7131000000000005e-05 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977121+0000", 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9925000000000001e-05 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85078 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.395197734999996, 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044323946000000003, 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.408 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85078 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933027+0000", 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933029+0000", 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:02:46.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933035+0000", 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933041+0000", 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8300000000000001e-06 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977158+0000", 2024-09-21T22:02:46.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044117682999999998 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977273+0000", 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114307 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977350+0000", 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7466999999999995e-05 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.412 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85079 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.395176919999997, 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044512719999999999, 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.413 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85079 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933050+0000", 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933056+0000", 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.105e-06 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933060+0000", 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.561e-06 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977399+0000", 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044339296 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977465+0000", 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.546e-05 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977560+0000", 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4905e-05 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85080 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.417 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.395117409000001, 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044578665000000003, 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85080 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:46.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.37e-07 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933110+0000", 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9009999999999998e-06 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933119+0000", 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7609999999999996e-06 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933125+0000", 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3199999999999996e-06 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977587+0000", 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044462224000000002 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977629+0000", 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2064999999999998e-05 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977685+0000", 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85081 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.395089409999997, 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044717826000000002, 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.422 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85081 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933137+0000", 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933144+0000", 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9009999999999997e-06 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933150+0000", 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0179999999999998e-06 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977715+0000", 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044564469000000002 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977765+0000", 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0040000000000002e-05 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977852+0000", 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7820999999999998e-05 2024-09-21T22:02:46.426 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85082 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 42.395067421999997, 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044866094000000002, 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:46.427 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85082 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:46.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933159+0000", 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1019999999999999e-06 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933165+0000", 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933170+0000", 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9860000000000002e-06 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977880+0000", 2024-09-21T22:02:46.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044710059000000003 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977944+0000", 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4162e-05 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.978023+0000", 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8392000000000004e-05 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.431 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.432 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.432 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:46.432 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:46.432 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:46.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:46.434 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:46.432+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:46.534 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:46.532+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:46.537 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:46.537 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:46.537 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:46.537 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:46.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:46.602 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:46.635 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:46.633+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:46.648 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:46.648 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:46.648 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:46.648 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:46.649 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:46.657 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:46.722 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:46.723 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:46.739 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:46.741 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:46.739+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:46.755 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:46.771 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:46.771 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:46.788 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:46.788 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:46.801 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:46.801 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:46.804 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:46.805 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:46.810 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:46.821 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:46.822 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:46.826 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:02:46.830 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.3 primary-affinity to 0.185402 (8121502) 2024-09-21T22:02:46.837 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:46.835+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:46.846 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:46.846 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:46.937 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:46.935+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:46.955 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:46.955 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:46.964 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:47.037 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:47.036+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:47.109 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:47.109 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:47.117 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:47.139 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:47.137+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:47.220 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:47.220 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:47.229 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:47.273 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:47.271+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:47.333 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:47.333 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:47.340 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:47.339+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:47.341 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:47.441 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:47.439+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:47.485 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:47.485 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:47.494 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:47.541 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:47.539+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:47.599 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:47.599 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:47.608 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:47.642 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:47.640+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:47.743 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:47.741+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:47.751 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:47.751 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:47.760 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:47.843 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:47.841+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:47.870 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:47.870 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:47.879 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:47.946 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:47.942+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:48.022 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:48.022 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:48.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:48.044 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:48.043+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:48.137 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:48.137 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:48.145 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:48.143+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:48.146 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:48.246 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:48.244+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:48.289 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:48.290 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:48.298 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:48.347 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:48.346+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:48.440 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:48.440 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:48.447 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:48.447+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:48.450 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:48.548 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:48.546+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:48.553 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:48.553 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:48.562 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:48.649 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:48.647+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:48.704 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:48.704 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:48.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:48.750 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:48.749+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:48.851 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:02:48.851 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:48.849+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:48.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:48.860 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:48.860 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:48.870 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:48.955 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:48.953+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:49.005 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:49.005 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:49.024 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:49.024 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:49.033 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:49.033 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:49.041 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:49.041 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:49.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:49.057 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:49.057 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:49.058 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:49.055+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:49.074 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:49.075 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:49.091 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:49.092 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:49.108 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:49.109 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:49.125 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:49.125 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:49.162 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:49.163 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:49.163 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:49.163 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:49.163 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:49.163 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:49.161+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:49.172 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:49.253 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:49.253+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:49.317 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29325 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 753664~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445910846000004, 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029056615000000001, 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29325 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869602+0000", 2024-09-21T22:02:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8000000000000001e-07 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869604+0000", 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.024e-06 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869610+0000", 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869615+0000", 2024-09-21T22:02:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7829999999999998e-06 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898494+0000", 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028879268 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898567+0000", 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2259000000000001e-05 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898658+0000", 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1550000000000003e-05 2024-09-21T22:02:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29326 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 794624~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445890852999995, 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029224027, 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29326 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869622+0000", 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2899999999999999e-07 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869624+0000", 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0420000000000001e-06 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869630+0000", 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4880000000000004e-06 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869635+0000", 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.989e-06 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898687+0000", 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029051897 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898762+0000", 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4249e-05 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898846+0000", 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4033e-05 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29327 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 835584~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445771418000007, 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029266638000000001, 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29327 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869741+0000", 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869742+0000", 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.51e-07 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869745+0000", 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0400000000000001e-06 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869754+0000", 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1309999999999995e-06 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.869760+0000", 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2820000000000002e-06 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898874+0000", 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029113503999999998 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.898944+0000", 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0963000000000005e-05 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899008+0000", 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3167e-05 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29328 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 876544~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445504712000002, 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029094221999999999, 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29328 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870008+0000", 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9100000000000004e-07 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870011+0000", 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1300000000000001e-06 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870021+0000", 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6099999999999995e-06 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870028+0000", 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.097e-06 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899023+0000", 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.028994992000000001 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899060+0000", 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.697e-05 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899102+0000", 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1832000000000002e-05 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29329 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 917504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.44547455, 2024-09-21T22:02:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029212642, 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29329 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870038+0000", 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7800000000000002e-07 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870041+0000", 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3709999999999998e-06 2024-09-21T22:02:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870048+0000", 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9809999999999997e-06 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870053+0000", 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899117+0000", 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029063489000000001 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899169+0000", 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2076000000000001e-05 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899251+0000", 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1928000000000006e-05 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29330 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 958464~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445449014000005, 2024-09-21T22:02:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029380905999999998, 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29330 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870063+0000", 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870064+0000", 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870066+0000", 2024-09-21T22:02:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3130000000000001e-06 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870073+0000", 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3270000000000003e-06 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870079+0000", 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2979999999999999e-06 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899280+0000", 2024-09-21T22:02:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029201650999999999 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899360+0000", 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0109000000000002e-05 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899444+0000", 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3829e-05 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29331 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 999424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445426486000002, 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029550795000000001, 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29331 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870086+0000", 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.34e-07 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870089+0000", 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2199999999999999e-06 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870096+0000", 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870101+0000", 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2530000000000004e-06 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899477+0000", 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029376301 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899555+0000", 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7410000000000006e-05 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899637+0000", 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2069000000000003e-05 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29332 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1040384~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445402865999995, 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029722187000000001, 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29332 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870110+0000", 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-07 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870112+0000", 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0389999999999999e-06 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870119+0000", 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.618e-06 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870123+0000", 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899666+0000", 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029542519 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899742+0000", 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6611000000000002e-05 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899832+0000", 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9367e-05 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29333 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1081344~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445382516999999, 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029901425999999998, 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29333 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870130+0000", 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.72e-07 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870133+0000", 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.351e-06 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870140+0000", 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0790000000000003e-06 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870145+0000", 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4709999999999998e-06 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899862+0000", 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029716968999999999 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.899943+0000", 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1304999999999995e-05 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900031+0000", 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7879000000000003e-05 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29334 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1122304~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445360102999999, 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030086008000000001, 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29334 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870152+0000", 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870153+0000", 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.65e-07 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870155+0000", 2024-09-21T22:02:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0509999999999999e-06 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870161+0000", 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6590000000000001e-06 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870167+0000", 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3000000000000001e-06 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900063+0000", 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029896584 2024-09-21T22:02:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900144+0000", 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0605000000000005e-05 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900238+0000", 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4444000000000006e-05 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29335 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1163264~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445184036000001, 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030108818999999998, 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29335 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870328+0000", 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870329+0000", 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4799999999999998e-07 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870332+0000", 2024-09-21T22:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.039e-06 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870341+0000", 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8089999999999999e-06 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870348+0000", 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900271+0000", 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029922925999999999 2024-09-21T22:02:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900352+0000", 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0945999999999994e-05 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900437+0000", 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5493000000000003e-05 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29336 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445155028000002, 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030268522999999999, 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29336 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870357+0000", 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870358+0000", 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3300000000000003e-07 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870360+0000", 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2699999999999999e-06 2024-09-21T22:02:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870367+0000", 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7240000000000003e-06 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870372+0000", 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4419999999999997e-06 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900471+0000", 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030098843 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900550+0000", 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9126000000000001e-05 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900626+0000", 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5685000000000005e-05 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.366 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29337 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1245184~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.445133197000004, 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030432971999999999, 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29337 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870379+0000", 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870380+0000", 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7800000000000002e-07 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870382+0000", 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9530000000000002e-06 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870515+0000", 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013330699999999999 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870524+0000", 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900652+0000", 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030128396000000002 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900730+0000", 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7372000000000004e-05 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900812+0000", 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2468999999999999e-05 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29338 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1286144~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.444976052000001, 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030460002, 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29338 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870536+0000", 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870537+0000", 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5199999999999996e-07 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870541+0000", 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4809999999999998e-06 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870555+0000", 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4450000000000001e-05 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870561+0000", 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0870000000000003e-06 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900842+0000", 2024-09-21T22:02:49.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030281143999999999 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900914+0000", 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1341999999999996e-05 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.900996+0000", 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2845999999999999e-05 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.374 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29339 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1327104~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.444943581999993, 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030611111999999999, 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29339 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:49.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870569+0000", 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3000000000000001e-07 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870572+0000", 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3779999999999999e-06 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870579+0000", 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870584+0000", 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0640000000000001e-06 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901027+0000", 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030443258000000001 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901100+0000", 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2954000000000007e-05 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901180+0000", 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0034e-05 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29340 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1368064~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.444922051000006, 2024-09-21T22:02:49.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030778947000000001, 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29340 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870590+0000", 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870591+0000", 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2399999999999999e-07 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870593+0000", 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0169999999999999e-06 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870600+0000", 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7889999999999997e-06 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870605+0000", 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2900000000000002e-06 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901211+0000", 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030606000000000001 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901280+0000", 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9535000000000004e-05 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901369+0000", 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8892000000000002e-05 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29341 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1409024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.444900734000001, 2024-09-21T22:02:49.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030939932999999999, 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29341 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870612+0000", 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870618+0000", 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0589999999999999e-06 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870625+0000", 2024-09-21T22:02:49.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1779999999999997e-06 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870630+0000", 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0819999999999998e-06 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901399+0000", 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030768585000000001 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901478+0000", 2024-09-21T22:02:49.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9383999999999998e-05 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901552+0000", 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3314999999999999e-05 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29342 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1449984~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.444875292000006, 2024-09-21T22:02:49.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031091838, 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29342 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870637+0000", 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870638+0000", 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9099999999999999e-07 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870639+0000", 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9460000000000001e-06 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870646+0000", 2024-09-21T22:02:49.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8700000000000003e-06 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870651+0000", 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0320000000000003e-06 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901578+0000", 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.030926703 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901646+0000", 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8201999999999995e-05 2024-09-21T22:02:49.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901729+0000", 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2694000000000005e-05 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29343 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1490944~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.444854593000002, 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031252543000000001, 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.390 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29343 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:49.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870658+0000", 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7899999999999999e-07 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870660+0000", 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.216e-06 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870667+0000", 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4529999999999999e-06 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870672+0000", 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.113e-06 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901756+0000", 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031084479000000002 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901819+0000", 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2597999999999999e-05 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901910+0000", 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1304999999999994e-05 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:29344 3.4 3:254a74f0:::rbd_data.1124c77189a0.0000000000000004:10 [read 1531904~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.444833961, 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031416901999999997, 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.394 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29344 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870678+0000", 2024-09-21T22:02:49.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870679+0000", 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5900000000000003e-07 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870681+0000", 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1670000000000002e-06 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870687+0000", 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4729999999999997e-06 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.870693+0000", 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1050000000000003e-06 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.901940+0000", 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.031247789000000002 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902015+0000", 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4209999999999996e-05 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:17.902095+0000", 2024-09-21T22:02:49.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0798999999999997e-05 2024-09-21T22:02:49.398 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.398 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.398 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.398 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.398 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.398 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:49.399 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:49.400 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:49.398+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:49.500 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:49.498+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:49.541 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:49.541 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:49.541 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:49.541 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:49.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:49.601 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:49.600+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:49.692 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:49.692 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:49.692 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:49.692 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:49.692 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:49.701 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:49.702 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:49.700+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:49.718 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:02:49.802 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:49.800+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:80156 3.5 3:a1396def:::rbd_object_map.1124d81bddfe:head [read 0~94] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.771393123000003, 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6793500620000001, 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.818 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 80156 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043814+0000", 2024-09-21T22:02:49.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043816+0000", 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0839999999999999e-06 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043825+0000", 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043847+0000", 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1676999999999999e-05 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043858+0000", 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1199000000000001e-05 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043937+0000", 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9281000000000002e-05 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.043950+0000", 2024-09-21T22:02:49.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2513e-05 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715287+0000", 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.67133663899999996 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:01:59.715300+0000", 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3654e-05 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.722928+0000", 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0076280950000001 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723038+0000", 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110145 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:00.723164+0000", 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012601100000000001 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.823 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85050 3.18 3:1fd90dc3:::rbd_data.1124d990a49c.0000000000000001:2d [sparse-read 7929856~42491] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.885250704999997, 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044083326999999999, 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85050 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929957+0000", 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4600000000000001e-07 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929958+0000", 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3599999999999999e-06 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929962+0000", 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8060000000000001e-06 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929965+0000", 2024-09-21T22:02:49.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5500000000000001e-06 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973768+0000", 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043802843000000001 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973830+0000", 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2547999999999998e-05 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974040+0000", 2024-09-21T22:02:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020997400000000001 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85051 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.885239452, 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044177951999999999, 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.828 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85051 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929968+0000", 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.96e-07 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929970+0000", 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.751e-06 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929977+0000", 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5420000000000002e-06 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929981+0000", 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5739999999999997e-06 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973745+0000", 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043763541000000003 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.973820+0000", 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4795000000000005e-05 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974146+0000", 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00032645299999999999 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85052 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.832 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.885220412000002, 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044346141999999998, 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85052 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:49.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929987+0000", 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6e-07 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929989+0000", 2024-09-21T22:02:49.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3820000000000001e-06 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929992+0000", 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1310000000000002e-06 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929994+0000", 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4760000000000001e-06 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974207+0000", 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044212491999999999 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974266+0000", 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9098999999999998e-05 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974333+0000", 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7302e-05 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85053 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.885210364000002, 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044518747999999997, 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85053 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929997+0000", 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0800000000000001e-07 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.929999+0000", 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.221e-06 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930001+0000", 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.903e-06 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930004+0000", 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3360000000000002e-06 2024-09-21T22:02:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974399+0000", 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044395260999999998 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974440+0000", 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1254000000000002e-05 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974516+0000", 2024-09-21T22:02:49.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5564999999999999e-05 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85054 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2162688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.885199032000003, 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044703447, 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.841 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85054 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930008+0000", 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930009+0000", 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3700000000000001e-07 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930011+0000", 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.883e-06 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930016+0000", 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4369999999999998e-06 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930020+0000", 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3680000000000002e-06 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974543+0000", 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044523600000000003 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974624+0000", 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0989999999999995e-05 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974712+0000", 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7831999999999995e-05 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85055 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.885184291999998, 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044885911000000001, 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85055 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930023+0000", 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.28e-07 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930025+0000", 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3230000000000001e-06 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930032+0000", 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0709999999999997e-06 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930035+0000", 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8770000000000002e-06 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974740+0000", 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044704893000000002 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974822+0000", 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2047999999999998e-05 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974909+0000", 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7471000000000003e-05 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85056 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.885169771000001, 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060964000000002, 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85056 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930038+0000", 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2600000000000001e-07 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930039+0000", 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1230000000000001e-06 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930043+0000", 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8750000000000002e-06 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930047+0000", 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8840000000000004e-06 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.974937+0000", 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044890473 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975014+0000", 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6574000000000002e-05 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975099+0000", 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4808999999999994e-05 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85057 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.885154624000002, 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045182878000000003, 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.853 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85057 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930053+0000", 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930055+0000", 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1040000000000001e-06 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930065+0000", 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0023e-05 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.930070+0000", 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8400000000000002e-06 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975131+0000", 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.045060718999999999 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975183+0000", 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1910999999999998e-05 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975236+0000", 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2948000000000002e-05 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85062 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.883263556000003, 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044032922000000002, 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.857 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85062 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931944+0000", 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931945+0000", 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5499999999999998e-07 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931947+0000", 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3590000000000002e-06 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931953+0000", 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1720000000000004e-06 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931958+0000", 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7169999999999999e-06 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975829+0000", 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043871432000000002 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975894+0000", 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5060000000000004e-05 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.975977+0000", 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2626999999999993e-05 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85063 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6160384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.883243041999997, 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044185847, 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.861 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85063 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931964+0000", 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931965+0000", 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4900000000000001e-07 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931967+0000", 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2359999999999999e-06 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931977+0000", 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8959999999999998e-06 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931982+0000", 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976005+0000", 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044023195000000001 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976067+0000", 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1495999999999995e-05 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976150+0000", 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3458e-05 2024-09-21T22:02:49.864 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85064 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.883216558000001, 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044333939000000003, 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85064 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931991+0000", 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3599999999999999e-07 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.931994+0000", 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3740000000000001e-06 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932001+0000", 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7270000000000007e-06 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932005+0000", 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9009999999999996e-06 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976178+0000", 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044172185000000003 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976242+0000", 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4430999999999993e-05 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976325+0000", 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2885000000000003e-05 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85065 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7471104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.883195671000003, 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044487967000000003, 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85065 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932012+0000", 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-07 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932014+0000", 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4610000000000001e-06 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932017+0000", 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8319999999999999e-06 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932020+0000", 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.571e-06 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976351+0000", 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044330688 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976407+0000", 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6023999999999998e-05 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976500+0000", 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3142999999999999e-05 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85066 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8126464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.883184641, 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044733053000000002, 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.873 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85066 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932023+0000", 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1e-07 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932024+0000", 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.108e-06 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932029+0000", 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.335e-06 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932031+0000", 2024-09-21T22:02:49.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5560000000000002e-06 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976528+0000", 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044496971000000003 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976590+0000", 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2200999999999996e-05 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.976756+0000", 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016567200000000001 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85077 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 4915200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.882209400000001, 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044123073999999998, 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.877 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85077 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932998+0000", 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.932999+0000", 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.37e-07 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933006+0000", 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9430000000000003e-06 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933013+0000", 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5510000000000002e-06 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933019+0000", 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5679999999999999e-06 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977004+0000", 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.043985319000000002 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977071+0000", 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7131000000000005e-05 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977121+0000", 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9925000000000001e-05 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85078 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.882181187, 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044323946000000003, 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.881 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85078 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933026+0000", 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933027+0000", 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933029+0000", 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0549999999999998e-06 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933035+0000", 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1940000000000003e-06 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933041+0000", 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8300000000000001e-06 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977158+0000", 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044117682999999998 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977273+0000", 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114307 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977350+0000", 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7466999999999995e-05 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85079 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.882160372000001, 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044512719999999999, 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.885 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85079 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933047+0000", 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933050+0000", 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933056+0000", 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.105e-06 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933060+0000", 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.561e-06 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977399+0000", 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044339296 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977465+0000", 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.546e-05 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977560+0000", 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4905e-05 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85080 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.882100860999998, 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044578665000000003, 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.889 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85080 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933107+0000", 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.37e-07 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933110+0000", 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9009999999999998e-06 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933119+0000", 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7609999999999996e-06 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933125+0000", 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3199999999999996e-06 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977587+0000", 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044462224000000002 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977629+0000", 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2064999999999998e-05 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977685+0000", 2024-09-21T22:02:49.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5856999999999997e-05 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85081 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 7536640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.882072862000001, 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044717826000000002, 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85081 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933135+0000", 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933137+0000", 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1660000000000001e-06 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933144+0000", 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9009999999999997e-06 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933150+0000", 2024-09-21T22:02:49.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0179999999999998e-06 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977715+0000", 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044564469000000002 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977765+0000", 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0040000000000002e-05 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977852+0000", 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7820999999999998e-05 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.896 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4388.0:85082 3.8 3:13b3ac15:::rbd_data.1124d990a49c.0000000000000002:2d [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.882050874000001, 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044866094000000002, 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "continuous": false, 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4388", 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 85082 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.897 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933157+0000", 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1100000000000001e-07 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933159+0000", 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1019999999999999e-06 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933165+0000", 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9819999999999996e-06 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.933170+0000", 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9860000000000002e-06 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977880+0000", 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.044710059000000003 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.977944+0000", 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4162e-05 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2024-09-21T22:02:03.978023+0000", 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8392000000000004e-05 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:49.901 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:49.901 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:49.901 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:49.943 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:49.941+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:50.003 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:50.002+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:50.005 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:50.005 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:50.005 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:50.006 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:50.014 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:50.103 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:50.103+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:50.158 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:50.158 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:50.158 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:50.158 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:50.158 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:50.167 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:50.204 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:50.202+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:50.304 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:50.304+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:50.314 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:50.314 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:50.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:50.314 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:50.314 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.314 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:02:50.314 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:50.314 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 111.100159069, 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:50.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:02:50.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:02:50.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.318 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56963 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 622592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:50.319 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.058097988999997, 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021343747, 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56963 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2e-07 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253818+0000", 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1160000000000002e-06 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253823+0000", 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253828+0000", 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.274987+0000", 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021158445000000001 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275065+0000", 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8407999999999999e-05 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275159+0000", 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3497000000000003e-05 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.323 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56964 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.058078672000001, 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021459051999999999, 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56964 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.324 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253835+0000", 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:50.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253837+0000", 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253842+0000", 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8080000000000001e-06 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253847+0000", 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6099999999999999e-06 2024-09-21T22:02:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275188+0000", 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021341057 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275230+0000", 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1941999999999999e-05 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275293+0000", 2024-09-21T22:02:50.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3195999999999996e-05 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56965 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.058046671, 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021632274, 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56965 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253867+0000", 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253869+0000", 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253875+0000", 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0970000000000002e-06 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253880+0000", 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275329+0000", 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021448292000000001 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275407+0000", 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7946000000000002e-05 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275499+0000", 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1978000000000006e-05 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56966 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1310720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.058026824000002, 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021740731999999999, 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.332 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56966 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253888+0000", 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0669999999999999e-06 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253894+0000", 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8980000000000001e-06 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253900+0000", 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275526+0000", 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021625912000000001 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275569+0000", 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3043000000000001e-05 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275627+0000", 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7479000000000003e-05 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56967 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.058006652000003, 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021928007999999999, 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.336 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56967 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253907+0000", 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.41e-07 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253908+0000", 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.776e-06 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253914+0000", 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1950000000000002e-06 2024-09-21T22:02:50.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253928+0000", 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3974e-05 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275662+0000", 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021734168000000002 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275740+0000", 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7807999999999998e-05 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275834+0000", 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4746000000000004e-05 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56968 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057978509999998, 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022029615999999998, 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.340 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56968 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:50.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253935+0000", 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253937+0000", 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253943+0000", 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253948+0000", 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275861+0000", 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021913548000000001 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275905+0000", 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3795000000000003e-05 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275964+0000", 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8739000000000001e-05 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56969 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057959840999999, 2024-09-21T22:02:50.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022221162999999999, 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56969 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253955+0000", 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.874e-06 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253961+0000", 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999998e-06 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253965+0000", 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5260000000000004e-06 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276000+0000", 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022034611999999999 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276078+0000", 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8311000000000003e-05 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276174+0000", 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6139999999999998e-05 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56984 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057942222999998, 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022340279000000001, 2024-09-21T22:02:50.348 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56984 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253973+0000", 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.81e-06 2024-09-21T22:02:50.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253979+0000", 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253983+0000", 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276203+0000", 2024-09-21T22:02:50.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022219848 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276248+0000", 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4880999999999999e-05 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276311+0000", 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3047999999999997e-05 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.352 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56985 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057924251000003, 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022528538000000001, 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56985 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253991+0000", 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1229999999999998e-06 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253997+0000", 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4759999999999997e-06 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254003+0000", 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.896e-06 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276347+0000", 2024-09-21T22:02:50.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022344180000000002 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276424+0000", 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7014000000000005e-05 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276517+0000", 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3383999999999999e-05 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.356 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56986 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057904647999997, 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022636156000000001, 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56986 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254009+0000", 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254021+0000", 2024-09-21T22:02:50.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2075e-05 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254027+0000", 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2910000000000004e-06 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254032+0000", 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0969999999999996e-06 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276545+0000", 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022513014000000001 2024-09-21T22:02:50.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276588+0000", 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3183000000000003e-05 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276644+0000", 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6165999999999997e-05 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56987 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 868352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057874177999999, 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022813353000000001, 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56987 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254041+0000", 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254047+0000", 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254051+0000", 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6430000000000003e-06 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276680+0000", 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022628945000000001 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276758+0000", 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7775999999999995e-05 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276852+0000", 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4067999999999995e-05 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56988 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1097728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057856762999997, 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923770999999999, 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56988 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254058+0000", 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254064+0000", 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2950000000000001e-06 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254068+0000", 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1479999999999999e-06 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276880+0000", 2024-09-21T22:02:50.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022812260000000001 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276923+0000", 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3347999999999999e-05 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276980+0000", 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6496000000000003e-05 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56989 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1327104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057839757000004, 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023109826999999999, 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56989 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254075+0000", 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.691e-06 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254081+0000", 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254085+0000", 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.498e-06 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277015+0000", 2024-09-21T22:02:50.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929417000000001 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277092+0000", 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6625000000000006e-05 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277183+0000", 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1453999999999995e-05 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.372 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56990 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1556480~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057821609999998, 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023224305000000001, 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56990 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:50.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254092+0000", 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.22e-07 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254093+0000", 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7099999999999999e-06 2024-09-21T22:02:50.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254099+0000", 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254103+0000", 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277211+0000", 2024-09-21T22:02:50.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023107593999999999 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277254+0000", 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2762000000000002e-05 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277316+0000", 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1876000000000002e-05 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.376 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56991 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057804263999998, 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023415498999999999, 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56991 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:50.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254111+0000", 2024-09-21T22:02:50.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.813e-06 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254116+0000", 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254121+0000", 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5730000000000001e-06 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277351+0000", 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023230621 2024-09-21T22:02:50.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277431+0000", 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9818e-05 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277524+0000", 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2986999999999996e-05 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.380 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56992 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 2015232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057786774999997, 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023528238999999999, 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56992 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:50.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254128+0000", 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8330000000000001e-06 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254134+0000", 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5729999999999998e-06 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254139+0000", 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4790000000000004e-06 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277553+0000", 2024-09-21T22:02:50.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023413607999999999 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277596+0000", 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3489000000000003e-05 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277654+0000", 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7911999999999997e-05 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57020 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057289689999998, 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023243617000000001, 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57020 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254624+0000", 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254632+0000", 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1219999999999995e-06 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254640+0000", 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9370000000000004e-06 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254645+0000", 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3140000000000003e-06 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277690+0000", 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023044477000000001 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277768+0000", 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8594e-05 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277867+0000", 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8560999999999994e-05 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57021 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.057260788999997, 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023344055999999998, 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.389 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57021 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254653+0000", 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254654+0000", 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254661+0000", 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254666+0000", 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277894+0000", 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023228029000000001 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277936+0000", 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2589000000000002e-05 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277996+0000", 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9967999999999999e-05 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57023 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 704512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 63.05724197, 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023525122999999998, 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.393 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57023 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:50.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.32e-07 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254679+0000", 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7479999999999993e-06 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254686+0000", 2024-09-21T22:02:50.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:02:50.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254690+0000", 2024-09-21T22:02:50.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7180000000000004e-06 2024-09-21T22:02:50.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278021+0000", 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023330391999999998 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278097+0000", 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6464999999999994e-05 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278196+0000", 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8852999999999997e-05 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.398 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.399 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.399 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:50.399 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:50.406 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:50.405+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:50.507 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:50.506+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:50.543 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:50.543 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:50.543 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:50.543 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:50.552 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:50.608 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:50.606+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:50.655 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:50.655 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:50.655 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:50.655 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:50.655 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:50.663 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:50.708 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:50.708+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:50.775 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:50.775 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 106.72125568, 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.776 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:50.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:02:50.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:50.780 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.844541186000001, 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:02:50.782 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.784 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.844531235999995, 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.787 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.788 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.791 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.844517832999998, 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.792 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:02:50.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.844508161999997, 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:02:50.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.842512325000001, 2024-09-21T22:02:50.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.805 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.842466068999997, 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.806 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:02:50.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.842428733999995, 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:02:50.810 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:02:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:02:50.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.814 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.842394553000005, 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.815 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.842354681000003, 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.819 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:02:50.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.842309396000005, 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:02:50.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85825 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2277376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.711211916000003, 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028813432, 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.828 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85825 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061936+0000", 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4790000000000001e-06 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061939+0000", 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1240000000000001e-06 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061941+0000", 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.452e-06 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090598+0000", 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028656966999999998 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090675+0000", 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6914000000000003e-05 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090745+0000", 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0290999999999995e-05 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.832 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85826 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2342912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.711199798000003, 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028888786999999999, 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85826 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061946+0000", 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.556e-06 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061949+0000", 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9249999999999999e-06 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061951+0000", 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4739999999999999e-06 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090758+0000", 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028806486999999999 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090796+0000", 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8466000000000001e-05 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090833+0000", 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6674000000000002e-05 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.836 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85827 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2408448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.711189843, 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029053266000000001, 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85827 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.837 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:50.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9999999999999999e-07 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061955+0000", 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.156e-06 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061958+0000", 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9340000000000002e-06 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061961+0000", 2024-09-21T22:02:50.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5040000000000001e-06 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090862+0000", 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028901175000000001 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090937+0000", 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4881000000000004e-05 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091007+0000", 2024-09-21T22:02:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0415999999999998e-05 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85828 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2473984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.711180163000002, 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029127014, 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.841 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85828 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061965+0000", 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061968+0000", 2024-09-21T22:02:50.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.92e-06 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061971+0000", 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.101e-06 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091020+0000", 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029048398999999999 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.844 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091056+0000", 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6718000000000003e-05 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091091+0000", 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4501000000000001e-05 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85829 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2539520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.71113081, 2024-09-21T22:02:50.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029251899000000001, 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85829 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062014+0000", 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062016+0000", 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:02:50.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062022+0000", 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062027+0000", 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2180000000000001e-06 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091120+0000", 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029093112000000001 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091195+0000", 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5499000000000003e-05 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091265+0000", 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9670000000000002e-05 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85830 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2605056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:50.849 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.711111164000002, 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029323741, 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85830 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:50.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062034+0000", 2024-09-21T22:02:50.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2729999999999999e-06 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062038+0000", 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.602e-06 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062042+0000", 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9949999999999999e-06 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091283+0000", 2024-09-21T22:02:50.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029241195000000001 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091320+0000", 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7296999999999999e-05 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091356+0000", 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6170000000000001e-05 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85831 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2670592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.711098692, 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029484659999999999, 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85831 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062047+0000", 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062050+0000", 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1099999999999999e-06 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062052+0000", 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4899999999999999e-06 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091385+0000", 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029333016999999999 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091461+0000", 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6019000000000005e-05 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091530+0000", 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8660999999999999e-05 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.857 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85832 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2736128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.711088660999998, 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029557844999999999, 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85832 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.858 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:50.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062057+0000", 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.119e-06 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062060+0000", 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9730000000000002e-06 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062062+0000", 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091542+0000", 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029480309999999999 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091579+0000", 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6254000000000002e-05 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091613+0000", 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4555999999999999e-05 2024-09-21T22:02:50.861 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85882 3.16 3:6c4a0c3b:::rbd_data.1124f4fa8d1.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 46.624096948000002, 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029882499999999999, 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:50.862 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85882 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:50.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149049+0000", 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.635e-06 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149054+0000", 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7939999999999999e-06 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149067+0000", 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2587e-05 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:50.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149074+0000", 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.25e-06 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149143+0000", 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9008000000000001e-05 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149216+0000", 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2947000000000005e-05 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149339+0000", 2024-09-21T22:02:50.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012293800000000001 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178449+0000", 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029110159 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178861+0000", 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000411808 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178898+0000", 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6745000000000001e-05 2024-09-21T22:02:50.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:50.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:50.867 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:50.867 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178929+0000", 2024-09-21T22:02:50.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1628999999999998e-05 2024-09-21T22:02:50.867 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.867 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.867 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.867 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:50.867 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:50.867 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:50.868 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:50.868 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:50.867+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:50.969 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:50.968+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:51.014 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:51.014 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:51.014 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:51.014 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:51.022 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:51.070 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:51.068+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:51.137 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:51.166 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:51.166 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:51.166 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:51.166 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:51.166 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:51.170 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:51.169+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:51.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:51.262 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:51.271 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:51.271+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:51.279 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:51.279 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:51.295 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:51.295 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:51.311 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:51.311 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:51.320 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:51.320 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:51.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 92.474842838000001, 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.321 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.322 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.475931325000005, 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.327 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:02:51.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:02:51.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:02:51.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:02:51.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:02:51.333 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.367474568000006, 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.334 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.367465275000001, 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.338 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:02:51.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.367441529000004, 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.342 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:51.346 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.367430975999994, 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.347 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.348 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.349 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.350 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.367421573000001, 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:51.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:02:51.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:02:51.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.354 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.367410782999997, 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.367377509999997, 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:02:51.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:02:51.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.362 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.367366837999995, 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:02:51.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:02:51.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:02:51.366 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.363237346999995, 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:02:51.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:02:51.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.370 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.362838209000003, 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.371 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:02:51.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.374 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.361883617999993, 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.375 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:02:51.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:02:51.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.361860364999998, 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.379 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.382 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.360567695, 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.383 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.360548582000007, 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.387 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.390 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.391 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.360529451999994, 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:02:51.395 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.360511114000005, 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.396 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:02:51.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 91.360492715000007, 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:51.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:02:51.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:02:51.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:41899 3.10 3:0bb333a9:::rbd_data.11247a90fb52.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 82.563583304000005, 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015085853, 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:51.404 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 41899 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:51.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754789+0000", 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.372e-06 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754796+0000", 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8249999999999999e-06 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754809+0000", 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3662000000000001e-05 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754816+0000", 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7220000000000002e-06 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754866+0000", 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9945999999999999e-05 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754919+0000", 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3329999999999999e-05 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.758040+0000", 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031204869999999999 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769752+0000", 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011712530000000001 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769803+0000", 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.117e-05 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769841+0000", 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7982999999999999e-05 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769873+0000", 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1826000000000003e-05 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.409 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.410 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:51.410 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:51.410 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:51.410 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:51.411 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:51.412 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:51.412 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:51.413 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:51.413 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:51.413 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:51.409+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:51.511 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:51.510+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:51.560 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:51.560 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:51.564 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:51.613 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:51.611+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:51.667 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:51.667 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:51.675 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:51.719 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:51.718+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:51.738 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T22:02:51.778 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:51.778 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:51.787 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:51.828 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:51.827+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:51.852 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7] out_osds: [6, 2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T22:02:51.852 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T22:02:51.852 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-21T22:02:51.852 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T22:02:51.901 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:51.901 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:51.912 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:51.915 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:51.913+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:52.015 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:52.014+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:52.030 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:52.030 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:52.039 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:52.116 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:52.115+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:52.143 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:52.143 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:52.152 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:52.164 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:02:52.164 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:52.164 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 135, 2024-09-21T22:02:52.164 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "014f3ec5-afd0-4b18-9c74-de91f34d0760", 2024-09-21T22:02:52.164 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-09-21T22:00:24.916784+0000", 2024-09-21T22:02:52.164 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-09-21T22:02:51.846010+0000", 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-09-21T22:00:36.060631+0000", 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-09-21T22:02:29.712852+0000", 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5799936, 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 5, 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T22:02:52.165 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 3, 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 8, 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "luminous", 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:37.034134+0000", 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:52.166 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-09-21T22:02:52.167 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "17", 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:52.168 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:52.169 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:52.170 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-09-21T22:02:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 8, 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 8, 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.25, 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.79173088073730469, 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:42.753049+0000", 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:52.173 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:52.174 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "21", 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 2, 2024-09-21T22:02:52.175 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 21, 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:52.176 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:52.177 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:52.178 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 3, 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 3, 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.75, 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2.25, 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2.25, 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.79173088073730469, 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:52.179 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "pool_client.0", 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-09-21T22:00:52.269263+0000", 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 8193, 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "is_stretch_pool": false, 2024-09-21T22:02:52.180 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.181 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "135", 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 47, 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 135, 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-09-21T22:02:52.182 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-09-21T22:02:52.183 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-09-21T22:02:52.184 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.5099999904632568, 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.5099999904632568, 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.75, 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 0.79173088073730469, 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 0.79000002145767212, 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-09-21T22:02:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "ebc4f0b9-33fc-4301-b1c0-ac843b19095b", 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 13, 2024-09-21T22:02:52.186 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 130, 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6808", 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6809", 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6810", 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6811", 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6814", 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6815", 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:52.189 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6812", 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6813", 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3559797623 2024-09-21T22:02:52.190 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6809/3559797623", 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6811/3559797623", 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6815/3559797623", 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6813/3559797623", 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:02:52.191 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "1c8f54fe-439f-486e-8b8b-fe892332ada3", 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 0.1484527587890625, 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 130, 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.192 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6824", 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6825", 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6826", 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6827", 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6830", 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6831", 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.195 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6828", 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6829", 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 428384344 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6825/428384344", 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6827/428384344", 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6831/428384344", 2024-09-21T22:02:52.196 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6829/428384344", 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "b202159c-804c-4d22-9aa3-8f590dce8faa", 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 0, 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 0, 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 115, 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6816", 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6817", 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6818", 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.199 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6819", 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6822", 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.200 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6823", 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6820", 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.201 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6821", 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4237051748 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6817/4237051748", 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6819/4237051748", 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6823/4237051748", 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6821/4237051748", 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "28a8c407-a445-4c76-8d7c-d5a249d13e03", 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 0.185394287109375, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 116, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6800", 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6801", 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.204 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6802", 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6803", 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.205 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6806", 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6807", 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6804", 2024-09-21T22:02:52.206 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6805", 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3004236595 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.102:6801/3004236595", 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.102:6803/3004236595", 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.102:6807/3004236595", 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.102:6805/3004236595", 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:52.207 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605", 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 116, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:52.208 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6824", 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6825", 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.209 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6826", 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6827", 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.210 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6830", 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6831", 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6828", 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6829", 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 743062291 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6825/743062291", 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6827/743062291", 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6831/743062291", 2024-09-21T22:02:52.212 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6829/743062291", 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7a0cc26e-a543-4647-bc53-fbecb69b2326", 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:52.213 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 130, 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6808", 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6809", 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6810", 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6811", 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.215 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6814", 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6815", 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6812", 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6813", 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2410886219 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6809/2410886219", 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6811/2410886219", 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6815/2410886219", 2024-09-21T22:02:52.217 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6813/2410886219", 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "7768eeb7-c6d0-47d8-a400-c47a2154c590", 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 0, 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 0, 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:52.218 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 48, 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6800", 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6801", 2024-09-21T22:02:52.219 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6802", 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6803", 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:52.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6806", 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6807", 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.221 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6804", 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6805", 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2491178498 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6801/2491178498", 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6803/2491178498", 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6807/2491178498", 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6805/2491178498", 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "30ed992b-2e99-4523-9fdd-8389f75940af", 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-09-21T22:02:52.223 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 14, 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 130, 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6816", 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.224 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6817", 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6818", 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6819", 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6822", 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6823", 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:52.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6820", 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.184:6821", 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1580142875 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.184:6817/1580142875", 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.184:6819/1580142875", 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.184:6823/1580142875", 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.184:6821/1580142875", 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.228 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.652871+0000", 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:52.229 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.866866+0000", 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 65536, 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.859757+0000", 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 3, 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:34.082180+0000", 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 4, 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.844484+0000", 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 5, 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.746321+0000", 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 6, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 65536, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.324821+0000", 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 7, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-09-21T22:02:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-09-21T22:00:33.093833+0000", 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [ 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: "pgid": "3.5", 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: 3, 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: 2 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: "pgid": "3.1c", 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-09-21T22:02:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: 7, 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: 3 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-09-21T22:02:52.235 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [ 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: "snaps": [ 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: "begin": 8, 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: "length": 9 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [ 2024-09-21T22:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: "snaps": [ 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: "begin": 8, 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: "length": 1 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-09-21T22:02:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-09-21T22:02:52.238 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-09-21T22:02:52.238 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-09-21T22:02:52.238 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-09-21T22:02:52.238 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T22:02:52.238 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:52.239 INFO:tasks.thrashosds.thrasher:j is {'epoch': 135, 'fsid': '014f3ec5-afd0-4b18-9c74-de91f34d0760', 'created': '2024-09-21T22:00:24.916784+0000', 'modified': '2024-09-21T22:02:51.846010+0000', 'last_up_change': '2024-09-21T22:00:36.060631+0000', 'last_in_change': '2024-09-21T22:02:29.712852+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T22:00:37.034134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7917308807373047, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T22:00:42.753049+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.75, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.7917308807373047, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T22:00:52.269263+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 47, 'snap_epoch': 135, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.509999990463257, 'score_stable': 2.509999990463257, 'optimal_score': 0.75, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.7917308807373047, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}], 'osds': [{'osd': 0, 'uuid': 'ebc4f0b9-33fc-4301-b1c0-ac843b19095b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6808', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6809', 'nonce': 3559797623}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6810', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6811', 'nonce': 3559797623}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6814', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6815', 'nonce': 3559797623}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6812', 'nonce': 3559797623}, {'type': 'v1', 'addr': '172.21.15.102:6813', 'nonce': 3559797623}]}, 'public_addr': '172.21.15.102:6809/3559797623', 'cluster_addr': '172.21.15.102:6811/3559797623', 'heartbeat_back_addr': '172.21.15.102:6815/3559797623', 'heartbeat_front_addr': '172.21.15.102:6813/3559797623', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1c8f54fe-439f-486e-8b8b-fe892332ada3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1484527587890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6824', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6825', 'nonce': 428384344}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6826', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6827', 'nonce': 428384344}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6830', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6831', 'nonce': 428384344}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6828', 'nonce': 428384344}, {'type': 'v1', 'addr': '172.21.15.102:6829', 'nonce': 428384344}]}, 'public_addr': '172.21.15.102:6825/428384344', 'cluster_addr': '172.21.15.102:6827/428384344', 'heartbeat_back_addr': '172.21.15.102:6831/428384344', 'heartbeat_front_addr': '172.21.15.102:6829/428384344', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'b202159c-804c-4d22-9aa3-8f590dce8faa', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6816', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6817', 'nonce': 4237051748}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6818', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6819', 'nonce': 4237051748}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6822', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6823', 'nonce': 4237051748}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6820', 'nonce': 4237051748}, {'type': 'v1', 'addr': '172.21.15.102:6821', 'nonce': 4237051748}]}, 'public_addr': '172.21.15.102:6817/4237051748', 'cluster_addr': '172.21.15.102:6819/4237051748', 'heartbeat_back_addr': '172.21.15.102:6823/4237051748', 'heartbeat_front_addr': '172.21.15.102:6821/4237051748', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '28a8c407-a445-4c76-8d7c-d5a249d13e03', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.185394287109375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 3004236595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 3004236595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 3004236595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 3004236595}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 3004236595}]}, 'public_addr': '172.21.15.102:6801/3004236595', 'cluster_addr': '172.21.15.102:6803/3004236595', 'heartbeat_back_addr': '172.21.15.102:6807/3004236595', 'heartbeat_front_addr': '172.21.15.102:6805/3004236595', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 116, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6824', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6825', 'nonce': 743062291}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6826', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6827', 'nonce': 743062291}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6830', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6831', 'nonce': 743062291}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6828', 'nonce': 743062291}, {'type': 'v1', 'addr': '172.21.15.184:6829', 'nonce': 743062291}]}, 'public_addr': '172.21.15.184:6825/743062291', 'cluster_addr': '172.21.15.184:6827/743062291', 'heartbeat_back_addr': '172.21.15.184:6831/743062291', 'heartbeat_front_addr': '172.21.15.184:6829/743062291', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '7a0cc26e-a543-4647-bc53-fbecb69b2326', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6808', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6809', 'nonce': 2410886219}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6810', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6811', 'nonce': 2410886219}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6814', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6815', 'nonce': 2410886219}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6812', 'nonce': 2410886219}, {'type': 'v1', 'addr': '172.21.15.184:6813', 'nonce': 2410886219}]}, 'public_addr': '172.21.15.184:6809/2410886219', 'cluster_addr': '172.21.15.184:6811/2410886219', 'heartbeat_back_addr': '172.21.15.184:6815/2410886219', 'heartbeat_front_addr': '172.21.15.184:6813/2410886219', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '7768eeb7-c6d0-47d8-a400-c47a2154c590', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6800', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6801', 'nonce': 2491178498}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6802', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6803', 'nonce': 2491178498}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6806', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6807', 'nonce': 2491178498}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6804', 'nonce': 2491178498}, {'type': 'v1', 'addr': '172.21.15.184:6805', 'nonce': 2491178498}]}, 'public_addr': '172.21.15.184:6801/2491178498', 'cluster_addr': '172.21.15.184:6803/2491178498', 'heartbeat_back_addr': '172.21.15.184:6807/2491178498', 'heartbeat_front_addr': '172.21.15.184:6805/2491178498', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '30ed992b-2e99-4523-9fdd-8389f75940af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6816', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6817', 'nonce': 1580142875}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6818', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6819', 'nonce': 1580142875}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6822', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6823', 'nonce': 1580142875}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6820', 'nonce': 1580142875}, {'type': 'v1', 'addr': '172.21.15.184:6821', 'nonce': 1580142875}]}, 'public_addr': '172.21.15.184:6817/1580142875', 'cluster_addr': '172.21.15.184:6819/1580142875', 'heartbeat_back_addr': '172.21.15.184:6823/1580142875', 'heartbeat_front_addr': '172.21.15.184:6821/1580142875', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.652871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.866866+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.859757+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:34.082180+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.844484+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.746321+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.324821+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T22:00:33.093833+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.5', 'osds': [3, 2]}, {'pgid': '3.1c', 'osds': [7, 3]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 8, 'length': 9}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 8, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T22:02:52.240 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-21T22:02:52.240 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:52.238+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:52.256 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:52.256 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:52.265 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:52.340 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:52.339+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:52.408 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:52.408 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:52.417 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:52.440 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:52.439+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:52.519 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:52.519 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:52.528 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:52.572 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:52.570+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:52.632 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:52.632 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:52.642 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:52.643 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:52.640+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:52.742 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:52.742+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:52.787 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:52.787 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:52.796 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:52.843 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:52.841+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-09-21T22:02:52.907 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:52.907 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:52.916 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:52.944 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:52.943+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:53.044 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:53.042+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:53.064 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:53.064 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:53.072 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:53.157 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:53.155+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:53.216 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:53.216 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:53.224 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:53.246 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:53.246+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:53.348 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:53.347+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:53.368 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:53.368 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:53.376 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:53.414 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T22:02:53.448 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:53.448+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:53.483 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:53.483 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:53.492 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:53.534 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:53.534 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:53.549 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:53.547+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:53.551 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:53.567 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:53.567 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:53.583 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:53.583 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:53.600 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:53.600 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:53.617 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:53.617 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:53.633 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:53.633 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:53.637 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:53.637 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:53.637 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:53.637 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:53.637 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:53.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:53.650 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:53.650 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:53.650 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:53.648+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:53.750 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:53.750 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:53.750 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:521 3.a 3:534698ff:::rbd_header.11243bc9e3dc:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 114.53671075600001, 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.410852242, 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 521 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.751 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211754+0000", 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211755+0000", 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0399999999999995e-07 2024-09-21T22:02:53.752 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211762+0000", 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9319999999999996e-06 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211772+0000", 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8600000000000005e-06 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211778+0000", 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.169e-06 2024-09-21T22:02:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211821+0000", 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3952000000000002e-05 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:59.211829+0000", 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0690000000000004e-06 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622117+0000", 2024-09-21T22:02:53.754 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.4102882029999999 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622304+0000", 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018692900000000001 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:00.622606+0000", 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030242399999999998 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.755 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56963 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 622592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494649675999995, 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021343747, 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56963 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:53.756 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253815+0000", 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2e-07 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253818+0000", 2024-09-21T22:02:53.757 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1160000000000002e-06 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253823+0000", 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253828+0000", 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1189999999999996e-06 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.274987+0000", 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021158445000000001 2024-09-21T22:02:53.758 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275065+0000", 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8407999999999999e-05 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275159+0000", 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3497000000000003e-05 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.759 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56964 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 851968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494630358999999, 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021459051999999999, 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56964 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.760 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253834+0000", 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253835+0000", 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3299999999999998e-07 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.761 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253837+0000", 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1059999999999998e-06 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253842+0000", 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8080000000000001e-06 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253847+0000", 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6099999999999999e-06 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.762 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275188+0000", 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021341057 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275230+0000", 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1941999999999999e-05 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275293+0000", 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3195999999999996e-05 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.763 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56965 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1081344~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494598358000005, 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021632274, 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56965 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.764 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253866+0000", 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253867+0000", 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7899999999999999e-07 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253869+0000", 2024-09-21T22:02:53.765 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253875+0000", 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0970000000000002e-06 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253880+0000", 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3619999999999997e-06 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275329+0000", 2024-09-21T22:02:53.766 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021448292000000001 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275407+0000", 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7946000000000002e-05 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275499+0000", 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1978000000000006e-05 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.767 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56966 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1310720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494578511, 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021740731999999999, 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56966 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.768 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253886+0000", 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2800000000000003e-07 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.769 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253888+0000", 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0669999999999999e-06 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253894+0000", 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8980000000000001e-06 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253900+0000", 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0050000000000001e-06 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.770 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275526+0000", 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021625912000000001 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275569+0000", 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3043000000000001e-05 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275627+0000", 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7479000000000003e-05 2024-09-21T22:02:53.771 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56967 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1540096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494558338999994, 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021928007999999999, 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.772 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56967 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253906+0000", 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253907+0000", 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.41e-07 2024-09-21T22:02:53.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253908+0000", 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.776e-06 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253914+0000", 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.1950000000000002e-06 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253928+0000", 2024-09-21T22:02:53.774 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3974e-05 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275662+0000", 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021734168000000002 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275740+0000", 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7807999999999998e-05 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275834+0000", 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4746000000000004e-05 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.775 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56968 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494530197000003, 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022029615999999998, 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56968 2024-09-21T22:02:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253934+0000", 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253935+0000", 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6400000000000003e-07 2024-09-21T22:02:53.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253937+0000", 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.12e-06 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253943+0000", 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1160000000000004e-06 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253948+0000", 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.8339999999999998e-06 2024-09-21T22:02:53.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275861+0000", 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021913548000000001 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275905+0000", 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3795000000000003e-05 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.275964+0000", 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8739000000000001e-05 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.779 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56969 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1998848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494511528000004, 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022221162999999999, 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56969 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.780 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253953+0000", 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8000000000000002e-07 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.781 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253955+0000", 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.874e-06 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253961+0000", 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999998e-06 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253965+0000", 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5260000000000004e-06 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.782 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276000+0000", 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022034611999999999 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276078+0000", 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8311000000000003e-05 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276174+0000", 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6139999999999998e-05 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.783 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56984 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494493910000003, 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022340279000000001, 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56984 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.784 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253971+0000", 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.785 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253973+0000", 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.81e-06 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253979+0000", 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7950000000000004e-06 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253983+0000", 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5469999999999998e-06 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.786 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276203+0000", 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022219848 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276248+0000", 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4880999999999999e-05 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276311+0000", 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3047999999999997e-05 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.787 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56985 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494475937999994, 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022528538000000001, 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56985 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.788 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253989+0000", 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6499999999999999e-07 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.789 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253991+0000", 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1229999999999998e-06 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.253997+0000", 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4759999999999997e-06 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254003+0000", 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.896e-06 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.790 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276347+0000", 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022344180000000002 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276424+0000", 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7014000000000005e-05 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276517+0000", 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.3383999999999999e-05 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.791 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56986 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494456334999995, 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022636156000000001, 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56986 2024-09-21T22:02:53.792 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254008+0000", 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.793 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254009+0000", 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3000000000000002e-07 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254021+0000", 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2075e-05 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254027+0000", 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2910000000000004e-06 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.794 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254032+0000", 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0969999999999996e-06 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276545+0000", 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022513014000000001 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276588+0000", 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3183000000000003e-05 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.795 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276644+0000", 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6165999999999997e-05 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56987 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 868352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494425864999997, 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022813353000000001, 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56987 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.797 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254039+0000", 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1199999999999998e-07 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254041+0000", 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9290000000000001e-06 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.798 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254047+0000", 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5799999999999999e-06 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254051+0000", 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6430000000000003e-06 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276680+0000", 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022628945000000001 2024-09-21T22:02:53.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276758+0000", 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7775999999999995e-05 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276852+0000", 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4067999999999995e-05 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.800 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56988 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1097728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494408449999995, 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022923770999999999, 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56988 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:53.801 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254056+0000", 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254058+0000", 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8789999999999999e-06 2024-09-21T22:02:53.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254064+0000", 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2950000000000001e-06 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254068+0000", 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1479999999999999e-06 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276880+0000", 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022812260000000001 2024-09-21T22:02:53.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276923+0000", 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3347999999999999e-05 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.276980+0000", 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6496000000000003e-05 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56989 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1327104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.804 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494391444000001, 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023109826999999999, 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56989 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.805 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254073+0000", 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9200000000000002e-07 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254075+0000", 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.691e-06 2024-09-21T22:02:53.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254081+0000", 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8499999999999999e-06 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254085+0000", 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.498e-06 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277015+0000", 2024-09-21T22:02:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.022929417000000001 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277092+0000", 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6625000000000006e-05 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277183+0000", 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1453999999999995e-05 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56990 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1556480~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494373296999996, 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023224305000000001, 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56990 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.809 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254091+0000", 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254092+0000", 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.22e-07 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.810 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254093+0000", 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7099999999999999e-06 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254099+0000", 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5330000000000002e-06 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254103+0000", 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5079999999999999e-06 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277211+0000", 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023107593999999999 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277254+0000", 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2762000000000002e-05 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277316+0000", 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1876000000000002e-05 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.812 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56991 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 1785856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494355951000003, 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023415498999999999, 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56991 2024-09-21T22:02:53.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254109+0000", 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2599999999999998e-07 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254111+0000", 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.813e-06 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254116+0000", 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.361e-06 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254121+0000", 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5730000000000001e-06 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277351+0000", 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023230621 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277431+0000", 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9818e-05 2024-09-21T22:02:53.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277524+0000", 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.2986999999999996e-05 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:56992 3.9 3:92515d32:::rbd_data.1124581ebce7.0000000000000001:25 [read 2015232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.494338462000002, 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023528238999999999, 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.817 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 56992 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254126+0000", 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4499999999999998e-07 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254128+0000", 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8330000000000001e-06 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254134+0000", 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5729999999999998e-06 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254139+0000", 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4790000000000004e-06 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277553+0000", 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023413607999999999 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277596+0000", 2024-09-21T22:02:53.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3489000000000003e-05 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277654+0000", 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7911999999999997e-05 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57020 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 671744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.493841376999995, 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023243617000000001, 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.821 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57020 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254623+0000", 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254624+0000", 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1200000000000003e-07 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254632+0000", 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1219999999999995e-06 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254640+0000", 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9370000000000004e-06 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254645+0000", 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3140000000000003e-06 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277690+0000", 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023044477000000001 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277768+0000", 2024-09-21T22:02:53.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8594e-05 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277867+0000", 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8560999999999994e-05 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57021 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 688128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.493812476000002, 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023344055999999998, 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.825 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57021 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254652+0000", 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254653+0000", 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254654+0000", 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254661+0000", 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254666+0000", 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9869999999999999e-06 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277894+0000", 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023228029000000001 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277936+0000", 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2589000000000002e-05 2024-09-21T22:02:53.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.277996+0000", 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9967999999999999e-05 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:57023 3.9 3:95b9a111:::rbd_data.1124b436ff4.0000000000000000:22 [read 704512~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73)", 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 66.493793656999998, 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023525122999999998, 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:53.829 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 57023 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254671+0000", 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.32e-07 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254679+0000", 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7479999999999993e-06 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:53.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254686+0000", 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5150000000000003e-06 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.254690+0000", 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7180000000000004e-06 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278021+0000", 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023330391999999998 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:53.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278097+0000", 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6464999999999994e-05 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:47.278196+0000", 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.8852999999999997e-05 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:53.833 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:53.834 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:53.833+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:53.835 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:53.935 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:53.934+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:53.953 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:53.953 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:53.953 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:53.953 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:53.962 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:54.046 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:54.045+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:54.106 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:54.106 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:54.106 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:54.106 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:54.106 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:54.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:54.156 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:54.155+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:54.237 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:54.236+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:5821 3.c 3:3482b188:::rbd_data.11241aed97b.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 110.20597030499999, 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028978673999999999, 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 5821 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051888+0000", 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.261 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051889+0000", 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051892+0000", 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7000000000000002e-06 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051900+0000", 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1010000000000003e-06 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.262 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051904+0000", 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.301e-06 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.051963+0000", 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8848999999999998e-05 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.052048+0000", 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5722000000000004e-05 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.263 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 3", 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.056759+0000", 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0047110299999999997 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080744+0000", 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023984544 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080790+0000", 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5547000000000003e-05 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.264 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080831+0000", 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1313000000000002e-05 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:04.080867+0000", 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5995999999999999e-05 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29929 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3084288~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:54.265 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.329255810999996, 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028690054, 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29929 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.266 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928603+0000", 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5199999999999998e-07 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928604+0000", 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2330000000000001e-06 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.267 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928607+0000", 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0149999999999999e-06 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928610+0000", 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5830000000000001e-06 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957127+0000", 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028517461000000001 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.268 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957201+0000", 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4227000000000006e-05 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957293+0000", 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.1283e-05 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29930 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3608576~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.329245861000004, 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.02890206, 2024-09-21T22:02:54.269 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29930 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.270 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928613+0000", 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6300000000000001e-07 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928617+0000", 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2930000000000002e-06 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928620+0000", 2024-09-21T22:02:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0879999999999999e-06 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928623+0000", 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5000000000000002e-06 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957329+0000", 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028705976000000001 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957412+0000", 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2730000000000002e-05 2024-09-21T22:02:54.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957515+0000", 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010310999999999999 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29931 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3125248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.329232458000007, 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029083701999999999, 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29931 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928626+0000", 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928628+0000", 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.141e-06 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.275 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928630+0000", 2024-09-21T22:02:54.276 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8609999999999998e-06 2024-09-21T22:02:54.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.276 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.276 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.276 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928633+0000", 2024-09-21T22:02:54.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4660000000000002e-06 2024-09-21T22:02:54.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.277 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.277 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.277 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957556+0000", 2024-09-21T22:02:54.277 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028923589999999999 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957625+0000", 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8139999999999995e-05 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957710+0000", 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5154999999999994e-05 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.278 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29932 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3649536~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.329222787000006, 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029301225, 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29932 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.279 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.928636+0000", 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930293+0000", 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0016572259999999999 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.280 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930297+0000", 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4599999999999996e-06 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930305+0000", 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5580000000000003e-06 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930311+0000", 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.891e-06 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.281 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957744+0000", 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.027433422999999998 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957824+0000", 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9872999999999999e-05 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.957937+0000", 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000112794 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.282 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29947 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3452928~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.327226949999996, 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028857722999999998, 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29947 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.283 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930632+0000", 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4999999999999998e-07 2024-09-21T22:02:54.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930639+0000", 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7349999999999999e-06 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930645+0000", 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8009999999999998e-06 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.285 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930650+0000", 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5199999999999999e-06 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959324+0000", 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028674005999999998 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959403+0000", 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9016000000000004e-05 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.286 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959489+0000", 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6295e-05 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29949 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3493888~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.327180694000006, 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029041530999999999, 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29949 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.288 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930678+0000", 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9499999999999998e-07 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930680+0000", 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9740000000000001e-06 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930686+0000", 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9540000000000001e-06 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.289 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930691+0000", 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.622e-06 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959541+0000", 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028850271 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959639+0000", 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7546000000000004e-05 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.290 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959719+0000", 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0768999999999999e-05 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29951 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3534848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.327143359000004, 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029133554999999998, 2024-09-21T22:02:54.291 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29951 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.292 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930715+0000", 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930716+0000", 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9399999999999995e-07 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930717+0000", 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6869999999999999e-06 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.293 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930723+0000", 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6420000000000004e-06 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930727+0000", 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3479999999999997e-06 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959748+0000", 2024-09-21T22:02:54.294 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029020634 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959795+0000", 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7141000000000001e-05 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959849+0000", 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3609000000000001e-05 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29953 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3575808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.327109178000001, 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029281781, 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29953 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.296 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930749+0000", 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930750+0000", 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1699999999999999e-07 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.297 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930751+0000", 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.7320000000000001e-06 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930757+0000", 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5430000000000001e-06 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930761+0000", 2024-09-21T22:02:54.298 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3449999999999999e-06 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959873+0000", 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029112134000000001 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.959927+0000", 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3986000000000001e-05 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.299 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960031+0000", 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000103624 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29955 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3616768~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.327069305999999, 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029445881, 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.300 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29955 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.301 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930789+0000", 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930790+0000", 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.3799999999999998e-07 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930791+0000", 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5999999999999999e-06 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.302 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930797+0000", 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5180000000000004e-06 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930807+0000", 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0519999999999999e-05 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960069+0000", 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029262178 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.303 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960144+0000", 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4906000000000004e-05 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960235+0000", 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0821000000000003e-05 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:29957 3.1c 3:3d29d5db:::rbd_data.1124c77189a0.0000000000000000:10 [read 3657728~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:54.304 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 96.327024021, 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029606763000000001, 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 29957 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.305 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930834+0000", 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930835+0000", 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4199999999999996e-07 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.306 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930837+0000", 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.812e-06 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930843+0000", 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7429999999999999e-06 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.930846+0000", 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1530000000000001e-06 2024-09-21T22:02:54.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960270+0000", 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029424525999999999 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960357+0000", 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6254999999999993e-05 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.960441+0000", 2024-09-21T22:02:54.308 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4732000000000001e-05 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85825 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2277376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.195926540999999, 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028813432, 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.309 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85825 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.310 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061932+0000", 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061936+0000", 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4790000000000001e-06 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.311 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061939+0000", 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1240000000000001e-06 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061941+0000", 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.452e-06 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090598+0000", 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028656966999999998 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.312 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090675+0000", 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6914000000000003e-05 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090745+0000", 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0290999999999995e-05 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.313 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85826 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2342912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.195914422999998, 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028888786999999999, 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85826 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.314 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061944+0000", 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.315 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061946+0000", 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.556e-06 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061949+0000", 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9249999999999999e-06 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061951+0000", 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4739999999999999e-06 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090758+0000", 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028806486999999999 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090796+0000", 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8466000000000001e-05 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090833+0000", 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6674000000000002e-05 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.317 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85827 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2408448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.195904468000002, 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029053266000000001, 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85827 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.318 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061954+0000", 2024-09-21T22:02:54.319 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9999999999999999e-07 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061955+0000", 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.156e-06 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061958+0000", 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9340000000000002e-06 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061961+0000", 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.5040000000000001e-06 2024-09-21T22:02:54.320 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090862+0000", 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028901175000000001 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.090937+0000", 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4881000000000004e-05 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091007+0000", 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.0415999999999998e-05 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.321 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85828 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2473984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.195894787999997, 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029127014, 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85828 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.322 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061964+0000", 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2399999999999999e-07 2024-09-21T22:02:54.323 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061965+0000", 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061968+0000", 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.92e-06 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.061971+0000", 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.101e-06 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.324 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091020+0000", 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029048398999999999 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091056+0000", 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6718000000000003e-05 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091091+0000", 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4501000000000001e-05 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.325 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85829 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2539520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.195845435000003, 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029251899000000001, 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85829 2024-09-21T22:02:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062013+0000", 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062014+0000", 2024-09-21T22:02:54.327 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5499999999999998e-07 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062016+0000", 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.6199999999999999e-06 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062022+0000", 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3249999999999996e-06 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062027+0000", 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2180000000000001e-06 2024-09-21T22:02:54.328 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091120+0000", 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029093112000000001 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091195+0000", 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5499000000000003e-05 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091265+0000", 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9670000000000002e-05 2024-09-21T22:02:54.329 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85830 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2605056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.195825788999997, 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029323741, 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.330 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85830 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.331 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062033+0000", 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0900000000000001e-07 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062034+0000", 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2729999999999999e-06 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062038+0000", 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.602e-06 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062042+0000", 2024-09-21T22:02:54.332 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9949999999999999e-06 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091283+0000", 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029241195000000001 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091320+0000", 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7296999999999999e-05 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091356+0000", 2024-09-21T22:02:54.333 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6170000000000001e-05 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85831 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2670592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.195813317000002, 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029484659999999999, 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.334 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85831 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.335 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062045+0000", 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1199999999999999e-07 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062047+0000", 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1510000000000001e-06 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062050+0000", 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1099999999999999e-06 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062052+0000", 2024-09-21T22:02:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4899999999999999e-06 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091385+0000", 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029333016999999999 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091461+0000", 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6019000000000005e-05 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091530+0000", 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8660999999999999e-05 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.337 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85832 3.1c 3:3cbf6b61:::rbd_data.1124c531400c.0000000000000005:2f [read 2736128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.195803286, 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029557844999999999, 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85832 2024-09-21T22:02:54.338 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.339 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062055+0000", 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062057+0000", 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.119e-06 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062060+0000", 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9730000000000002e-06 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.062062+0000", 2024-09-21T22:02:54.340 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4260000000000002e-06 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091542+0000", 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029480309999999999 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091579+0000", 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6254000000000002e-05 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.091613+0000", 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4555999999999999e-05 2024-09-21T22:02:54.341 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:85882 3.16 3:6c4a0c3b:::rbd_data.1124f4fa8d1.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 50.108811572999997, 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029882499999999999, 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.342 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 85882 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149047+0000", 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.343 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149049+0000", 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.635e-06 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149054+0000", 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7939999999999999e-06 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149067+0000", 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2587e-05 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149074+0000", 2024-09-21T22:02:54.344 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.25e-06 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149143+0000", 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9008000000000001e-05 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149216+0000", 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2947000000000005e-05 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 7", 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.149339+0000", 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00012293800000000001 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.345 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178449+0000", 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.029110159 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178861+0000", 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000411808 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178898+0000", 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6745000000000001e-05 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.346 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.347 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.347 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:04.178929+0000", 2024-09-21T22:02:54.347 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1628999999999998e-05 2024-09-21T22:02:54.347 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.347 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.347 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.347 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.347 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.347 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:54.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:54.349 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:54.346+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:54.449 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:54.449+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:54.492 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:54.492 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:54.492 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:54.492 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:54.500 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:54.585 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:54.584+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:54.644 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:54.644 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:54.644 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:54.644 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:54.644 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:54.651 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:54.650+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:54.653 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:54.752 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:54.750+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:54.810 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33029 3.a 3:529a6378:::rbd_object_map.1124387000ba:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 95.964941373000002, 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.958333031, 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33029 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843528+0000", 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843529+0000", 2024-09-21T22:02:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.252e-06 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843535+0000", 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4990000000000002e-06 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843546+0000", 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1338000000000001e-05 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843552+0000", 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8799999999999996e-06 2024-09-21T22:02:54.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843594+0000", 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2039999999999997e-05 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:18.843600+0000", 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2110000000000003e-06 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796629+0000", 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.95302914999999999 2024-09-21T22:02:54.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.796786+0000", 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015643800000000001 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.797035+0000", 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00024971599999999998 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.798928+0000", 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0018929470000000001 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.815 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801695+0000", 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0027671599999999998 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801761+0000", 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5592000000000005e-05 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.801861+0000", 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9808000000000004e-05 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.816 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33063 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:head [stat,delete] snapc 12=[12] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.966029860000006, 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025179816000000001, 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33063 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.817 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842439+0000", 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842441+0000", 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.378e-06 2024-09-21T22:02:54.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842446+0000", 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2499999999999997e-06 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842456+0000", 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0198e-05 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842463+0000", 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1999999999999997e-06 2024-09-21T22:02:54.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842523+0000", 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9852999999999998e-05 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for missing object", 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.842656+0000", 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00013238400000000001 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862887+0000", 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.020231463000000002 2024-09-21T22:02:54.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for rw locks", 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.862971+0000", 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757999999999993e-05 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863463+0000", 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00049216600000000004 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863509+0000", 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5494999999999997e-05 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.821 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.863668+0000", 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00015913799999999999 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.866512+0000", 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0028444310000000001 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867432+0000", 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00091971299999999995 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:54.822 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867508+0000", 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6339000000000002e-05 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.867619+0000", 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011105 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33245 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5308416~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.857573102999993, 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010501106, 2024-09-21T22:02:54.823 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33245 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.824 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950896+0000", 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950897+0000", 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6099999999999999e-07 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.825 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950900+0000", 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.8629999999999999e-06 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950903+0000", 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3819999999999998e-06 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959090+0000", 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0081877129999999992 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.826 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.959151+0000", 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1204000000000006e-05 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961397+0000", 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0022457760000000001 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33246 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 5767168~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.857563810000002, 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011002869, 2024-09-21T22:02:54.827 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33246 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.828 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950905+0000", 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950906+0000", 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.1e-07 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950918+0000", 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2228e-05 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.829 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950922+0000", 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5850000000000001e-06 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950925+0000", 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.796e-06 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961429+0000", 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010503986 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.830 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961507+0000", 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7774000000000004e-05 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961908+0000", 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00040129 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33247 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6225920~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.857540064000005, 2024-09-21T22:02:54.831 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011399629, 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33247 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.832 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950929+0000", 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2000000000000001e-07 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950931+0000", 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.198e-06 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950934+0000", 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8190000000000002e-06 2024-09-21T22:02:54.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950937+0000", 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3199999999999998e-06 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.961948+0000", 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011010961 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962026+0000", 2024-09-21T22:02:54.834 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8510999999999994e-05 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962329+0000", 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030259999999999998 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33248 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6356992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:54.835 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.857529510999996, 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011581225000000001, 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33248 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.836 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950940+0000", 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0699999999999999e-07 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950941+0000", 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9999999999999995e-07 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.837 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950944+0000", 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9459999999999998e-06 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950946+0000", 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.39e-06 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962361+0000", 2024-09-21T22:02:54.838 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011414743999999999 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962436+0000", 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5420999999999995e-05 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962521+0000", 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4517000000000004e-05 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33249 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6815744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.857520108000003, 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011733212, 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33249 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.840 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950949+0000", 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.05e-07 2024-09-21T22:02:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950950+0000", 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.051e-06 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950954+0000", 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9060000000000004e-06 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950957+0000", 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4530000000000001e-06 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.842 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962552+0000", 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011595421999999999 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962607+0000", 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4679999999999998e-05 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962682+0000", 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.5494999999999995e-05 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33250 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.857509317999998, 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011921297000000001, 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33250 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.844 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950960+0000", 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.04e-07 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.845 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950961+0000", 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1310000000000001e-06 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950964+0000", 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0280000000000001e-06 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950967+0000", 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.7389999999999999e-06 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.846 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962712+0000", 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011745455 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962794+0000", 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1777e-05 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962881+0000", 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6963000000000001e-05 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.847 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33251 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7733248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.857476044999999, 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.01204326, 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33251 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.848 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950993+0000", 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950994+0000", 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.27e-07 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950995+0000", 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5710000000000001e-06 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.849 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.950998+0000", 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2930000000000001e-06 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951001+0000", 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4719999999999998e-06 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962910+0000", 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011909019999999999 2024-09-21T22:02:54.850 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.962983+0000", 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3225000000000004e-05 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963036+0000", 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3352e-05 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33252 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8192000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.851 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.857465372999997, 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012165252, 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33252 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.852 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951004+0000", 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.9400000000000001e-07 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951008+0000", 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1509999999999997e-06 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.853 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951011+0000", 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0139999999999999e-06 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.951014+0000", 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.706e-06 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963055+0000", 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.012041158 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.854 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963092+0000", 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6732e-05 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.963169+0000", 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7197e-05 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33411 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 1900544~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.853335881999996, 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096836679999999994, 2024-09-21T22:02:54.855 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33411 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955133+0000", 2024-09-21T22:02:54.856 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955134+0000", 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1500000000000004e-07 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955138+0000", 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9210000000000002e-06 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955146+0000", 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0970000000000006e-06 2024-09-21T22:02:54.857 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955486+0000", 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00034027999999999999 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964406+0000", 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0089198130000000004 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964515+0000", 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010870300000000001 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.858 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.964817+0000", 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00030223899999999999 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33413 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 2949120~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.852936744000004, 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010018318, 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.859 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33413 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955532+0000", 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.860 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955533+0000", 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4099999999999999e-07 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.955535+0000", 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3089999999999998e-06 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956388+0000", 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00085228300000000001 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956397+0000", 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.6050000000000004e-06 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965176+0000", 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0087791150000000005 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965257+0000", 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0878999999999996e-05 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.862 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.965551+0000", 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00029368599999999998 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33416 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4456448~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.851982152999994, 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098463920000000007, 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.863 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33416 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956487+0000", 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.864 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956488+0000", 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7300000000000001e-07 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956490+0000", 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4210000000000002e-06 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956497+0000", 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.1509999999999998e-06 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.865 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956502+0000", 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2329999999999997e-06 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966107+0000", 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096043190000000001 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966148+0000", 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.1742000000000001e-05 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966333+0000", 2024-09-21T22:02:54.866 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018505299999999999 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33417 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 4915200~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.8519589, 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010129147999999999, 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.867 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33417 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956510+0000", 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956511+0000", 2024-09-21T22:02:54.868 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.3500000000000002e-07 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956513+0000", 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.3029999999999998e-06 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.956526+0000", 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3227000000000001e-05 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957668+0000", 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0011420639999999999 2024-09-21T22:02:54.869 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966361+0000", 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0086930730000000008 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966445+0000", 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3757000000000005e-05 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.966639+0000", 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000194289 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.870 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33420 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6422528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.850666230000002, 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096645059999999998, 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33420 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.871 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957803+0000", 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9700000000000002e-07 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.872 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957806+0000", 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.154e-06 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957812+0000", 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0650000000000004e-06 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957816+0000", 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5970000000000002e-06 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.873 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967368+0000", 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0095521270000000005 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967411+0000", 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2681e-05 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967467+0000", 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6484999999999999e-05 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.874 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33421 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 6881280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.850647116999994, 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098506199999999992, 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33421 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.875 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957822+0000", 2024-09-21T22:02:54.876 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.34e-07 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957824+0000", 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9360000000000002e-06 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957830+0000", 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.9139999999999996e-06 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957835+0000", 2024-09-21T22:02:54.877 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7099999999999998e-06 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967503+0000", 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0096683099999999994 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967584+0000", 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0547e-05 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967673+0000", 2024-09-21T22:02:54.878 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8869000000000006e-05 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33422 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.850627986999996, 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099566710000000003, 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.879 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33422 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957841+0000", 2024-09-21T22:02:54.880 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957842+0000", 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957844+0000", 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9719999999999999e-06 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957850+0000", 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2809999999999997e-06 2024-09-21T22:02:54.881 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957855+0000", 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9280000000000001e-06 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967700+0000", 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0098446899999999997 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967742+0000", 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2901999999999997e-05 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.882 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967798+0000", 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.5498000000000003e-05 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33423 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.850609649000006, 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010137937, 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.883 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33423 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.884 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957860+0000", 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.39e-07 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957862+0000", 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.95e-06 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957867+0000", 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6160000000000001e-06 2024-09-21T22:02:54.885 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957872+0000", 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9089999999999999e-06 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967833+0000", 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0099602000000000007 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967911+0000", 2024-09-21T22:02:54.886 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8205000000000001e-05 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.967998+0000", 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6718000000000006e-05 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:33424 3.10 3:0a26451b:::rbd_data.112454b9c0b3.0000000000000002:12 [sparse-read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 94.850591249999994, 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010238015, 2024-09-21T22:02:54.887 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.888 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.888 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:54.888 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.888 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.888 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.888 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 33424 2024-09-21T22:02:54.888 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.888 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.888 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.889 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957878+0000", 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4900000000000001e-07 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957880+0000", 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.052e-06 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957887+0000", 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2299999999999996e-06 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.890 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.957891+0000", 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.369e-06 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968018+0000", 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.010126705 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968062+0000", 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.384e-05 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:19.968116+0000", 2024-09-21T22:02:54.891 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.4469999999999999e-05 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:41899 3.10 3:0bb333a9:::rbd_data.11247a90fb52.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 86.053681839000006, 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.015085853, 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:54.892 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 41899 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754787+0000", 2024-09-21T22:02:54.893 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754789+0000", 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.372e-06 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754796+0000", 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.8249999999999999e-06 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754809+0000", 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.3662000000000001e-05 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754816+0000", 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.7220000000000002e-06 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754866+0000", 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9945999999999999e-05 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.754919+0000", 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3329999999999999e-05 2024-09-21T22:02:54.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.758040+0000", 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0031204869999999999 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769752+0000", 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.011712530000000001 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769803+0000", 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.117e-05 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.896 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769841+0000", 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7982999999999999e-05 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:28.769873+0000", 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.1826000000000003e-05 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:54.897 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:54.898 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T22:02:54.899 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:54.899 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:54.898+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:54.999 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:54.998+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:55.043 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:55.043 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:55.043 INFO:teuthology.orchestra.run.smithi184.stdout: "num_ops": 0 2024-09-21T22:02:55.043 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:55.053 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:55.140 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:55.139+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:55.196 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:55.196 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [], 2024-09-21T22:02:55.196 INFO:teuthology.orchestra.run.smithi184.stdout: "complaint_time": 30, 2024-09-21T22:02:55.196 INFO:teuthology.orchestra.run.smithi184.stdout: "num_blocked_ops": 0 2024-09-21T22:02:55.196 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:55.201 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:55.200+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:55.205 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:55.302 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:55.301+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:55.351 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-21T22:02:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "size": 20, 2024-09-21T22:02:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 600, 2024-09-21T22:02:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "ops": [ 2024-09-21T22:02:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4212.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T22:02:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:55.351 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 137.27546895399999, 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.247102614, 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4212", 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/750701463", 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 1 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.352 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073382+0000", 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073383+0000", 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.8160000000000001e-06 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073391+0000", 2024-09-21T22:02:55.353 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8350000000000004e-06 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073403+0000", 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1799e-05 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073413+0000", 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0012e-05 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.354 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073487+0000", 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3663000000000003e-05 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op must wait for map", 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.073494+0000", 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3329999999999999e-06 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077127+0000", 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.003632648 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.077136+0000", 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4890000000000001e-06 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319119+0000", 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.24198292800000001 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319303+0000", 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018383900000000001 2024-09-21T22:02:55.356 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 0", 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.319487+0000", 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018455199999999999 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320222+0000", 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000734251 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320411+0000", 2024-09-21T22:02:55.357 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00018884500000000001 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320451+0000", 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0670000000000002e-05 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:00:38.320484+0000", 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.2934e-05 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.358 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:7933 3.11 3:8add74ad:::rbd_data.11245d75990.0000000000000004:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 109.843432703, 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.028791522999999999, 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 7933 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.359 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505418+0000", 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505419+0000", 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.4499999999999996e-07 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.360 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505422+0000", 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9269999999999998e-06 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505432+0000", 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.0969999999999995e-06 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505436+0000", 2024-09-21T22:02:55.361 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7960000000000003e-06 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505475+0000", 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.8855e-05 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.505521+0000", 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.6057999999999998e-05 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.362 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.510218+0000", 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0046964449999999996 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534101+0000", 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023883015 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534137+0000", 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.6641999999999999e-05 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.363 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534175+0000", 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7821000000000003e-05 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:05.534209+0000", 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.4122000000000003e-05 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28834 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:55.364 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 97.490605885999997, 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023882212999999999, 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28834 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.365 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858245+0000", 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.5400000000000002e-07 2024-09-21T22:02:55.366 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858247+0000", 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0600000000000002e-06 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858253+0000", 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0480000000000004e-06 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858258+0000", 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9779999999999996e-06 2024-09-21T22:02:55.367 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.881978+0000", 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023720391 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882040+0000", 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1556000000000005e-05 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882127+0000", 2024-09-21T22:02:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6825999999999998e-05 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28835 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 97.490586422999996, 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024096118, 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.369 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28835 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858264+0000", 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858265+0000", 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0100000000000005e-07 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858266+0000", 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.872e-06 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858272+0000", 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.75e-06 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.371 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858284+0000", 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.2183e-05 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882169+0000", 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023884445000000001 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882253+0000", 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.3745999999999994e-05 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.372 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882360+0000", 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00010762100000000001 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28836 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 97.490558346, 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024263954000000001, 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.373 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28836 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.374 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858292+0000", 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858293+0000", 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0999999999999999e-07 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858295+0000", 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.4700000000000001e-06 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.375 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858302+0000", 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6320000000000002e-06 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858308+0000", 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8239999999999996e-06 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882406+0000", 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024098867999999999 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.376 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882476+0000", 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.9133000000000004e-05 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882556+0000", 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.0617000000000004e-05 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28837 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:55.377 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 97.490536513999999, 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024464494, 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28837 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:55.378 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858314+0000", 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.27e-07 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858316+0000", 2024-09-21T22:02:55.379 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.063e-06 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858323+0000", 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.511e-06 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858328+0000", 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0119999999999996e-06 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882597+0000", 2024-09-21T22:02:55.380 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024268881999999999 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882681+0000", 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4476999999999998e-05 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882778+0000", 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.7121999999999996e-05 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.381 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28838 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1462272~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 97.490516186999997, 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024650821999999999, 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28838 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.382 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858334+0000", 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858335+0000", 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.0400000000000002e-07 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.383 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858337+0000", 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.108e-06 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858343+0000", 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.5320000000000003e-06 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858348+0000", 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.9699999999999998e-06 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.384 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882818+0000", 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024469525999999998 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882896+0000", 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.7949999999999997e-05 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.882985+0000", 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9332000000000005e-05 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.385 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28839 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1503232~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 97.490495225000004, 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024864081999999999, 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.386 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28839 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858355+0000", 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.387 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858356+0000", 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9999999999999998e-07 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858358+0000", 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.2409999999999998e-06 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858365+0000", 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.6220000000000003e-06 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.388 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858370+0000", 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2349999999999999e-06 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883030+0000", 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024660298000000001 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883117+0000", 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6510999999999999e-05 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.389 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883219+0000", 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000102775 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:28840 3.d 3:b4402d83:::rbd_data.1124c77189a0.0000000000000005:10 [read 1544192~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 97.490474238000004, 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025049914, 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.390 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 28840 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858376+0000", 2024-09-21T22:02:55.391 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858377+0000", 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9000000000000002e-07 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858379+0000", 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.0899999999999999e-06 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858385+0000", 2024-09-21T22:02:55.392 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4409999999999998e-06 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.858391+0000", 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3090000000000003e-06 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883256+0000", 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024865116 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.393 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883338+0000", 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.2327e-05 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:17.883426+0000", 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8240999999999998e-05 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:49858 3.13 3:cf49d586:::rbd_data.1124298f9171.0000000000000006:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 74.549027444000004, 2024-09-21T22:02:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.026338139, 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 49858 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.395 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799823+0000", 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799825+0000", 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.5099999999999999e-06 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799833+0000", 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1429999999999998e-06 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.396 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799849+0000", 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.6541e-05 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799857+0000", 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.9219999999999997e-06 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.799920+0000", 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.2718000000000005e-05 2024-09-21T22:02:55.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.800001+0000", 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.1481000000000001e-05 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for subops from 4", 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.804574+0000", 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.0045721720000000002 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "sub_op_commit_rec", 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826029+0000", 2024-09-21T22:02:55.398 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.021455183999999999 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "op_commit", 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826048+0000", 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9086e-05 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "commit_sent", 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826104+0000", 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6499000000000002e-05 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:01:40.826161+0000", 2024-09-21T22:02:55.399 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6882999999999997e-05 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81730 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7127040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 54.175407047999997, 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023997688999999999, 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.400 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81730 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173443+0000", 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.401 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173444+0000", 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.0499999999999999e-07 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173450+0000", 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1750000000000002e-06 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173456+0000", 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0599999999999996e-06 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.402 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173461+0000", 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5279999999999997e-06 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197301+0000", 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023840647 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197353+0000", 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2222000000000002e-05 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.403 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197441+0000", 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.7751999999999996e-05 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81734 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 54.175371615000003, 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024110228000000001, 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.404 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81734 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.405 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173479+0000", 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.7100000000000002e-07 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173482+0000", 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.136e-06 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.406 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173488+0000", 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.3380000000000001e-06 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173493+0000", 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.7559999999999999e-06 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197456+0000", 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.023962944999999999 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197495+0000", 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9385000000000003e-05 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197589+0000", 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.4097000000000004e-05 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81735 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:55.408 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 54.175351239999998, 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024317473999999999, 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81735 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.409 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173499+0000", 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173500+0000", 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.58e-07 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.410 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173502+0000", 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9580000000000001e-06 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173507+0000", 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6080000000000003e-06 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173516+0000", 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.8130000000000002e-06 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197630+0000", 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024114304 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197717+0000", 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6839e-05 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197817+0000", 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 9.9494000000000007e-05 2024-09-21T22:02:55.412 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81736 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 2605056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 54.175328381, 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024493269000000002, 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.413 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81736 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173522+0000", 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.414 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173523+0000", 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.72e-07 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173524+0000", 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9850000000000001e-06 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173531+0000", 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.049e-06 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.415 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173539+0000", 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.5790000000000004e-06 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197853+0000", 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024313950000000001 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.197926+0000", 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.2606000000000002e-05 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.416 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198015+0000", 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.9728000000000006e-05 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81737 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 3883008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 54.175305533, 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024642094, 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.417 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81737 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.418 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173545+0000", 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7300000000000002e-07 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173547+0000", 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 2.013e-06 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.419 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173554+0000", 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.4559999999999997e-06 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173558+0000", 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4240000000000003e-06 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198041+0000", 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024483076999999999 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.420 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198102+0000", 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1066000000000001e-05 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198187+0000", 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.4685000000000007e-05 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81738 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 4571136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:55.421 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 54.175286683000003, 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024869964000000001, 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81738 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.422 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173564+0000", 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.2200000000000004e-07 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.423 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173566+0000", 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.86e-06 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173574+0000", 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.3200000000000002e-06 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173578+0000", 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.5360000000000003e-06 2024-09-21T22:02:55.424 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198231+0000", 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024653195999999999 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198318+0000", 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 8.6810000000000004e-05 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198434+0000", 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00011572 2024-09-21T22:02:55.425 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81739 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 54.175266506, 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024965376000000001, 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.426 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81739 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.427 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173584+0000", 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.4200000000000001e-07 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173590+0000", 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0889999999999999e-06 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173596+0000", 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.1199999999999999e-06 2024-09-21T22:02:55.428 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173600+0000", 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2379999999999999e-06 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198454+0000", 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024854246 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198496+0000", 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.2202e-05 2024-09-21T22:02:55.429 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198549+0000", 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.3038999999999998e-05 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81740 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 6537216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 54.175244567999997, 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025068272999999999, 2024-09-21T22:02:55.430 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81740 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.431 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173606+0000", 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.7099999999999997e-07 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173608+0000", 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.9429999999999999e-06 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.432 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173614+0000", 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6289999999999998e-06 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173618+0000", 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.459e-06 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198573+0000", 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.024954473000000001 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.433 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198614+0000", 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.087e-05 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198674+0000", 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0528000000000001e-05 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:81749 3.11 3:8c0b2b2f:::rbd_data.1124d990a49c.0000000000000000:2d [read 7815168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T22:02:55.434 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 54.175226352000003, 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025172553, 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 81749 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.435 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173624+0000", 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173625+0000", 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.46e-07 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.436 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173626+0000", 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.841e-06 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173632+0000", 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.8130000000000001e-06 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.173638+0000", 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.6890000000000001e-06 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198697+0000", 2024-09-21T22:02:55.437 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.025059100000000001 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198736+0000", 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 3.9319000000000001e-05 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:01.198797+0000", 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 6.0445000000000001e-05 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.438 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "description": "osd_op(client.4388.0:90311 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110)", 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "initiated_at": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "age": 28.611188831, 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.98809498799999995, 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "continuous": false, 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "type_data": { 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "flag_point": "started", 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "client_info": { 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "client": "client.4388", 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "client_addr": "172.21.15.102:0/3592280969", 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "tid": 90311 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.439 INFO:teuthology.orchestra.run.smithi184.stdout: "events": [ 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "initiated", 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "header_read", 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "throttled", 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737662+0000", 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.6599999999999995e-07 2024-09-21T22:02:55.440 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "all_read", 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737667+0000", 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 4.442e-06 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "dispatched", 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737677+0000", 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.0132000000000001e-05 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "queued_for_pg", 2024-09-21T22:02:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737682+0000", 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 5.0010000000000001e-06 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737760+0000", 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 7.8349999999999994e-05 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "waiting for peered", 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:26.737772+0000", 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 1.1209999999999999e-05 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.442 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "reached_pg", 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:27.725508+0000", 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.98773678200000004 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "started", 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:27.725615+0000", 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.000107091 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: { 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "event": "done", 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "time": "2024-09-21T22:02:27.725757+0000", 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: "duration": 0.00014121399999999999 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.443 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-21T22:02:55.444 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-21T22:02:55.444 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-21T22:02:55.445 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:55.444+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:55.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T22:02:55.545 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:55.543+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:55.549 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:55.549 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:55.549 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2024-09-21T22:02:55.549 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:55.558 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T22:02:55.646 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-21T22:02:55.644+0000 7f1b811e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33761) UID: 0 2024-09-21T22:02:55.661 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T22:02:55.702 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:02:55.703 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2024-09-21T22:02:55.703 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2024-09-21T22:02:55.703 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2024-09-21T22:02:55.703 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:02:55.712 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T22:02:55.721 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-09-21T22:02:55.780 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:55.778+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:55.796 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-09-21T22:02:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T22:02:55.814 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-09-21T22:02:55.814 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T22:02:55.834 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-09-21T22:02:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T22:02:55.841 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:55.841 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:55.848 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:55.847+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:55.852 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T22:02:55.852 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3: {} 2024-09-21T22:02:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T22:02:55.871 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4: {} 2024-09-21T22:02:55.871 INFO:teuthology.orchestra.run.smithi102.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T22:02:55.889 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5: {} 2024-09-21T22:02:55.889 INFO:teuthology.orchestra.run.smithi102.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T22:02:55.906 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6: {} 2024-09-21T22:02:55.906 INFO:teuthology.orchestra.run.smithi102.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T22:02:55.922 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7: {} 2024-09-21T22:02:55.923 INFO:teuthology.orchestra.run.smithi102.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T22:02:55.949 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:55.948+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:55.959 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:55.959 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:55.967 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T22:02:56.050 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-09-21T22:02:56.050+0000 7feace73b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33685) UID: 0 2024-09-21T22:02:56.111 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:56.111 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:56.119 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T22:02:56.163 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-21T22:02:56.161+0000 7f176427a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33756) UID: 0 2024-09-21T22:02:56.221 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:56.221 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:56.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T22:02:56.271 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:56.269+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:56.352 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:56.350+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:56.373 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:56.373 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:56.382 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T22:02:56.466 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-21T22:02:56.464+0000 7f1ffb554640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33749) UID: 0 2024-09-21T22:02:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:56.525 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:56.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T22:02:56.555 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:56.554+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:56.656 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-09-21T22:02:56.655+0000 7ff4602fa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33690) UID: 0 2024-09-21T22:02:56.676 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:56.676 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:56.685 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T22:02:56.756 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-21T22:02:56.754+0000 7fb10f9c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33767) UID: 0 2024-09-21T22:02:56.787 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:56.787 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:56.795 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T22:02:56.856 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-09-21T22:02:56.856+0000 7f04970a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33681) UID: 0 2024-09-21T22:02:56.946 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:56.946 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:56.956 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T22:02:56.957 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-09-21T22:02:56.956+0000 7f132134a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33687) UID: 0 2024-09-21T22:02:56.970 INFO:teuthology.orchestra.run.smithi102.stdout:All operations completed A-OK! 2024-09-21T22:02:56.983 DEBUG:teuthology.parallel:result is None 2024-09-21T22:02:56.983 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-21T22:02:56.992 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-21T22:02:57.018 INFO:tasks.thrashosds:joining thrashosds 2024-09-21T22:02:57.063 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:57.064 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:57.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T22:02:57.177 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:57.177 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:57.186 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T22:02:57.241 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-21T22:02:57.241 INFO:tasks.thrashosds.thrasher:Adding osd 6 2024-09-21T22:02:57.241 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 6 2024-09-21T22:02:57.289 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:57.289 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:57.299 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T22:02:57.402 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:57.402 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:57.412 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T22:02:57.515 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:57.515 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:57.524 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T22:02:57.528 INFO:tasks.ceph.mon.a.smithi102.stderr:2024-09-21T22:02:57.526+0000 7f46e9689640 -1 mon.a@0(leader).osd e140 definitely_dead 0 2024-09-21T22:02:57.626 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:57.626 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:57.634 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T22:02:57.738 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:57.738 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:57.740 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T22:02:57.746 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T22:02:57.850 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:57.850 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:57.859 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T22:02:57.877 INFO:teuthology.orchestra.run.smithi102.stderr:marked in osd.6. 2024-09-21T22:02:57.899 INFO:tasks.thrashosds.thrasher:Added osd 6 2024-09-21T22:02:57.899 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-21T22:02:57.899 INFO:tasks.thrashosds.thrasher:Adding osd 2 2024-09-21T22:02:57.899 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 2 2024-09-21T22:02:57.965 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:57.965 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:57.974 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T22:02:58.076 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:58.076 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:58.085 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T22:02:58.189 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:58.189 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:58.198 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T22:02:58.208 INFO:tasks.ceph.mon.a.smithi102.stderr:2024-09-21T22:02:58.207+0000 7f46e9689640 -1 mon.a@0(leader).osd e141 definitely_dead 0 2024-09-21T22:02:58.300 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:58.300 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:58.310 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T22:02:58.412 INFO:teuthology.orchestra.run.smithi184.stdout:ERROR: (22) Invalid argument 2024-09-21T22:02:58.412 INFO:teuthology.orchestra.run.smithi184.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T22:02:58.879 INFO:teuthology.orchestra.run.smithi102.stderr:marked in osd.2. 2024-09-21T22:02:58.880 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-09-21T22:02:58.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T22:02:58.903 INFO:tasks.thrashosds.thrasher:Added osd 2 2024-09-21T22:02:58.903 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-21T22:02:59.062 INFO:teuthology.orchestra.run.smithi102.stdout:mon.a: {} 2024-09-21T22:02:59.063 INFO:teuthology.orchestra.run.smithi102.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:02:59.072 INFO:teuthology.orchestra.run.smithi102.stdout:mon.b: {} 2024-09-21T22:02:59.072 INFO:teuthology.orchestra.run.smithi102.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:02:59.080 INFO:teuthology.orchestra.run.smithi102.stdout:mon.c: {} 2024-09-21T22:02:59.080 INFO:teuthology.orchestra.run.smithi102.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T22:02:59.095 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T22:02:59.721 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-09-21T22:02:59.725 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T22:02:59.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-21T22:03:00.728 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-21T22:03:00.747 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T22:03:01.727 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T22:03:01.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-21T22:03:02.726 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-21T22:03:02.744 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T22:03:03.735 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T22:03:03.751 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-21T22:03:04.722 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-21T22:03:04.739 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T22:03:05.913 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T22:03:05.929 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-21T22:03:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-21T22:03:06.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T22:03:07.940 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T22:03:07.957 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-21T22:03:08.934 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-21T22:03:08.951 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T22:03:09.936 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T22:03:09.955 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-21T22:03:10.948 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-21T22:03:10.962 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-21T22:03:11.964 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.6 to 1 (10000) 2024-09-21T22:03:11.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-21T22:03:12.965 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-21T22:03:12.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T22:03:13.975 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T22:03:13.993 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-21T22:03:14.980 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-21T22:03:14.997 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-21T22:03:14.998 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-21T22:03:14.998 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-21T22:03:14.998 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-21T22:03:14.998 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T22:03:14.998 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:03:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:03:15.286 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":158,"fsid":"014f3ec5-afd0-4b18-9c74-de91f34d0760","created":"2024-09-21T22:00:24.916784+0000","modified":"2024-09-21T22:03:14.974504+0000","last_up_change":"2024-09-21T22:00:36.060631+0000","last_in_change":"2024-09-21T22:02:58.877270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:00:37.034134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T22:00:42.753049+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-21T22:00:52.269263+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":47,"snap_epoch":140,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ebc4f0b9-33fc-4301-b1c0-ac843b19095b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6809","nonce":3559797623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6811","nonce":3559797623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6815","nonce":3559797623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6813","nonce":3559797623}]},"public_addr":"172.21.15.102:6809/3559797623","cluster_addr":"172.21.15.102:6811/3559797623","heartbeat_back_addr":"172.21.15.102:6815/3559797623","heartbeat_front_addr":"172.21.15.102:6813/3559797623","state":["exists","up"]},{"osd":1,"uuid":"1c8f54fe-439f-486e-8b8b-fe892332ada3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6825","nonce":428384344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6827","nonce":428384344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6831","nonce":428384344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6829","nonce":428384344}]},"public_addr":"172.21.15.102:6825/428384344","cluster_addr":"172.21.15.102:6827/428384344","heartbeat_back_addr":"172.21.15.102:6831/428384344","heartbeat_front_addr":"172.21.15.102:6829/428384344","state":["exists","up"]},{"osd":2,"uuid":"b202159c-804c-4d22-9aa3-8f590dce8faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6817","nonce":4237051748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6819","nonce":4237051748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6823","nonce":4237051748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6821","nonce":4237051748}]},"public_addr":"172.21.15.102:6817/4237051748","cluster_addr":"172.21.15.102:6819/4237051748","heartbeat_back_addr":"172.21.15.102:6823/4237051748","heartbeat_front_addr":"172.21.15.102:6821/4237051748","state":["exists","up"]},{"osd":3,"uuid":"28a8c407-a445-4c76-8d7c-d5a249d13e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6801","nonce":3004236595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6803","nonce":3004236595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6807","nonce":3004236595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6805","nonce":3004236595}]},"public_addr":"172.21.15.102:6801/3004236595","cluster_addr":"172.21.15.102:6803/3004236595","heartbeat_back_addr":"172.21.15.102:6807/3004236595","heartbeat_front_addr":"172.21.15.102:6805/3004236595","state":["exists","up"]},{"osd":4,"uuid":"cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6825","nonce":743062291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6827","nonce":743062291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6831","nonce":743062291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6829","nonce":743062291}]},"public_addr":"172.21.15.184:6825/743062291","cluster_addr":"172.21.15.184:6827/743062291","heartbeat_back_addr":"172.21.15.184:6831/743062291","heartbeat_front_addr":"172.21.15.184:6829/743062291","state":["exists","up"]},{"osd":5,"uuid":"7a0cc26e-a543-4647-bc53-fbecb69b2326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6809","nonce":2410886219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6811","nonce":2410886219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6815","nonce":2410886219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6813","nonce":2410886219}]},"public_addr":"172.21.15.184:6809/2410886219","cluster_addr":"172.21.15.184:6811/2410886219","heartbeat_back_addr":"172.21.15.184:6815/2410886219","heartbeat_front_addr":"172.21.15.184:6813/2410886219","state":["exists","up"]},{"osd":6,"uuid":"7768eeb7-c6d0-47d8-a400-c47a2154c590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6801","nonce":2491178498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6803","nonce":2491178498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6807","nonce":2491178498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6805","nonce":2491178498}]},"public_addr":"172.21.15.184:6801/2491178498","cluster_addr":"172.21.15.184:6803/2491178498","heartbeat_back_addr":"172.21.15.184:6807/2491178498","heartbeat_front_addr":"172.21.15.184:6805/2491178498","state":["exists","up"]},{"osd":7,"uuid":"30ed992b-2e99-4523-9fdd-8389f75940af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6817","nonce":1580142875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6819","nonce":1580142875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6823","nonce":1580142875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6821","nonce":1580142875}]},"public_addr":"172.21.15.184:6817/1580142875","cluster_addr":"172.21.15.184:6819/1580142875","heartbeat_back_addr":"172.21.15.184:6823/1580142875","heartbeat_front_addr":"172.21.15.184:6821/1580142875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.652871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.866866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.859757+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:34.082180+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.844484+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.746321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.324821+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.093833+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.5","osds":[3,2]},{"pgid":"3.1c","osds":[7,3]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:03:15.299 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T22:03:15.300 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:03:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:03:15.580 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":158,"fsid":"014f3ec5-afd0-4b18-9c74-de91f34d0760","created":"2024-09-21T22:00:24.916784+0000","modified":"2024-09-21T22:03:14.974504+0000","last_up_change":"2024-09-21T22:00:36.060631+0000","last_in_change":"2024-09-21T22:02:58.877270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:00:37.034134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T22:00:42.753049+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-21T22:00:52.269263+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":47,"snap_epoch":140,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ebc4f0b9-33fc-4301-b1c0-ac843b19095b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6809","nonce":3559797623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6811","nonce":3559797623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6815","nonce":3559797623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6813","nonce":3559797623}]},"public_addr":"172.21.15.102:6809/3559797623","cluster_addr":"172.21.15.102:6811/3559797623","heartbeat_back_addr":"172.21.15.102:6815/3559797623","heartbeat_front_addr":"172.21.15.102:6813/3559797623","state":["exists","up"]},{"osd":1,"uuid":"1c8f54fe-439f-486e-8b8b-fe892332ada3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6825","nonce":428384344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6827","nonce":428384344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6831","nonce":428384344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6829","nonce":428384344}]},"public_addr":"172.21.15.102:6825/428384344","cluster_addr":"172.21.15.102:6827/428384344","heartbeat_back_addr":"172.21.15.102:6831/428384344","heartbeat_front_addr":"172.21.15.102:6829/428384344","state":["exists","up"]},{"osd":2,"uuid":"b202159c-804c-4d22-9aa3-8f590dce8faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6817","nonce":4237051748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6819","nonce":4237051748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6823","nonce":4237051748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6821","nonce":4237051748}]},"public_addr":"172.21.15.102:6817/4237051748","cluster_addr":"172.21.15.102:6819/4237051748","heartbeat_back_addr":"172.21.15.102:6823/4237051748","heartbeat_front_addr":"172.21.15.102:6821/4237051748","state":["exists","up"]},{"osd":3,"uuid":"28a8c407-a445-4c76-8d7c-d5a249d13e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6801","nonce":3004236595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6803","nonce":3004236595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6807","nonce":3004236595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6805","nonce":3004236595}]},"public_addr":"172.21.15.102:6801/3004236595","cluster_addr":"172.21.15.102:6803/3004236595","heartbeat_back_addr":"172.21.15.102:6807/3004236595","heartbeat_front_addr":"172.21.15.102:6805/3004236595","state":["exists","up"]},{"osd":4,"uuid":"cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6825","nonce":743062291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6827","nonce":743062291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6831","nonce":743062291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6829","nonce":743062291}]},"public_addr":"172.21.15.184:6825/743062291","cluster_addr":"172.21.15.184:6827/743062291","heartbeat_back_addr":"172.21.15.184:6831/743062291","heartbeat_front_addr":"172.21.15.184:6829/743062291","state":["exists","up"]},{"osd":5,"uuid":"7a0cc26e-a543-4647-bc53-fbecb69b2326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6809","nonce":2410886219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6811","nonce":2410886219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6815","nonce":2410886219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6813","nonce":2410886219}]},"public_addr":"172.21.15.184:6809/2410886219","cluster_addr":"172.21.15.184:6811/2410886219","heartbeat_back_addr":"172.21.15.184:6815/2410886219","heartbeat_front_addr":"172.21.15.184:6813/2410886219","state":["exists","up"]},{"osd":6,"uuid":"7768eeb7-c6d0-47d8-a400-c47a2154c590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6801","nonce":2491178498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6803","nonce":2491178498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6807","nonce":2491178498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6805","nonce":2491178498}]},"public_addr":"172.21.15.184:6801/2491178498","cluster_addr":"172.21.15.184:6803/2491178498","heartbeat_back_addr":"172.21.15.184:6807/2491178498","heartbeat_front_addr":"172.21.15.184:6805/2491178498","state":["exists","up"]},{"osd":7,"uuid":"30ed992b-2e99-4523-9fdd-8389f75940af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6817","nonce":1580142875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6819","nonce":1580142875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6823","nonce":1580142875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6821","nonce":1580142875}]},"public_addr":"172.21.15.184:6817/1580142875","cluster_addr":"172.21.15.184:6819/1580142875","heartbeat_back_addr":"172.21.15.184:6823/1580142875","heartbeat_front_addr":"172.21.15.184:6821/1580142875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.652871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.866866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.859757+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:34.082180+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.844484+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.746321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.324821+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.093833+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.5","osds":[3,2]},{"pgid":"3.1c","osds":[7,3]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:03:15.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T22:03:15.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T22:03:15.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T22:03:15.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T22:03:15.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T22:03:15.595 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T22:03:15.595 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T22:03:15.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T22:03:15.835 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:15.835 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T22:03:15.839 INFO:teuthology.orchestra.run.smithi102.stdout:60129542180 2024-09-21T22:03:15.839 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T22:03:15.840 INFO:teuthology.orchestra.run.smithi102.stdout:60129542180 2024-09-21T22:03:15.840 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T22:03:15.841 INFO:teuthology.orchestra.run.smithi102.stdout:60129542181 2024-09-21T22:03:15.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T22:03:15.842 INFO:teuthology.orchestra.run.smithi102.stdout:60129542180 2024-09-21T22:03:15.842 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T22:03:15.842 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:15.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T22:03:15.843 INFO:teuthology.orchestra.run.smithi102.stdout:55834574882 2024-09-21T22:03:15.844 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T22:03:15.845 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:15.846 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T22:03:16.372 INFO:teuthology.orchestra.run.smithi102.stdout:60129542178 2024-09-21T22:03:16.390 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:16.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.2 2024-09-21T22:03:16.408 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:16.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542179 for osd.4 2024-09-21T22:03:16.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542179 for osd.1 2024-09-21T22:03:16.435 INFO:teuthology.orchestra.run.smithi102.stdout:60129542178 2024-09-21T22:03:16.437 INFO:teuthology.orchestra.run.smithi102.stdout:60129542178 2024-09-21T22:03:16.440 INFO:teuthology.orchestra.run.smithi102.stdout:60129542180 2024-09-21T22:03:16.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.5 2024-09-21T22:03:16.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.3 2024-09-21T22:03:16.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542181 got 60129542180 for osd.7 2024-09-21T22:03:16.465 INFO:teuthology.orchestra.run.smithi102.stdout:55834574881 2024-09-21T22:03:16.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574881 for osd.0 2024-09-21T22:03:16.490 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:16.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542179 for osd.6 2024-09-21T22:03:17.392 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T22:03:17.411 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T22:03:17.427 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T22:03:17.453 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T22:03:17.454 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T22:03:17.456 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T22:03:17.484 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T22:03:17.504 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T22:03:17.899 INFO:teuthology.orchestra.run.smithi102.stdout:60129542178 2024-09-21T22:03:17.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.2 2024-09-21T22:03:17.981 INFO:teuthology.orchestra.run.smithi102.stdout:60129542180 2024-09-21T22:03:17.988 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:18.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542181 got 60129542180 for osd.7 2024-09-21T22:03:18.003 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:18.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542179 for osd.4 2024-09-21T22:03:18.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542179 for osd.1 2024-09-21T22:03:18.025 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:18.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.5 2024-09-21T22:03:18.038 DEBUG:teuthology.parallel:result is None 2024-09-21T22:03:18.041 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:18.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.3 2024-09-21T22:03:18.054 DEBUG:teuthology.parallel:result is None 2024-09-21T22:03:18.102 INFO:teuthology.orchestra.run.smithi102.stdout:60129542180 2024-09-21T22:03:18.110 INFO:teuthology.orchestra.run.smithi102.stdout:55834574883 2024-09-21T22:03:18.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542180 for osd.6 2024-09-21T22:03:18.116 DEBUG:teuthology.parallel:result is None 2024-09-21T22:03:18.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574883 for osd.0 2024-09-21T22:03:18.123 DEBUG:teuthology.parallel:result is None 2024-09-21T22:03:18.920 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T22:03:19.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T22:03:19.009 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T22:03:19.025 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T22:03:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:60129542179 2024-09-21T22:03:19.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.2 2024-09-21T22:03:19.255 DEBUG:teuthology.parallel:result is None 2024-09-21T22:03:19.305 INFO:teuthology.orchestra.run.smithi102.stdout:60129542181 2024-09-21T22:03:19.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542181 got 60129542181 for osd.7 2024-09-21T22:03:19.318 DEBUG:teuthology.parallel:result is None 2024-09-21T22:03:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:60129542180 2024-09-21T22:03:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:60129542180 2024-09-21T22:03:19.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542180 for osd.4 2024-09-21T22:03:19.361 DEBUG:teuthology.parallel:result is None 2024-09-21T22:03:19.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542180 for osd.1 2024-09-21T22:03:19.367 DEBUG:teuthology.parallel:result is None 2024-09-21T22:03:19.367 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T22:03:19.367 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:03:19.681 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:03:19.682 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:03:19.694 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-09-21T22:03:19.028515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":110,"num_read":141156,"num_read_kb":761933,"num_write":21534,"num_write_kb":438517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1366,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18942,"ondisk_log_size":18942,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376920,"kb_used_data":14944,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754597800,"statfs":{"total":773094113280,"available":772708147200,"internally_reserved":0,"allocated":15302656,"data_stored":8474356,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":370462258},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.066373"},"pg_stats":[{"pgid":"3.1f","version":"140'425","reported_seq":2548,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140960+0000","last_change":"2024-09-21T22:02:56.873931+0000","last_active":"2024-09-21T22:03:15.140960+0000","last_peered":"2024-09-21T22:03:15.140960+0000","last_clean":"2024-09-21T22:03:15.140960+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:03:15.140960+0000","last_undegraded":"2024-09-21T22:03:15.140960+0000","last_fullsized":"2024-09-21T22:03:15.140960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:48:46.229881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842339999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3150,"num_read_kb":17993,"num_write":419,"num_write_kb":16614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"139'647","reported_seq":3149,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978817+0000","last_change":"2024-09-21T22:03:07.941715+0000","last_active":"2024-09-21T22:03:14.978817+0000","last_peered":"2024-09-21T22:03:14.978817+0000","last_clean":"2024-09-21T22:03:14.978817+0000","last_became_active":"2024-09-21T22:03:07.939807+0000","last_became_peered":"2024-09-21T22:03:07.939807+0000","last_unstale":"2024-09-21T22:03:14.978817+0000","last_undegraded":"2024-09-21T22:03:14.978817+0000","last_fullsized":"2024-09-21T22:03:14.978817+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:41:15.679849+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0059876790000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3617,"num_read_kb":17763,"num_write":805,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":5393987,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"140'1290","reported_seq":4549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979353+0000","last_change":"2024-09-21T22:02:56.880766+0000","last_active":"2024-09-21T22:03:14.979353+0000","last_peered":"2024-09-21T22:03:14.979353+0000","last_clean":"2024-09-21T22:03:14.979353+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:03:14.979353+0000","last_undegraded":"2024-09-21T22:03:14.979353+0000","last_fullsized":"2024-09-21T22:03:14.979353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:06:37.789236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020421839999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":9275,"num_read_kb":26039,"num_write":1594,"num_write_kb":17141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"140'539","reported_seq":6456,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142232+0000","last_change":"2024-09-21T22:02:56.893214+0000","last_active":"2024-09-21T22:03:15.142232+0000","last_peered":"2024-09-21T22:03:15.142232+0000","last_clean":"2024-09-21T22:03:15.142232+0000","last_became_active":"2024-09-21T22:02:27.724446+0000","last_became_peered":"2024-09-21T22:02:27.724446+0000","last_unstale":"2024-09-21T22:03:15.142232+0000","last_undegraded":"2024-09-21T22:03:15.142232+0000","last_fullsized":"2024-09-21T22:03:15.142232+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:24:18.215433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018963980000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":6312,"num_read_kb":34767,"num_write":622,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":4226464,"num_keys_recovered":52,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1b","version":"139'427","reported_seq":2493,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141358+0000","last_change":"2024-09-21T22:02:56.874277+0000","last_active":"2024-09-21T22:03:15.141358+0000","last_peered":"2024-09-21T22:03:15.141358+0000","last_clean":"2024-09-21T22:03:15.141358+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:03:15.141358+0000","last_undegraded":"2024-09-21T22:03:15.141358+0000","last_fullsized":"2024-09-21T22:03:15.141358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:15.061982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024247990000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2405,"num_read_kb":22208,"num_write":524,"num_write_kb":15129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"139'777","reported_seq":5986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141475+0000","last_change":"2024-09-21T22:02:56.872628+0000","last_active":"2024-09-21T22:03:15.141475+0000","last_peered":"2024-09-21T22:03:15.141475+0000","last_clean":"2024-09-21T22:03:15.141475+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:03:15.141475+0000","last_undegraded":"2024-09-21T22:03:15.141475+0000","last_fullsized":"2024-09-21T22:03:15.141475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:00:17.211762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086556399999999998,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9177,"num_read_kb":15032,"num_write":963,"num_write_kb":7279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"132'737","reported_seq":5383,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140929+0000","last_change":"2024-09-21T22:02:56.876587+0000","last_active":"2024-09-21T22:03:15.140929+0000","last_peered":"2024-09-21T22:03:15.140929+0000","last_clean":"2024-09-21T22:03:15.140929+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:03:15.140929+0000","last_undegraded":"2024-09-21T22:03:15.140929+0000","last_fullsized":"2024-09-21T22:03:15.140929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:39.590354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052006100000000005,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6528,"num_read_kb":21380,"num_write":923,"num_write_kb":11344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"139'420","reported_seq":3313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978553+0000","last_change":"2024-09-21T22:03:07.943880+0000","last_active":"2024-09-21T22:03:14.978553+0000","last_peered":"2024-09-21T22:03:14.978553+0000","last_clean":"2024-09-21T22:03:14.978553+0000","last_became_active":"2024-09-21T22:03:07.942754+0000","last_became_peered":"2024-09-21T22:03:07.942754+0000","last_unstale":"2024-09-21T22:03:14.978553+0000","last_undegraded":"2024-09-21T22:03:14.978553+0000","last_fullsized":"2024-09-21T22:03:14.978553+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:14:49.189417+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001417499,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3247,"num_read_kb":25203,"num_write":372,"num_write_kb":14568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"139'467","reported_seq":3606,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141060+0000","last_change":"2024-09-21T22:02:56.874306+0000","last_active":"2024-09-21T22:03:15.141060+0000","last_peered":"2024-09-21T22:03:15.141060+0000","last_clean":"2024-09-21T22:03:15.141060+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:03:15.141060+0000","last_undegraded":"2024-09-21T22:03:15.141060+0000","last_fullsized":"2024-09-21T22:03:15.141060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:00.084380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022694490000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4796,"num_read_kb":36988,"num_write":418,"num_write_kb":23161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"139'558","reported_seq":5502,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979246+0000","last_change":"2024-09-21T22:02:56.880020+0000","last_active":"2024-09-21T22:03:14.979246+0000","last_peered":"2024-09-21T22:03:14.979246+0000","last_clean":"2024-09-21T22:03:14.979246+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:03:14.979246+0000","last_undegraded":"2024-09-21T22:03:14.979246+0000","last_fullsized":"2024-09-21T22:03:14.979246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:33.890137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001422139,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5645,"num_read_kb":30705,"num_write":602,"num_write_kb":12146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"139'393","reported_seq":2422,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142448+0000","last_change":"2024-09-21T22:02:56.892611+0000","last_active":"2024-09-21T22:03:15.142448+0000","last_peered":"2024-09-21T22:03:15.142448+0000","last_clean":"2024-09-21T22:03:15.142448+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:03:15.142448+0000","last_undegraded":"2024-09-21T22:03:15.142448+0000","last_fullsized":"2024-09-21T22:03:15.142448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:06:05.808304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154411,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2451,"num_read_kb":16496,"num_write":423,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"138'482","reported_seq":2986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141495+0000","last_change":"2024-09-21T22:02:56.873157+0000","last_active":"2024-09-21T22:03:15.141495+0000","last_peered":"2024-09-21T22:03:15.141495+0000","last_clean":"2024-09-21T22:03:15.141495+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:03:15.141495+0000","last_undegraded":"2024-09-21T22:03:15.141495+0000","last_fullsized":"2024-09-21T22:03:15.141495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:41.327365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013256330000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3311,"num_read_kb":22849,"num_write":472,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141793+0000","last_change":"2024-09-21T22:02:58.886889+0000","last_active":"2024-09-21T22:03:15.141793+0000","last_peered":"2024-09-21T22:03:15.141793+0000","last_clean":"2024-09-21T22:03:15.141793+0000","last_became_active":"2024-09-21T22:02:58.886569+0000","last_became_peered":"2024-09-21T22:02:58.886569+0000","last_unstale":"2024-09-21T22:03:15.141793+0000","last_undegraded":"2024-09-21T22:03:15.141793+0000","last_fullsized":"2024-09-21T22:03:15.141793+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:25:13.011972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"140'669","reported_seq":3791,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140856+0000","last_change":"2024-09-21T22:02:56.872906+0000","last_active":"2024-09-21T22:03:15.140856+0000","last_peered":"2024-09-21T22:03:15.140856+0000","last_clean":"2024-09-21T22:03:15.140856+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:03:15.140856+0000","last_undegraded":"2024-09-21T22:03:15.140856+0000","last_fullsized":"2024-09-21T22:03:15.140856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:08:05.048385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014495230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4731,"num_read_kb":30235,"num_write":747,"num_write_kb":21390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141092+0000","last_change":"2024-09-21T22:03:03.795675+0000","last_active":"2024-09-21T22:03:15.141092+0000","last_peered":"2024-09-21T22:03:15.141092+0000","last_clean":"2024-09-21T22:03:15.141092+0000","last_became_active":"2024-09-21T22:03:03.795428+0000","last_became_peered":"2024-09-21T22:03:03.795428+0000","last_unstale":"2024-09-21T22:03:15.141092+0000","last_undegraded":"2024-09-21T22:03:15.141092+0000","last_fullsized":"2024-09-21T22:03:15.141092+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:17.673856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"139'427","reported_seq":2844,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978691+0000","last_change":"2024-09-21T22:03:07.938096+0000","last_active":"2024-09-21T22:03:14.978691+0000","last_peered":"2024-09-21T22:03:14.978691+0000","last_clean":"2024-09-21T22:03:14.978691+0000","last_became_active":"2024-09-21T22:03:07.937189+0000","last_became_peered":"2024-09-21T22:03:07.937189+0000","last_unstale":"2024-09-21T22:03:14.978691+0000","last_undegraded":"2024-09-21T22:03:14.978691+0000","last_fullsized":"2024-09-21T22:03:14.978691+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:53.667899+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001035935,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3573,"num_read_kb":18221,"num_write":381,"num_write_kb":12046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142304+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:03:15.142304+0000","last_peered":"2024-09-21T22:03:15.142304+0000","last_clean":"2024-09-21T22:03:15.142304+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:03:15.142304+0000","last_undegraded":"2024-09-21T22:03:15.142304+0000","last_fullsized":"2024-09-21T22:03:15.142304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"137'1229","reported_seq":6783,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141072+0000","last_change":"2024-09-21T22:03:03.738243+0000","last_active":"2024-09-21T22:03:15.141072+0000","last_peered":"2024-09-21T22:03:15.141072+0000","last_clean":"2024-09-21T22:03:15.141072+0000","last_became_active":"2024-09-21T22:03:03.736933+0000","last_became_peered":"2024-09-21T22:03:03.736933+0000","last_unstale":"2024-09-21T22:03:15.141072+0000","last_undegraded":"2024-09-21T22:03:15.141072+0000","last_fullsized":"2024-09-21T22:03:15.141072+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1229,"log_dups_size":0,"ondisk_log_size":1229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:42:15.915953+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00055570499999999998,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":11131,"num_read_kb":38962,"num_write":1701,"num_write_kb":13508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":2571463,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:03:04.524949+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:03:04.524729+0000","last_became_peered":"2024-09-21T22:03:04.524729+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:53:23.125596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"139'560","reported_seq":3448,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978853+0000","last_change":"2024-09-21T22:03:07.941051+0000","last_active":"2024-09-21T22:03:14.978853+0000","last_peered":"2024-09-21T22:03:14.978853+0000","last_clean":"2024-09-21T22:03:14.978853+0000","last_became_active":"2024-09-21T22:03:07.939773+0000","last_became_peered":"2024-09-21T22:03:07.939773+0000","last_unstale":"2024-09-21T22:03:14.978853+0000","last_undegraded":"2024-09-21T22:03:14.978853+0000","last_fullsized":"2024-09-21T22:03:14.978853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:16:26.184045+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079113100000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3777,"num_read_kb":20163,"num_write":683,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":6110205,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"140'648","reported_seq":3015,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141426+0000","last_change":"2024-09-21T22:02:56.873270+0000","last_active":"2024-09-21T22:03:15.141426+0000","last_peered":"2024-09-21T22:03:15.141426+0000","last_clean":"2024-09-21T22:03:15.141426+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:03:15.141426+0000","last_undegraded":"2024-09-21T22:03:15.141426+0000","last_fullsized":"2024-09-21T22:03:15.141426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:13:07.713841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013958779999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":2979,"num_read_kb":18860,"num_write":691,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":296,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979186+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:03:14.979186+0000","last_peered":"2024-09-21T22:03:14.979186+0000","last_clean":"2024-09-21T22:03:14.979186+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:03:14.979186+0000","last_undegraded":"2024-09-21T22:03:14.979186+0000","last_fullsized":"2024-09-21T22:03:14.979186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"139'382","reported_seq":2549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140990+0000","last_change":"2024-09-21T22:03:03.737358+0000","last_active":"2024-09-21T22:03:15.140990+0000","last_peered":"2024-09-21T22:03:15.140990+0000","last_clean":"2024-09-21T22:03:15.140990+0000","last_became_active":"2024-09-21T22:03:03.736151+0000","last_became_peered":"2024-09-21T22:03:03.736151+0000","last_unstale":"2024-09-21T22:03:15.140990+0000","last_undegraded":"2024-09-21T22:03:15.140990+0000","last_fullsized":"2024-09-21T22:03:15.140990+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:15:18.105335+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079671400000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":2522,"num_read_kb":15798,"num_write":339,"num_write_kb":10215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":1488605,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978247+0000","last_change":"2024-09-21T22:02:59.729883+0000","last_active":"2024-09-21T22:03:14.978247+0000","last_peered":"2024-09-21T22:03:14.978247+0000","last_clean":"2024-09-21T22:03:14.978247+0000","last_became_active":"2024-09-21T22:02:59.729555+0000","last_became_peered":"2024-09-21T22:02:59.729555+0000","last_unstale":"2024-09-21T22:03:14.978247+0000","last_undegraded":"2024-09-21T22:03:14.978247+0000","last_fullsized":"2024-09-21T22:03:14.978247+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:36:23.460064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"139'249","reported_seq":1737,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:02:56.872721+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:37:30.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013224700000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1014,"num_read_kb":21083,"num_write":213,"num_write_kb":9611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142085+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:03:15.142085+0000","last_peered":"2024-09-21T22:03:15.142085+0000","last_clean":"2024-09-21T22:03:15.142085+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:03:15.142085+0000","last_undegraded":"2024-09-21T22:03:15.142085+0000","last_fullsized":"2024-09-21T22:03:15.142085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"139'510","reported_seq":2654,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978715+0000","last_change":"2024-09-21T22:03:07.939621+0000","last_active":"2024-09-21T22:03:14.978715+0000","last_peered":"2024-09-21T22:03:14.978715+0000","last_clean":"2024-09-21T22:03:14.978715+0000","last_became_active":"2024-09-21T22:03:07.938172+0000","last_became_peered":"2024-09-21T22:03:07.938172+0000","last_unstale":"2024-09-21T22:03:14.978715+0000","last_undegraded":"2024-09-21T22:03:14.978715+0000","last_fullsized":"2024-09-21T22:03:14.978715+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:27:59.532011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077946799999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3658,"num_read_kb":17679,"num_write":432,"num_write_kb":10973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979215+0000","last_change":"2024-09-21T22:02:59.738182+0000","last_active":"2024-09-21T22:03:14.979215+0000","last_peered":"2024-09-21T22:03:14.979215+0000","last_clean":"2024-09-21T22:03:14.979215+0000","last_became_active":"2024-09-21T22:02:59.735519+0000","last_became_peered":"2024-09-21T22:02:59.735519+0000","last_unstale":"2024-09-21T22:03:14.979215+0000","last_undegraded":"2024-09-21T22:03:14.979215+0000","last_fullsized":"2024-09-21T22:03:14.979215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:19.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":445,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142117+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:03:15.142117+0000","last_peered":"2024-09-21T22:03:15.142117+0000","last_clean":"2024-09-21T22:03:15.142117+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:03:15.142117+0000","last_undegraded":"2024-09-21T22:03:15.142117+0000","last_fullsized":"2024-09-21T22:03:15.142117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"140'707","reported_seq":7393,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978567+0000","last_change":"2024-09-21T22:02:56.935303+0000","last_active":"2024-09-21T22:03:14.978567+0000","last_peered":"2024-09-21T22:03:14.978567+0000","last_clean":"2024-09-21T22:03:14.978567+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:03:14.978567+0000","last_undegraded":"2024-09-21T22:03:14.978567+0000","last_fullsized":"2024-09-21T22:03:14.978567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:33:00.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043807600000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":8848,"num_read_kb":26906,"num_write":745,"num_write_kb":11566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"139'572","reported_seq":4507,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141395+0000","last_change":"2024-09-21T22:03:02.734471+0000","last_active":"2024-09-21T22:03:15.141395+0000","last_peered":"2024-09-21T22:03:15.141395+0000","last_clean":"2024-09-21T22:03:15.141395+0000","last_became_active":"2024-09-21T22:03:02.733121+0000","last_became_peered":"2024-09-21T22:03:02.733121+0000","last_unstale":"2024-09-21T22:03:15.141395+0000","last_undegraded":"2024-09-21T22:03:15.141395+0000","last_fullsized":"2024-09-21T22:03:15.141395+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:19:14.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001727063,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":5483,"num_read_kb":33605,"num_write":573,"num_write_kb":16665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":3573432,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"140'554","reported_seq":2135,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.731202+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.729474+0000","last_became_peered":"2024-09-21T22:03:01.729474+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:08.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":3106,"num_read_kb":9483,"num_write":540,"num_write_kb":9066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"139'329","reported_seq":1878,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978627+0000","last_change":"2024-09-21T22:03:07.944339+0000","last_active":"2024-09-21T22:03:14.978627+0000","last_peered":"2024-09-21T22:03:14.978627+0000","last_clean":"2024-09-21T22:03:14.978627+0000","last_became_active":"2024-09-21T22:03:07.943220+0000","last_became_peered":"2024-09-21T22:03:07.943220+0000","last_unstale":"2024-09-21T22:03:14.978627+0000","last_undegraded":"2024-09-21T22:03:14.978627+0000","last_fullsized":"2024-09-21T22:03:14.978627+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:51.424190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081105489999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":1262,"num_read_kb":20198,"num_write":335,"num_write_kb":15448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"139'886","reported_seq":3512,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979195+0000","last_change":"2024-09-21T22:02:56.879719+0000","last_active":"2024-09-21T22:03:14.979195+0000","last_peered":"2024-09-21T22:03:14.979195+0000","last_clean":"2024-09-21T22:03:14.979195+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:03:14.979195+0000","last_undegraded":"2024-09-21T22:03:14.979195+0000","last_fullsized":"2024-09-21T22:03:14.979195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:18.500573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012138979999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4783,"num_read_kb":25125,"num_write":1089,"num_write_kb":15165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"139'330","reported_seq":4647,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142154+0000","last_change":"2024-09-21T22:02:56.892713+0000","last_active":"2024-09-21T22:03:15.142154+0000","last_peered":"2024-09-21T22:03:15.142154+0000","last_clean":"2024-09-21T22:03:15.142154+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:03:15.142154+0000","last_undegraded":"2024-09-21T22:03:15.142154+0000","last_fullsized":"2024-09-21T22:03:15.142154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:28.659826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016441019999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4476,"num_read_kb":19373,"num_write":277,"num_write_kb":6594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"138'786","reported_seq":2824,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142251+0000","last_change":"2024-09-21T22:02:56.891670+0000","last_active":"2024-09-21T22:03:15.142251+0000","last_peered":"2024-09-21T22:03:15.142251+0000","last_clean":"2024-09-21T22:03:15.142251+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:03:15.142251+0000","last_undegraded":"2024-09-21T22:03:15.142251+0000","last_fullsized":"2024-09-21T22:03:15.142251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:25:22.367301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070171700000000003,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4744,"num_read_kb":15768,"num_write":1138,"num_write_kb":6705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"138'909","reported_seq":2818,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142240+0000","last_change":"2024-09-21T22:02:56.892228+0000","last_active":"2024-09-21T22:03:15.142240+0000","last_peered":"2024-09-21T22:03:15.142240+0000","last_clean":"2024-09-21T22:03:15.142240+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:03:15.142240+0000","last_undegraded":"2024-09-21T22:03:15.142240+0000","last_fullsized":"2024-09-21T22:03:15.142240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:11.574320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562649999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4141,"num_read_kb":17774,"num_write":1199,"num_write_kb":13706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"139'302","reported_seq":1403,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.732935+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.731443+0000","last_became_peered":"2024-09-21T22:03:01.731443+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:06:01.781845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094293999999999997,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":784,"num_read_kb":16089,"num_write":270,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"139'769","reported_seq":3586,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142196+0000","last_change":"2024-09-21T22:02:56.891713+0000","last_active":"2024-09-21T22:03:15.142196+0000","last_peered":"2024-09-21T22:03:15.142196+0000","last_clean":"2024-09-21T22:03:15.142196+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:03:15.142196+0000","last_undegraded":"2024-09-21T22:03:15.142196+0000","last_fullsized":"2024-09-21T22:03:15.142196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:26.547168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071737500000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4762,"num_read_kb":48263,"num_write":1037,"num_write_kb":22105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"138'483","reported_seq":2394,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140920+0000","last_change":"2024-09-21T22:02:56.873784+0000","last_active":"2024-09-21T22:03:15.140920+0000","last_peered":"2024-09-21T22:03:15.140920+0000","last_clean":"2024-09-21T22:03:15.140920+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:03:15.140920+0000","last_undegraded":"2024-09-21T22:03:15.140920+0000","last_fullsized":"2024-09-21T22:03:15.140920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:09:19.068419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020803319999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2714,"num_read_kb":25997,"num_write":557,"num_write_kb":11325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"138'359","reported_seq":3012,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142234+0000","last_change":"2024-09-21T22:02:56.892151+0000","last_active":"2024-09-21T22:03:15.142234+0000","last_peered":"2024-09-21T22:03:15.142234+0000","last_clean":"2024-09-21T22:03:15.142234+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:03:15.142234+0000","last_undegraded":"2024-09-21T22:03:15.142234+0000","last_fullsized":"2024-09-21T22:03:15.142234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:42:48.152578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835350000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2638,"num_read_kb":34828,"num_write":289,"num_write_kb":13167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":110,"num_read":141040,"num_read_kb":761833,"num_write":21373,"num_write_kb":436099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1364,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18822,"ondisk_log_size":18822,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55260,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316580,"statfs":{"total":96636764160,"available":96580177920,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55248,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316592,"statfs":{"total":96636764160,"available":96580190208,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28884,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342956,"statfs":{"total":96636764160,"available":96607186944,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51096,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320744,"statfs":{"total":96636764160,"available":96584441856,"internally_reserved":0,"allocated":1904640,"data_stored":911731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33096,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338744,"statfs":{"total":96636764160,"available":96602873856,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:03:19.695 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:03:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:03:19.972 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:03:19.983 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-09-21T22:03:19.028515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":110,"num_read":141156,"num_read_kb":761933,"num_write":21534,"num_write_kb":438517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1366,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18942,"ondisk_log_size":18942,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376920,"kb_used_data":14944,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754597800,"statfs":{"total":773094113280,"available":772708147200,"internally_reserved":0,"allocated":15302656,"data_stored":8474356,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":370462258},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.066373"},"pg_stats":[{"pgid":"3.1f","version":"140'425","reported_seq":2548,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140960+0000","last_change":"2024-09-21T22:02:56.873931+0000","last_active":"2024-09-21T22:03:15.140960+0000","last_peered":"2024-09-21T22:03:15.140960+0000","last_clean":"2024-09-21T22:03:15.140960+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:03:15.140960+0000","last_undegraded":"2024-09-21T22:03:15.140960+0000","last_fullsized":"2024-09-21T22:03:15.140960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:48:46.229881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842339999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3150,"num_read_kb":17993,"num_write":419,"num_write_kb":16614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"139'647","reported_seq":3149,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978817+0000","last_change":"2024-09-21T22:03:07.941715+0000","last_active":"2024-09-21T22:03:14.978817+0000","last_peered":"2024-09-21T22:03:14.978817+0000","last_clean":"2024-09-21T22:03:14.978817+0000","last_became_active":"2024-09-21T22:03:07.939807+0000","last_became_peered":"2024-09-21T22:03:07.939807+0000","last_unstale":"2024-09-21T22:03:14.978817+0000","last_undegraded":"2024-09-21T22:03:14.978817+0000","last_fullsized":"2024-09-21T22:03:14.978817+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:41:15.679849+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0059876790000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3617,"num_read_kb":17763,"num_write":805,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":5393987,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"140'1290","reported_seq":4549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979353+0000","last_change":"2024-09-21T22:02:56.880766+0000","last_active":"2024-09-21T22:03:14.979353+0000","last_peered":"2024-09-21T22:03:14.979353+0000","last_clean":"2024-09-21T22:03:14.979353+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:03:14.979353+0000","last_undegraded":"2024-09-21T22:03:14.979353+0000","last_fullsized":"2024-09-21T22:03:14.979353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:06:37.789236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020421839999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":9275,"num_read_kb":26039,"num_write":1594,"num_write_kb":17141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"140'539","reported_seq":6456,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142232+0000","last_change":"2024-09-21T22:02:56.893214+0000","last_active":"2024-09-21T22:03:15.142232+0000","last_peered":"2024-09-21T22:03:15.142232+0000","last_clean":"2024-09-21T22:03:15.142232+0000","last_became_active":"2024-09-21T22:02:27.724446+0000","last_became_peered":"2024-09-21T22:02:27.724446+0000","last_unstale":"2024-09-21T22:03:15.142232+0000","last_undegraded":"2024-09-21T22:03:15.142232+0000","last_fullsized":"2024-09-21T22:03:15.142232+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:24:18.215433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018963980000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":6312,"num_read_kb":34767,"num_write":622,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":4226464,"num_keys_recovered":52,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1b","version":"139'427","reported_seq":2493,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141358+0000","last_change":"2024-09-21T22:02:56.874277+0000","last_active":"2024-09-21T22:03:15.141358+0000","last_peered":"2024-09-21T22:03:15.141358+0000","last_clean":"2024-09-21T22:03:15.141358+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:03:15.141358+0000","last_undegraded":"2024-09-21T22:03:15.141358+0000","last_fullsized":"2024-09-21T22:03:15.141358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:15.061982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024247990000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2405,"num_read_kb":22208,"num_write":524,"num_write_kb":15129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"139'777","reported_seq":5986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141475+0000","last_change":"2024-09-21T22:02:56.872628+0000","last_active":"2024-09-21T22:03:15.141475+0000","last_peered":"2024-09-21T22:03:15.141475+0000","last_clean":"2024-09-21T22:03:15.141475+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:03:15.141475+0000","last_undegraded":"2024-09-21T22:03:15.141475+0000","last_fullsized":"2024-09-21T22:03:15.141475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:00:17.211762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086556399999999998,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9177,"num_read_kb":15032,"num_write":963,"num_write_kb":7279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"132'737","reported_seq":5383,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140929+0000","last_change":"2024-09-21T22:02:56.876587+0000","last_active":"2024-09-21T22:03:15.140929+0000","last_peered":"2024-09-21T22:03:15.140929+0000","last_clean":"2024-09-21T22:03:15.140929+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:03:15.140929+0000","last_undegraded":"2024-09-21T22:03:15.140929+0000","last_fullsized":"2024-09-21T22:03:15.140929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:39.590354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052006100000000005,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6528,"num_read_kb":21380,"num_write":923,"num_write_kb":11344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"139'420","reported_seq":3313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978553+0000","last_change":"2024-09-21T22:03:07.943880+0000","last_active":"2024-09-21T22:03:14.978553+0000","last_peered":"2024-09-21T22:03:14.978553+0000","last_clean":"2024-09-21T22:03:14.978553+0000","last_became_active":"2024-09-21T22:03:07.942754+0000","last_became_peered":"2024-09-21T22:03:07.942754+0000","last_unstale":"2024-09-21T22:03:14.978553+0000","last_undegraded":"2024-09-21T22:03:14.978553+0000","last_fullsized":"2024-09-21T22:03:14.978553+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:14:49.189417+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001417499,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3247,"num_read_kb":25203,"num_write":372,"num_write_kb":14568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"139'467","reported_seq":3606,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141060+0000","last_change":"2024-09-21T22:02:56.874306+0000","last_active":"2024-09-21T22:03:15.141060+0000","last_peered":"2024-09-21T22:03:15.141060+0000","last_clean":"2024-09-21T22:03:15.141060+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:03:15.141060+0000","last_undegraded":"2024-09-21T22:03:15.141060+0000","last_fullsized":"2024-09-21T22:03:15.141060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:00.084380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022694490000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4796,"num_read_kb":36988,"num_write":418,"num_write_kb":23161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"139'558","reported_seq":5502,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979246+0000","last_change":"2024-09-21T22:02:56.880020+0000","last_active":"2024-09-21T22:03:14.979246+0000","last_peered":"2024-09-21T22:03:14.979246+0000","last_clean":"2024-09-21T22:03:14.979246+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:03:14.979246+0000","last_undegraded":"2024-09-21T22:03:14.979246+0000","last_fullsized":"2024-09-21T22:03:14.979246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:33.890137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001422139,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5645,"num_read_kb":30705,"num_write":602,"num_write_kb":12146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"139'393","reported_seq":2422,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142448+0000","last_change":"2024-09-21T22:02:56.892611+0000","last_active":"2024-09-21T22:03:15.142448+0000","last_peered":"2024-09-21T22:03:15.142448+0000","last_clean":"2024-09-21T22:03:15.142448+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:03:15.142448+0000","last_undegraded":"2024-09-21T22:03:15.142448+0000","last_fullsized":"2024-09-21T22:03:15.142448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:06:05.808304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154411,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2451,"num_read_kb":16496,"num_write":423,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"138'482","reported_seq":2986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141495+0000","last_change":"2024-09-21T22:02:56.873157+0000","last_active":"2024-09-21T22:03:15.141495+0000","last_peered":"2024-09-21T22:03:15.141495+0000","last_clean":"2024-09-21T22:03:15.141495+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:03:15.141495+0000","last_undegraded":"2024-09-21T22:03:15.141495+0000","last_fullsized":"2024-09-21T22:03:15.141495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:41.327365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013256330000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3311,"num_read_kb":22849,"num_write":472,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141793+0000","last_change":"2024-09-21T22:02:58.886889+0000","last_active":"2024-09-21T22:03:15.141793+0000","last_peered":"2024-09-21T22:03:15.141793+0000","last_clean":"2024-09-21T22:03:15.141793+0000","last_became_active":"2024-09-21T22:02:58.886569+0000","last_became_peered":"2024-09-21T22:02:58.886569+0000","last_unstale":"2024-09-21T22:03:15.141793+0000","last_undegraded":"2024-09-21T22:03:15.141793+0000","last_fullsized":"2024-09-21T22:03:15.141793+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:25:13.011972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"140'669","reported_seq":3791,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140856+0000","last_change":"2024-09-21T22:02:56.872906+0000","last_active":"2024-09-21T22:03:15.140856+0000","last_peered":"2024-09-21T22:03:15.140856+0000","last_clean":"2024-09-21T22:03:15.140856+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:03:15.140856+0000","last_undegraded":"2024-09-21T22:03:15.140856+0000","last_fullsized":"2024-09-21T22:03:15.140856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:08:05.048385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014495230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4731,"num_read_kb":30235,"num_write":747,"num_write_kb":21390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141092+0000","last_change":"2024-09-21T22:03:03.795675+0000","last_active":"2024-09-21T22:03:15.141092+0000","last_peered":"2024-09-21T22:03:15.141092+0000","last_clean":"2024-09-21T22:03:15.141092+0000","last_became_active":"2024-09-21T22:03:03.795428+0000","last_became_peered":"2024-09-21T22:03:03.795428+0000","last_unstale":"2024-09-21T22:03:15.141092+0000","last_undegraded":"2024-09-21T22:03:15.141092+0000","last_fullsized":"2024-09-21T22:03:15.141092+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:17.673856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"139'427","reported_seq":2844,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978691+0000","last_change":"2024-09-21T22:03:07.938096+0000","last_active":"2024-09-21T22:03:14.978691+0000","last_peered":"2024-09-21T22:03:14.978691+0000","last_clean":"2024-09-21T22:03:14.978691+0000","last_became_active":"2024-09-21T22:03:07.937189+0000","last_became_peered":"2024-09-21T22:03:07.937189+0000","last_unstale":"2024-09-21T22:03:14.978691+0000","last_undegraded":"2024-09-21T22:03:14.978691+0000","last_fullsized":"2024-09-21T22:03:14.978691+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:53.667899+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001035935,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3573,"num_read_kb":18221,"num_write":381,"num_write_kb":12046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142304+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:03:15.142304+0000","last_peered":"2024-09-21T22:03:15.142304+0000","last_clean":"2024-09-21T22:03:15.142304+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:03:15.142304+0000","last_undegraded":"2024-09-21T22:03:15.142304+0000","last_fullsized":"2024-09-21T22:03:15.142304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"137'1229","reported_seq":6783,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141072+0000","last_change":"2024-09-21T22:03:03.738243+0000","last_active":"2024-09-21T22:03:15.141072+0000","last_peered":"2024-09-21T22:03:15.141072+0000","last_clean":"2024-09-21T22:03:15.141072+0000","last_became_active":"2024-09-21T22:03:03.736933+0000","last_became_peered":"2024-09-21T22:03:03.736933+0000","last_unstale":"2024-09-21T22:03:15.141072+0000","last_undegraded":"2024-09-21T22:03:15.141072+0000","last_fullsized":"2024-09-21T22:03:15.141072+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1229,"log_dups_size":0,"ondisk_log_size":1229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:42:15.915953+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00055570499999999998,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":11131,"num_read_kb":38962,"num_write":1701,"num_write_kb":13508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":2571463,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:03:04.524949+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:03:04.524729+0000","last_became_peered":"2024-09-21T22:03:04.524729+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:53:23.125596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"139'560","reported_seq":3448,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978853+0000","last_change":"2024-09-21T22:03:07.941051+0000","last_active":"2024-09-21T22:03:14.978853+0000","last_peered":"2024-09-21T22:03:14.978853+0000","last_clean":"2024-09-21T22:03:14.978853+0000","last_became_active":"2024-09-21T22:03:07.939773+0000","last_became_peered":"2024-09-21T22:03:07.939773+0000","last_unstale":"2024-09-21T22:03:14.978853+0000","last_undegraded":"2024-09-21T22:03:14.978853+0000","last_fullsized":"2024-09-21T22:03:14.978853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:16:26.184045+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079113100000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3777,"num_read_kb":20163,"num_write":683,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":6110205,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"140'648","reported_seq":3015,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141426+0000","last_change":"2024-09-21T22:02:56.873270+0000","last_active":"2024-09-21T22:03:15.141426+0000","last_peered":"2024-09-21T22:03:15.141426+0000","last_clean":"2024-09-21T22:03:15.141426+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:03:15.141426+0000","last_undegraded":"2024-09-21T22:03:15.141426+0000","last_fullsized":"2024-09-21T22:03:15.141426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:13:07.713841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013958779999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":2979,"num_read_kb":18860,"num_write":691,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":296,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979186+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:03:14.979186+0000","last_peered":"2024-09-21T22:03:14.979186+0000","last_clean":"2024-09-21T22:03:14.979186+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:03:14.979186+0000","last_undegraded":"2024-09-21T22:03:14.979186+0000","last_fullsized":"2024-09-21T22:03:14.979186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"139'382","reported_seq":2549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140990+0000","last_change":"2024-09-21T22:03:03.737358+0000","last_active":"2024-09-21T22:03:15.140990+0000","last_peered":"2024-09-21T22:03:15.140990+0000","last_clean":"2024-09-21T22:03:15.140990+0000","last_became_active":"2024-09-21T22:03:03.736151+0000","last_became_peered":"2024-09-21T22:03:03.736151+0000","last_unstale":"2024-09-21T22:03:15.140990+0000","last_undegraded":"2024-09-21T22:03:15.140990+0000","last_fullsized":"2024-09-21T22:03:15.140990+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:15:18.105335+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079671400000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":2522,"num_read_kb":15798,"num_write":339,"num_write_kb":10215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":1488605,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978247+0000","last_change":"2024-09-21T22:02:59.729883+0000","last_active":"2024-09-21T22:03:14.978247+0000","last_peered":"2024-09-21T22:03:14.978247+0000","last_clean":"2024-09-21T22:03:14.978247+0000","last_became_active":"2024-09-21T22:02:59.729555+0000","last_became_peered":"2024-09-21T22:02:59.729555+0000","last_unstale":"2024-09-21T22:03:14.978247+0000","last_undegraded":"2024-09-21T22:03:14.978247+0000","last_fullsized":"2024-09-21T22:03:14.978247+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:36:23.460064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"139'249","reported_seq":1737,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:02:56.872721+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:37:30.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013224700000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1014,"num_read_kb":21083,"num_write":213,"num_write_kb":9611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142085+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:03:15.142085+0000","last_peered":"2024-09-21T22:03:15.142085+0000","last_clean":"2024-09-21T22:03:15.142085+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:03:15.142085+0000","last_undegraded":"2024-09-21T22:03:15.142085+0000","last_fullsized":"2024-09-21T22:03:15.142085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"139'510","reported_seq":2654,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978715+0000","last_change":"2024-09-21T22:03:07.939621+0000","last_active":"2024-09-21T22:03:14.978715+0000","last_peered":"2024-09-21T22:03:14.978715+0000","last_clean":"2024-09-21T22:03:14.978715+0000","last_became_active":"2024-09-21T22:03:07.938172+0000","last_became_peered":"2024-09-21T22:03:07.938172+0000","last_unstale":"2024-09-21T22:03:14.978715+0000","last_undegraded":"2024-09-21T22:03:14.978715+0000","last_fullsized":"2024-09-21T22:03:14.978715+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:27:59.532011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077946799999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3658,"num_read_kb":17679,"num_write":432,"num_write_kb":10973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979215+0000","last_change":"2024-09-21T22:02:59.738182+0000","last_active":"2024-09-21T22:03:14.979215+0000","last_peered":"2024-09-21T22:03:14.979215+0000","last_clean":"2024-09-21T22:03:14.979215+0000","last_became_active":"2024-09-21T22:02:59.735519+0000","last_became_peered":"2024-09-21T22:02:59.735519+0000","last_unstale":"2024-09-21T22:03:14.979215+0000","last_undegraded":"2024-09-21T22:03:14.979215+0000","last_fullsized":"2024-09-21T22:03:14.979215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:19.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":445,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142117+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:03:15.142117+0000","last_peered":"2024-09-21T22:03:15.142117+0000","last_clean":"2024-09-21T22:03:15.142117+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:03:15.142117+0000","last_undegraded":"2024-09-21T22:03:15.142117+0000","last_fullsized":"2024-09-21T22:03:15.142117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"140'707","reported_seq":7393,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978567+0000","last_change":"2024-09-21T22:02:56.935303+0000","last_active":"2024-09-21T22:03:14.978567+0000","last_peered":"2024-09-21T22:03:14.978567+0000","last_clean":"2024-09-21T22:03:14.978567+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:03:14.978567+0000","last_undegraded":"2024-09-21T22:03:14.978567+0000","last_fullsized":"2024-09-21T22:03:14.978567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:33:00.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043807600000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":8848,"num_read_kb":26906,"num_write":745,"num_write_kb":11566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"139'572","reported_seq":4507,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141395+0000","last_change":"2024-09-21T22:03:02.734471+0000","last_active":"2024-09-21T22:03:15.141395+0000","last_peered":"2024-09-21T22:03:15.141395+0000","last_clean":"2024-09-21T22:03:15.141395+0000","last_became_active":"2024-09-21T22:03:02.733121+0000","last_became_peered":"2024-09-21T22:03:02.733121+0000","last_unstale":"2024-09-21T22:03:15.141395+0000","last_undegraded":"2024-09-21T22:03:15.141395+0000","last_fullsized":"2024-09-21T22:03:15.141395+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:19:14.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001727063,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":5483,"num_read_kb":33605,"num_write":573,"num_write_kb":16665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":3573432,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"140'554","reported_seq":2135,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.731202+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.729474+0000","last_became_peered":"2024-09-21T22:03:01.729474+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:08.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":3106,"num_read_kb":9483,"num_write":540,"num_write_kb":9066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"139'329","reported_seq":1878,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978627+0000","last_change":"2024-09-21T22:03:07.944339+0000","last_active":"2024-09-21T22:03:14.978627+0000","last_peered":"2024-09-21T22:03:14.978627+0000","last_clean":"2024-09-21T22:03:14.978627+0000","last_became_active":"2024-09-21T22:03:07.943220+0000","last_became_peered":"2024-09-21T22:03:07.943220+0000","last_unstale":"2024-09-21T22:03:14.978627+0000","last_undegraded":"2024-09-21T22:03:14.978627+0000","last_fullsized":"2024-09-21T22:03:14.978627+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:51.424190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081105489999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":1262,"num_read_kb":20198,"num_write":335,"num_write_kb":15448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"139'886","reported_seq":3512,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979195+0000","last_change":"2024-09-21T22:02:56.879719+0000","last_active":"2024-09-21T22:03:14.979195+0000","last_peered":"2024-09-21T22:03:14.979195+0000","last_clean":"2024-09-21T22:03:14.979195+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:03:14.979195+0000","last_undegraded":"2024-09-21T22:03:14.979195+0000","last_fullsized":"2024-09-21T22:03:14.979195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:18.500573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012138979999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4783,"num_read_kb":25125,"num_write":1089,"num_write_kb":15165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"139'330","reported_seq":4647,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142154+0000","last_change":"2024-09-21T22:02:56.892713+0000","last_active":"2024-09-21T22:03:15.142154+0000","last_peered":"2024-09-21T22:03:15.142154+0000","last_clean":"2024-09-21T22:03:15.142154+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:03:15.142154+0000","last_undegraded":"2024-09-21T22:03:15.142154+0000","last_fullsized":"2024-09-21T22:03:15.142154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:28.659826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016441019999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4476,"num_read_kb":19373,"num_write":277,"num_write_kb":6594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"138'786","reported_seq":2824,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142251+0000","last_change":"2024-09-21T22:02:56.891670+0000","last_active":"2024-09-21T22:03:15.142251+0000","last_peered":"2024-09-21T22:03:15.142251+0000","last_clean":"2024-09-21T22:03:15.142251+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:03:15.142251+0000","last_undegraded":"2024-09-21T22:03:15.142251+0000","last_fullsized":"2024-09-21T22:03:15.142251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:25:22.367301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070171700000000003,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4744,"num_read_kb":15768,"num_write":1138,"num_write_kb":6705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"138'909","reported_seq":2818,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142240+0000","last_change":"2024-09-21T22:02:56.892228+0000","last_active":"2024-09-21T22:03:15.142240+0000","last_peered":"2024-09-21T22:03:15.142240+0000","last_clean":"2024-09-21T22:03:15.142240+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:03:15.142240+0000","last_undegraded":"2024-09-21T22:03:15.142240+0000","last_fullsized":"2024-09-21T22:03:15.142240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:11.574320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562649999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4141,"num_read_kb":17774,"num_write":1199,"num_write_kb":13706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"139'302","reported_seq":1403,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.732935+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.731443+0000","last_became_peered":"2024-09-21T22:03:01.731443+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:06:01.781845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094293999999999997,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":784,"num_read_kb":16089,"num_write":270,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"139'769","reported_seq":3586,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142196+0000","last_change":"2024-09-21T22:02:56.891713+0000","last_active":"2024-09-21T22:03:15.142196+0000","last_peered":"2024-09-21T22:03:15.142196+0000","last_clean":"2024-09-21T22:03:15.142196+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:03:15.142196+0000","last_undegraded":"2024-09-21T22:03:15.142196+0000","last_fullsized":"2024-09-21T22:03:15.142196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:26.547168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071737500000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4762,"num_read_kb":48263,"num_write":1037,"num_write_kb":22105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"138'483","reported_seq":2394,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140920+0000","last_change":"2024-09-21T22:02:56.873784+0000","last_active":"2024-09-21T22:03:15.140920+0000","last_peered":"2024-09-21T22:03:15.140920+0000","last_clean":"2024-09-21T22:03:15.140920+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:03:15.140920+0000","last_undegraded":"2024-09-21T22:03:15.140920+0000","last_fullsized":"2024-09-21T22:03:15.140920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:09:19.068419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020803319999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2714,"num_read_kb":25997,"num_write":557,"num_write_kb":11325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"138'359","reported_seq":3012,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142234+0000","last_change":"2024-09-21T22:02:56.892151+0000","last_active":"2024-09-21T22:03:15.142234+0000","last_peered":"2024-09-21T22:03:15.142234+0000","last_clean":"2024-09-21T22:03:15.142234+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:03:15.142234+0000","last_undegraded":"2024-09-21T22:03:15.142234+0000","last_fullsized":"2024-09-21T22:03:15.142234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:42:48.152578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835350000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2638,"num_read_kb":34828,"num_write":289,"num_write_kb":13167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":110,"num_read":141040,"num_read_kb":761833,"num_write":21373,"num_write_kb":436099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1364,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18822,"ondisk_log_size":18822,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55260,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316580,"statfs":{"total":96636764160,"available":96580177920,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55248,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316592,"statfs":{"total":96636764160,"available":96580190208,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28884,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342956,"statfs":{"total":96636764160,"available":96607186944,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51096,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320744,"statfs":{"total":96636764160,"available":96584441856,"internally_reserved":0,"allocated":1904640,"data_stored":911731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33096,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338744,"statfs":{"total":96636764160,"available":96602873856,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:03:19.985 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T22:03:19.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-21T22:03:20.281 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T22:03:20.289 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T22:03:20.289 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:03:20.568 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:03:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:03:20.580 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-09-21T22:03:19.028515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":110,"num_read":141156,"num_read_kb":761933,"num_write":21534,"num_write_kb":438517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1366,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18942,"ondisk_log_size":18942,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376920,"kb_used_data":14944,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754597800,"statfs":{"total":773094113280,"available":772708147200,"internally_reserved":0,"allocated":15302656,"data_stored":8474356,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":370462258},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.066373"},"pg_stats":[{"pgid":"3.1f","version":"140'425","reported_seq":2548,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140960+0000","last_change":"2024-09-21T22:02:56.873931+0000","last_active":"2024-09-21T22:03:15.140960+0000","last_peered":"2024-09-21T22:03:15.140960+0000","last_clean":"2024-09-21T22:03:15.140960+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:03:15.140960+0000","last_undegraded":"2024-09-21T22:03:15.140960+0000","last_fullsized":"2024-09-21T22:03:15.140960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:48:46.229881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842339999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3150,"num_read_kb":17993,"num_write":419,"num_write_kb":16614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"139'647","reported_seq":3149,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978817+0000","last_change":"2024-09-21T22:03:07.941715+0000","last_active":"2024-09-21T22:03:14.978817+0000","last_peered":"2024-09-21T22:03:14.978817+0000","last_clean":"2024-09-21T22:03:14.978817+0000","last_became_active":"2024-09-21T22:03:07.939807+0000","last_became_peered":"2024-09-21T22:03:07.939807+0000","last_unstale":"2024-09-21T22:03:14.978817+0000","last_undegraded":"2024-09-21T22:03:14.978817+0000","last_fullsized":"2024-09-21T22:03:14.978817+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:41:15.679849+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0059876790000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3617,"num_read_kb":17763,"num_write":805,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":5393987,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"140'1290","reported_seq":4549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979353+0000","last_change":"2024-09-21T22:02:56.880766+0000","last_active":"2024-09-21T22:03:14.979353+0000","last_peered":"2024-09-21T22:03:14.979353+0000","last_clean":"2024-09-21T22:03:14.979353+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:03:14.979353+0000","last_undegraded":"2024-09-21T22:03:14.979353+0000","last_fullsized":"2024-09-21T22:03:14.979353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:06:37.789236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020421839999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":9275,"num_read_kb":26039,"num_write":1594,"num_write_kb":17141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"140'539","reported_seq":6456,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142232+0000","last_change":"2024-09-21T22:02:56.893214+0000","last_active":"2024-09-21T22:03:15.142232+0000","last_peered":"2024-09-21T22:03:15.142232+0000","last_clean":"2024-09-21T22:03:15.142232+0000","last_became_active":"2024-09-21T22:02:27.724446+0000","last_became_peered":"2024-09-21T22:02:27.724446+0000","last_unstale":"2024-09-21T22:03:15.142232+0000","last_undegraded":"2024-09-21T22:03:15.142232+0000","last_fullsized":"2024-09-21T22:03:15.142232+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:24:18.215433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018963980000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":6312,"num_read_kb":34767,"num_write":622,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":4226464,"num_keys_recovered":52,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1b","version":"139'427","reported_seq":2493,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141358+0000","last_change":"2024-09-21T22:02:56.874277+0000","last_active":"2024-09-21T22:03:15.141358+0000","last_peered":"2024-09-21T22:03:15.141358+0000","last_clean":"2024-09-21T22:03:15.141358+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:03:15.141358+0000","last_undegraded":"2024-09-21T22:03:15.141358+0000","last_fullsized":"2024-09-21T22:03:15.141358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:15.061982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024247990000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2405,"num_read_kb":22208,"num_write":524,"num_write_kb":15129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"139'777","reported_seq":5986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141475+0000","last_change":"2024-09-21T22:02:56.872628+0000","last_active":"2024-09-21T22:03:15.141475+0000","last_peered":"2024-09-21T22:03:15.141475+0000","last_clean":"2024-09-21T22:03:15.141475+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:03:15.141475+0000","last_undegraded":"2024-09-21T22:03:15.141475+0000","last_fullsized":"2024-09-21T22:03:15.141475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:00:17.211762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086556399999999998,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9177,"num_read_kb":15032,"num_write":963,"num_write_kb":7279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"132'737","reported_seq":5383,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140929+0000","last_change":"2024-09-21T22:02:56.876587+0000","last_active":"2024-09-21T22:03:15.140929+0000","last_peered":"2024-09-21T22:03:15.140929+0000","last_clean":"2024-09-21T22:03:15.140929+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:03:15.140929+0000","last_undegraded":"2024-09-21T22:03:15.140929+0000","last_fullsized":"2024-09-21T22:03:15.140929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:39.590354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052006100000000005,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6528,"num_read_kb":21380,"num_write":923,"num_write_kb":11344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"139'420","reported_seq":3313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978553+0000","last_change":"2024-09-21T22:03:07.943880+0000","last_active":"2024-09-21T22:03:14.978553+0000","last_peered":"2024-09-21T22:03:14.978553+0000","last_clean":"2024-09-21T22:03:14.978553+0000","last_became_active":"2024-09-21T22:03:07.942754+0000","last_became_peered":"2024-09-21T22:03:07.942754+0000","last_unstale":"2024-09-21T22:03:14.978553+0000","last_undegraded":"2024-09-21T22:03:14.978553+0000","last_fullsized":"2024-09-21T22:03:14.978553+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:14:49.189417+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001417499,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3247,"num_read_kb":25203,"num_write":372,"num_write_kb":14568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"139'467","reported_seq":3606,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141060+0000","last_change":"2024-09-21T22:02:56.874306+0000","last_active":"2024-09-21T22:03:15.141060+0000","last_peered":"2024-09-21T22:03:15.141060+0000","last_clean":"2024-09-21T22:03:15.141060+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:03:15.141060+0000","last_undegraded":"2024-09-21T22:03:15.141060+0000","last_fullsized":"2024-09-21T22:03:15.141060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:00.084380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022694490000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4796,"num_read_kb":36988,"num_write":418,"num_write_kb":23161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"139'558","reported_seq":5502,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979246+0000","last_change":"2024-09-21T22:02:56.880020+0000","last_active":"2024-09-21T22:03:14.979246+0000","last_peered":"2024-09-21T22:03:14.979246+0000","last_clean":"2024-09-21T22:03:14.979246+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:03:14.979246+0000","last_undegraded":"2024-09-21T22:03:14.979246+0000","last_fullsized":"2024-09-21T22:03:14.979246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:33.890137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001422139,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5645,"num_read_kb":30705,"num_write":602,"num_write_kb":12146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"139'393","reported_seq":2422,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142448+0000","last_change":"2024-09-21T22:02:56.892611+0000","last_active":"2024-09-21T22:03:15.142448+0000","last_peered":"2024-09-21T22:03:15.142448+0000","last_clean":"2024-09-21T22:03:15.142448+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:03:15.142448+0000","last_undegraded":"2024-09-21T22:03:15.142448+0000","last_fullsized":"2024-09-21T22:03:15.142448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:06:05.808304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154411,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2451,"num_read_kb":16496,"num_write":423,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"138'482","reported_seq":2986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141495+0000","last_change":"2024-09-21T22:02:56.873157+0000","last_active":"2024-09-21T22:03:15.141495+0000","last_peered":"2024-09-21T22:03:15.141495+0000","last_clean":"2024-09-21T22:03:15.141495+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:03:15.141495+0000","last_undegraded":"2024-09-21T22:03:15.141495+0000","last_fullsized":"2024-09-21T22:03:15.141495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:41.327365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013256330000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3311,"num_read_kb":22849,"num_write":472,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141793+0000","last_change":"2024-09-21T22:02:58.886889+0000","last_active":"2024-09-21T22:03:15.141793+0000","last_peered":"2024-09-21T22:03:15.141793+0000","last_clean":"2024-09-21T22:03:15.141793+0000","last_became_active":"2024-09-21T22:02:58.886569+0000","last_became_peered":"2024-09-21T22:02:58.886569+0000","last_unstale":"2024-09-21T22:03:15.141793+0000","last_undegraded":"2024-09-21T22:03:15.141793+0000","last_fullsized":"2024-09-21T22:03:15.141793+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:25:13.011972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"140'669","reported_seq":3791,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140856+0000","last_change":"2024-09-21T22:02:56.872906+0000","last_active":"2024-09-21T22:03:15.140856+0000","last_peered":"2024-09-21T22:03:15.140856+0000","last_clean":"2024-09-21T22:03:15.140856+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:03:15.140856+0000","last_undegraded":"2024-09-21T22:03:15.140856+0000","last_fullsized":"2024-09-21T22:03:15.140856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:08:05.048385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014495230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4731,"num_read_kb":30235,"num_write":747,"num_write_kb":21390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141092+0000","last_change":"2024-09-21T22:03:03.795675+0000","last_active":"2024-09-21T22:03:15.141092+0000","last_peered":"2024-09-21T22:03:15.141092+0000","last_clean":"2024-09-21T22:03:15.141092+0000","last_became_active":"2024-09-21T22:03:03.795428+0000","last_became_peered":"2024-09-21T22:03:03.795428+0000","last_unstale":"2024-09-21T22:03:15.141092+0000","last_undegraded":"2024-09-21T22:03:15.141092+0000","last_fullsized":"2024-09-21T22:03:15.141092+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:17.673856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"139'427","reported_seq":2844,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978691+0000","last_change":"2024-09-21T22:03:07.938096+0000","last_active":"2024-09-21T22:03:14.978691+0000","last_peered":"2024-09-21T22:03:14.978691+0000","last_clean":"2024-09-21T22:03:14.978691+0000","last_became_active":"2024-09-21T22:03:07.937189+0000","last_became_peered":"2024-09-21T22:03:07.937189+0000","last_unstale":"2024-09-21T22:03:14.978691+0000","last_undegraded":"2024-09-21T22:03:14.978691+0000","last_fullsized":"2024-09-21T22:03:14.978691+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:53.667899+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001035935,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3573,"num_read_kb":18221,"num_write":381,"num_write_kb":12046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142304+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:03:15.142304+0000","last_peered":"2024-09-21T22:03:15.142304+0000","last_clean":"2024-09-21T22:03:15.142304+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:03:15.142304+0000","last_undegraded":"2024-09-21T22:03:15.142304+0000","last_fullsized":"2024-09-21T22:03:15.142304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"137'1229","reported_seq":6783,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141072+0000","last_change":"2024-09-21T22:03:03.738243+0000","last_active":"2024-09-21T22:03:15.141072+0000","last_peered":"2024-09-21T22:03:15.141072+0000","last_clean":"2024-09-21T22:03:15.141072+0000","last_became_active":"2024-09-21T22:03:03.736933+0000","last_became_peered":"2024-09-21T22:03:03.736933+0000","last_unstale":"2024-09-21T22:03:15.141072+0000","last_undegraded":"2024-09-21T22:03:15.141072+0000","last_fullsized":"2024-09-21T22:03:15.141072+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1229,"log_dups_size":0,"ondisk_log_size":1229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:42:15.915953+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00055570499999999998,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":11131,"num_read_kb":38962,"num_write":1701,"num_write_kb":13508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":2571463,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:03:04.524949+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:03:04.524729+0000","last_became_peered":"2024-09-21T22:03:04.524729+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:53:23.125596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"139'560","reported_seq":3448,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978853+0000","last_change":"2024-09-21T22:03:07.941051+0000","last_active":"2024-09-21T22:03:14.978853+0000","last_peered":"2024-09-21T22:03:14.978853+0000","last_clean":"2024-09-21T22:03:14.978853+0000","last_became_active":"2024-09-21T22:03:07.939773+0000","last_became_peered":"2024-09-21T22:03:07.939773+0000","last_unstale":"2024-09-21T22:03:14.978853+0000","last_undegraded":"2024-09-21T22:03:14.978853+0000","last_fullsized":"2024-09-21T22:03:14.978853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:16:26.184045+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079113100000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3777,"num_read_kb":20163,"num_write":683,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":6110205,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"140'648","reported_seq":3015,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141426+0000","last_change":"2024-09-21T22:02:56.873270+0000","last_active":"2024-09-21T22:03:15.141426+0000","last_peered":"2024-09-21T22:03:15.141426+0000","last_clean":"2024-09-21T22:03:15.141426+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:03:15.141426+0000","last_undegraded":"2024-09-21T22:03:15.141426+0000","last_fullsized":"2024-09-21T22:03:15.141426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:13:07.713841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013958779999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":2979,"num_read_kb":18860,"num_write":691,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":296,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979186+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:03:14.979186+0000","last_peered":"2024-09-21T22:03:14.979186+0000","last_clean":"2024-09-21T22:03:14.979186+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:03:14.979186+0000","last_undegraded":"2024-09-21T22:03:14.979186+0000","last_fullsized":"2024-09-21T22:03:14.979186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"139'382","reported_seq":2549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140990+0000","last_change":"2024-09-21T22:03:03.737358+0000","last_active":"2024-09-21T22:03:15.140990+0000","last_peered":"2024-09-21T22:03:15.140990+0000","last_clean":"2024-09-21T22:03:15.140990+0000","last_became_active":"2024-09-21T22:03:03.736151+0000","last_became_peered":"2024-09-21T22:03:03.736151+0000","last_unstale":"2024-09-21T22:03:15.140990+0000","last_undegraded":"2024-09-21T22:03:15.140990+0000","last_fullsized":"2024-09-21T22:03:15.140990+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:15:18.105335+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079671400000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":2522,"num_read_kb":15798,"num_write":339,"num_write_kb":10215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":1488605,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978247+0000","last_change":"2024-09-21T22:02:59.729883+0000","last_active":"2024-09-21T22:03:14.978247+0000","last_peered":"2024-09-21T22:03:14.978247+0000","last_clean":"2024-09-21T22:03:14.978247+0000","last_became_active":"2024-09-21T22:02:59.729555+0000","last_became_peered":"2024-09-21T22:02:59.729555+0000","last_unstale":"2024-09-21T22:03:14.978247+0000","last_undegraded":"2024-09-21T22:03:14.978247+0000","last_fullsized":"2024-09-21T22:03:14.978247+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:36:23.460064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"139'249","reported_seq":1737,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:02:56.872721+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:37:30.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013224700000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1014,"num_read_kb":21083,"num_write":213,"num_write_kb":9611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142085+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:03:15.142085+0000","last_peered":"2024-09-21T22:03:15.142085+0000","last_clean":"2024-09-21T22:03:15.142085+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:03:15.142085+0000","last_undegraded":"2024-09-21T22:03:15.142085+0000","last_fullsized":"2024-09-21T22:03:15.142085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"139'510","reported_seq":2654,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978715+0000","last_change":"2024-09-21T22:03:07.939621+0000","last_active":"2024-09-21T22:03:14.978715+0000","last_peered":"2024-09-21T22:03:14.978715+0000","last_clean":"2024-09-21T22:03:14.978715+0000","last_became_active":"2024-09-21T22:03:07.938172+0000","last_became_peered":"2024-09-21T22:03:07.938172+0000","last_unstale":"2024-09-21T22:03:14.978715+0000","last_undegraded":"2024-09-21T22:03:14.978715+0000","last_fullsized":"2024-09-21T22:03:14.978715+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:27:59.532011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077946799999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3658,"num_read_kb":17679,"num_write":432,"num_write_kb":10973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979215+0000","last_change":"2024-09-21T22:02:59.738182+0000","last_active":"2024-09-21T22:03:14.979215+0000","last_peered":"2024-09-21T22:03:14.979215+0000","last_clean":"2024-09-21T22:03:14.979215+0000","last_became_active":"2024-09-21T22:02:59.735519+0000","last_became_peered":"2024-09-21T22:02:59.735519+0000","last_unstale":"2024-09-21T22:03:14.979215+0000","last_undegraded":"2024-09-21T22:03:14.979215+0000","last_fullsized":"2024-09-21T22:03:14.979215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:19.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":445,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142117+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:03:15.142117+0000","last_peered":"2024-09-21T22:03:15.142117+0000","last_clean":"2024-09-21T22:03:15.142117+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:03:15.142117+0000","last_undegraded":"2024-09-21T22:03:15.142117+0000","last_fullsized":"2024-09-21T22:03:15.142117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"140'707","reported_seq":7393,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978567+0000","last_change":"2024-09-21T22:02:56.935303+0000","last_active":"2024-09-21T22:03:14.978567+0000","last_peered":"2024-09-21T22:03:14.978567+0000","last_clean":"2024-09-21T22:03:14.978567+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:03:14.978567+0000","last_undegraded":"2024-09-21T22:03:14.978567+0000","last_fullsized":"2024-09-21T22:03:14.978567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:33:00.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043807600000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":8848,"num_read_kb":26906,"num_write":745,"num_write_kb":11566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"139'572","reported_seq":4507,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141395+0000","last_change":"2024-09-21T22:03:02.734471+0000","last_active":"2024-09-21T22:03:15.141395+0000","last_peered":"2024-09-21T22:03:15.141395+0000","last_clean":"2024-09-21T22:03:15.141395+0000","last_became_active":"2024-09-21T22:03:02.733121+0000","last_became_peered":"2024-09-21T22:03:02.733121+0000","last_unstale":"2024-09-21T22:03:15.141395+0000","last_undegraded":"2024-09-21T22:03:15.141395+0000","last_fullsized":"2024-09-21T22:03:15.141395+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:19:14.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001727063,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":5483,"num_read_kb":33605,"num_write":573,"num_write_kb":16665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":3573432,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"140'554","reported_seq":2135,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.731202+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.729474+0000","last_became_peered":"2024-09-21T22:03:01.729474+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:08.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":3106,"num_read_kb":9483,"num_write":540,"num_write_kb":9066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"139'329","reported_seq":1878,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978627+0000","last_change":"2024-09-21T22:03:07.944339+0000","last_active":"2024-09-21T22:03:14.978627+0000","last_peered":"2024-09-21T22:03:14.978627+0000","last_clean":"2024-09-21T22:03:14.978627+0000","last_became_active":"2024-09-21T22:03:07.943220+0000","last_became_peered":"2024-09-21T22:03:07.943220+0000","last_unstale":"2024-09-21T22:03:14.978627+0000","last_undegraded":"2024-09-21T22:03:14.978627+0000","last_fullsized":"2024-09-21T22:03:14.978627+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:51.424190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081105489999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":1262,"num_read_kb":20198,"num_write":335,"num_write_kb":15448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"139'886","reported_seq":3512,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979195+0000","last_change":"2024-09-21T22:02:56.879719+0000","last_active":"2024-09-21T22:03:14.979195+0000","last_peered":"2024-09-21T22:03:14.979195+0000","last_clean":"2024-09-21T22:03:14.979195+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:03:14.979195+0000","last_undegraded":"2024-09-21T22:03:14.979195+0000","last_fullsized":"2024-09-21T22:03:14.979195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:18.500573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012138979999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4783,"num_read_kb":25125,"num_write":1089,"num_write_kb":15165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"139'330","reported_seq":4647,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142154+0000","last_change":"2024-09-21T22:02:56.892713+0000","last_active":"2024-09-21T22:03:15.142154+0000","last_peered":"2024-09-21T22:03:15.142154+0000","last_clean":"2024-09-21T22:03:15.142154+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:03:15.142154+0000","last_undegraded":"2024-09-21T22:03:15.142154+0000","last_fullsized":"2024-09-21T22:03:15.142154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:28.659826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016441019999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4476,"num_read_kb":19373,"num_write":277,"num_write_kb":6594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"138'786","reported_seq":2824,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142251+0000","last_change":"2024-09-21T22:02:56.891670+0000","last_active":"2024-09-21T22:03:15.142251+0000","last_peered":"2024-09-21T22:03:15.142251+0000","last_clean":"2024-09-21T22:03:15.142251+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:03:15.142251+0000","last_undegraded":"2024-09-21T22:03:15.142251+0000","last_fullsized":"2024-09-21T22:03:15.142251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:25:22.367301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070171700000000003,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4744,"num_read_kb":15768,"num_write":1138,"num_write_kb":6705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"138'909","reported_seq":2818,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142240+0000","last_change":"2024-09-21T22:02:56.892228+0000","last_active":"2024-09-21T22:03:15.142240+0000","last_peered":"2024-09-21T22:03:15.142240+0000","last_clean":"2024-09-21T22:03:15.142240+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:03:15.142240+0000","last_undegraded":"2024-09-21T22:03:15.142240+0000","last_fullsized":"2024-09-21T22:03:15.142240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:11.574320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562649999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4141,"num_read_kb":17774,"num_write":1199,"num_write_kb":13706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"139'302","reported_seq":1403,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.732935+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.731443+0000","last_became_peered":"2024-09-21T22:03:01.731443+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:06:01.781845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094293999999999997,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":784,"num_read_kb":16089,"num_write":270,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"139'769","reported_seq":3586,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142196+0000","last_change":"2024-09-21T22:02:56.891713+0000","last_active":"2024-09-21T22:03:15.142196+0000","last_peered":"2024-09-21T22:03:15.142196+0000","last_clean":"2024-09-21T22:03:15.142196+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:03:15.142196+0000","last_undegraded":"2024-09-21T22:03:15.142196+0000","last_fullsized":"2024-09-21T22:03:15.142196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:26.547168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071737500000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4762,"num_read_kb":48263,"num_write":1037,"num_write_kb":22105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"138'483","reported_seq":2394,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140920+0000","last_change":"2024-09-21T22:02:56.873784+0000","last_active":"2024-09-21T22:03:15.140920+0000","last_peered":"2024-09-21T22:03:15.140920+0000","last_clean":"2024-09-21T22:03:15.140920+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:03:15.140920+0000","last_undegraded":"2024-09-21T22:03:15.140920+0000","last_fullsized":"2024-09-21T22:03:15.140920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:09:19.068419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020803319999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2714,"num_read_kb":25997,"num_write":557,"num_write_kb":11325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"138'359","reported_seq":3012,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142234+0000","last_change":"2024-09-21T22:02:56.892151+0000","last_active":"2024-09-21T22:03:15.142234+0000","last_peered":"2024-09-21T22:03:15.142234+0000","last_clean":"2024-09-21T22:03:15.142234+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:03:15.142234+0000","last_undegraded":"2024-09-21T22:03:15.142234+0000","last_fullsized":"2024-09-21T22:03:15.142234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:42:48.152578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835350000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2638,"num_read_kb":34828,"num_write":289,"num_write_kb":13167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":110,"num_read":141040,"num_read_kb":761833,"num_write":21373,"num_write_kb":436099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1364,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18822,"ondisk_log_size":18822,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55260,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316580,"statfs":{"total":96636764160,"available":96580177920,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55248,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316592,"statfs":{"total":96636764160,"available":96580190208,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28884,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342956,"statfs":{"total":96636764160,"available":96607186944,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51096,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320744,"statfs":{"total":96636764160,"available":96584441856,"internally_reserved":0,"allocated":1904640,"data_stored":911731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33096,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338744,"statfs":{"total":96636764160,"available":96602873856,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:03:20.582 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:03:20.858 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:03:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:03:20.871 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-09-21T22:03:19.028515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":110,"num_read":141156,"num_read_kb":761933,"num_write":21534,"num_write_kb":438517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1366,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18942,"ondisk_log_size":18942,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376920,"kb_used_data":14944,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754597800,"statfs":{"total":773094113280,"available":772708147200,"internally_reserved":0,"allocated":15302656,"data_stored":8474356,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":370462258},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.066373"},"pg_stats":[{"pgid":"3.1f","version":"140'425","reported_seq":2548,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140960+0000","last_change":"2024-09-21T22:02:56.873931+0000","last_active":"2024-09-21T22:03:15.140960+0000","last_peered":"2024-09-21T22:03:15.140960+0000","last_clean":"2024-09-21T22:03:15.140960+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:03:15.140960+0000","last_undegraded":"2024-09-21T22:03:15.140960+0000","last_fullsized":"2024-09-21T22:03:15.140960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:48:46.229881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842339999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3150,"num_read_kb":17993,"num_write":419,"num_write_kb":16614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"139'647","reported_seq":3149,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978817+0000","last_change":"2024-09-21T22:03:07.941715+0000","last_active":"2024-09-21T22:03:14.978817+0000","last_peered":"2024-09-21T22:03:14.978817+0000","last_clean":"2024-09-21T22:03:14.978817+0000","last_became_active":"2024-09-21T22:03:07.939807+0000","last_became_peered":"2024-09-21T22:03:07.939807+0000","last_unstale":"2024-09-21T22:03:14.978817+0000","last_undegraded":"2024-09-21T22:03:14.978817+0000","last_fullsized":"2024-09-21T22:03:14.978817+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:41:15.679849+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0059876790000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3617,"num_read_kb":17763,"num_write":805,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":5393987,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"140'1290","reported_seq":4549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979353+0000","last_change":"2024-09-21T22:02:56.880766+0000","last_active":"2024-09-21T22:03:14.979353+0000","last_peered":"2024-09-21T22:03:14.979353+0000","last_clean":"2024-09-21T22:03:14.979353+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:03:14.979353+0000","last_undegraded":"2024-09-21T22:03:14.979353+0000","last_fullsized":"2024-09-21T22:03:14.979353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:06:37.789236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020421839999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":9275,"num_read_kb":26039,"num_write":1594,"num_write_kb":17141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"140'539","reported_seq":6456,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142232+0000","last_change":"2024-09-21T22:02:56.893214+0000","last_active":"2024-09-21T22:03:15.142232+0000","last_peered":"2024-09-21T22:03:15.142232+0000","last_clean":"2024-09-21T22:03:15.142232+0000","last_became_active":"2024-09-21T22:02:27.724446+0000","last_became_peered":"2024-09-21T22:02:27.724446+0000","last_unstale":"2024-09-21T22:03:15.142232+0000","last_undegraded":"2024-09-21T22:03:15.142232+0000","last_fullsized":"2024-09-21T22:03:15.142232+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:24:18.215433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018963980000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":6312,"num_read_kb":34767,"num_write":622,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":4226464,"num_keys_recovered":52,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1b","version":"139'427","reported_seq":2493,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141358+0000","last_change":"2024-09-21T22:02:56.874277+0000","last_active":"2024-09-21T22:03:15.141358+0000","last_peered":"2024-09-21T22:03:15.141358+0000","last_clean":"2024-09-21T22:03:15.141358+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:03:15.141358+0000","last_undegraded":"2024-09-21T22:03:15.141358+0000","last_fullsized":"2024-09-21T22:03:15.141358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:15.061982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024247990000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2405,"num_read_kb":22208,"num_write":524,"num_write_kb":15129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"139'777","reported_seq":5986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141475+0000","last_change":"2024-09-21T22:02:56.872628+0000","last_active":"2024-09-21T22:03:15.141475+0000","last_peered":"2024-09-21T22:03:15.141475+0000","last_clean":"2024-09-21T22:03:15.141475+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:03:15.141475+0000","last_undegraded":"2024-09-21T22:03:15.141475+0000","last_fullsized":"2024-09-21T22:03:15.141475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:00:17.211762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086556399999999998,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9177,"num_read_kb":15032,"num_write":963,"num_write_kb":7279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"132'737","reported_seq":5383,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140929+0000","last_change":"2024-09-21T22:02:56.876587+0000","last_active":"2024-09-21T22:03:15.140929+0000","last_peered":"2024-09-21T22:03:15.140929+0000","last_clean":"2024-09-21T22:03:15.140929+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:03:15.140929+0000","last_undegraded":"2024-09-21T22:03:15.140929+0000","last_fullsized":"2024-09-21T22:03:15.140929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:39.590354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052006100000000005,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6528,"num_read_kb":21380,"num_write":923,"num_write_kb":11344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"139'420","reported_seq":3313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978553+0000","last_change":"2024-09-21T22:03:07.943880+0000","last_active":"2024-09-21T22:03:14.978553+0000","last_peered":"2024-09-21T22:03:14.978553+0000","last_clean":"2024-09-21T22:03:14.978553+0000","last_became_active":"2024-09-21T22:03:07.942754+0000","last_became_peered":"2024-09-21T22:03:07.942754+0000","last_unstale":"2024-09-21T22:03:14.978553+0000","last_undegraded":"2024-09-21T22:03:14.978553+0000","last_fullsized":"2024-09-21T22:03:14.978553+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:14:49.189417+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001417499,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3247,"num_read_kb":25203,"num_write":372,"num_write_kb":14568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"139'467","reported_seq":3606,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141060+0000","last_change":"2024-09-21T22:02:56.874306+0000","last_active":"2024-09-21T22:03:15.141060+0000","last_peered":"2024-09-21T22:03:15.141060+0000","last_clean":"2024-09-21T22:03:15.141060+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:03:15.141060+0000","last_undegraded":"2024-09-21T22:03:15.141060+0000","last_fullsized":"2024-09-21T22:03:15.141060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:00.084380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022694490000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4796,"num_read_kb":36988,"num_write":418,"num_write_kb":23161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"139'558","reported_seq":5502,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979246+0000","last_change":"2024-09-21T22:02:56.880020+0000","last_active":"2024-09-21T22:03:14.979246+0000","last_peered":"2024-09-21T22:03:14.979246+0000","last_clean":"2024-09-21T22:03:14.979246+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:03:14.979246+0000","last_undegraded":"2024-09-21T22:03:14.979246+0000","last_fullsized":"2024-09-21T22:03:14.979246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:33.890137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001422139,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5645,"num_read_kb":30705,"num_write":602,"num_write_kb":12146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"139'393","reported_seq":2422,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142448+0000","last_change":"2024-09-21T22:02:56.892611+0000","last_active":"2024-09-21T22:03:15.142448+0000","last_peered":"2024-09-21T22:03:15.142448+0000","last_clean":"2024-09-21T22:03:15.142448+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:03:15.142448+0000","last_undegraded":"2024-09-21T22:03:15.142448+0000","last_fullsized":"2024-09-21T22:03:15.142448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:06:05.808304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154411,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2451,"num_read_kb":16496,"num_write":423,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"138'482","reported_seq":2986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141495+0000","last_change":"2024-09-21T22:02:56.873157+0000","last_active":"2024-09-21T22:03:15.141495+0000","last_peered":"2024-09-21T22:03:15.141495+0000","last_clean":"2024-09-21T22:03:15.141495+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:03:15.141495+0000","last_undegraded":"2024-09-21T22:03:15.141495+0000","last_fullsized":"2024-09-21T22:03:15.141495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:41.327365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013256330000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3311,"num_read_kb":22849,"num_write":472,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141793+0000","last_change":"2024-09-21T22:02:58.886889+0000","last_active":"2024-09-21T22:03:15.141793+0000","last_peered":"2024-09-21T22:03:15.141793+0000","last_clean":"2024-09-21T22:03:15.141793+0000","last_became_active":"2024-09-21T22:02:58.886569+0000","last_became_peered":"2024-09-21T22:02:58.886569+0000","last_unstale":"2024-09-21T22:03:15.141793+0000","last_undegraded":"2024-09-21T22:03:15.141793+0000","last_fullsized":"2024-09-21T22:03:15.141793+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:25:13.011972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"140'669","reported_seq":3791,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140856+0000","last_change":"2024-09-21T22:02:56.872906+0000","last_active":"2024-09-21T22:03:15.140856+0000","last_peered":"2024-09-21T22:03:15.140856+0000","last_clean":"2024-09-21T22:03:15.140856+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:03:15.140856+0000","last_undegraded":"2024-09-21T22:03:15.140856+0000","last_fullsized":"2024-09-21T22:03:15.140856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:08:05.048385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014495230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4731,"num_read_kb":30235,"num_write":747,"num_write_kb":21390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141092+0000","last_change":"2024-09-21T22:03:03.795675+0000","last_active":"2024-09-21T22:03:15.141092+0000","last_peered":"2024-09-21T22:03:15.141092+0000","last_clean":"2024-09-21T22:03:15.141092+0000","last_became_active":"2024-09-21T22:03:03.795428+0000","last_became_peered":"2024-09-21T22:03:03.795428+0000","last_unstale":"2024-09-21T22:03:15.141092+0000","last_undegraded":"2024-09-21T22:03:15.141092+0000","last_fullsized":"2024-09-21T22:03:15.141092+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:17.673856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"139'427","reported_seq":2844,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978691+0000","last_change":"2024-09-21T22:03:07.938096+0000","last_active":"2024-09-21T22:03:14.978691+0000","last_peered":"2024-09-21T22:03:14.978691+0000","last_clean":"2024-09-21T22:03:14.978691+0000","last_became_active":"2024-09-21T22:03:07.937189+0000","last_became_peered":"2024-09-21T22:03:07.937189+0000","last_unstale":"2024-09-21T22:03:14.978691+0000","last_undegraded":"2024-09-21T22:03:14.978691+0000","last_fullsized":"2024-09-21T22:03:14.978691+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:53.667899+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001035935,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3573,"num_read_kb":18221,"num_write":381,"num_write_kb":12046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142304+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:03:15.142304+0000","last_peered":"2024-09-21T22:03:15.142304+0000","last_clean":"2024-09-21T22:03:15.142304+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:03:15.142304+0000","last_undegraded":"2024-09-21T22:03:15.142304+0000","last_fullsized":"2024-09-21T22:03:15.142304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"137'1229","reported_seq":6783,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141072+0000","last_change":"2024-09-21T22:03:03.738243+0000","last_active":"2024-09-21T22:03:15.141072+0000","last_peered":"2024-09-21T22:03:15.141072+0000","last_clean":"2024-09-21T22:03:15.141072+0000","last_became_active":"2024-09-21T22:03:03.736933+0000","last_became_peered":"2024-09-21T22:03:03.736933+0000","last_unstale":"2024-09-21T22:03:15.141072+0000","last_undegraded":"2024-09-21T22:03:15.141072+0000","last_fullsized":"2024-09-21T22:03:15.141072+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1229,"log_dups_size":0,"ondisk_log_size":1229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:42:15.915953+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00055570499999999998,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":11131,"num_read_kb":38962,"num_write":1701,"num_write_kb":13508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":2571463,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:03:04.524949+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:03:04.524729+0000","last_became_peered":"2024-09-21T22:03:04.524729+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:53:23.125596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"139'560","reported_seq":3448,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978853+0000","last_change":"2024-09-21T22:03:07.941051+0000","last_active":"2024-09-21T22:03:14.978853+0000","last_peered":"2024-09-21T22:03:14.978853+0000","last_clean":"2024-09-21T22:03:14.978853+0000","last_became_active":"2024-09-21T22:03:07.939773+0000","last_became_peered":"2024-09-21T22:03:07.939773+0000","last_unstale":"2024-09-21T22:03:14.978853+0000","last_undegraded":"2024-09-21T22:03:14.978853+0000","last_fullsized":"2024-09-21T22:03:14.978853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:16:26.184045+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079113100000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3777,"num_read_kb":20163,"num_write":683,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":6110205,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"140'648","reported_seq":3015,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141426+0000","last_change":"2024-09-21T22:02:56.873270+0000","last_active":"2024-09-21T22:03:15.141426+0000","last_peered":"2024-09-21T22:03:15.141426+0000","last_clean":"2024-09-21T22:03:15.141426+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:03:15.141426+0000","last_undegraded":"2024-09-21T22:03:15.141426+0000","last_fullsized":"2024-09-21T22:03:15.141426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:13:07.713841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013958779999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":2979,"num_read_kb":18860,"num_write":691,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":296,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979186+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:03:14.979186+0000","last_peered":"2024-09-21T22:03:14.979186+0000","last_clean":"2024-09-21T22:03:14.979186+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:03:14.979186+0000","last_undegraded":"2024-09-21T22:03:14.979186+0000","last_fullsized":"2024-09-21T22:03:14.979186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"139'382","reported_seq":2549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140990+0000","last_change":"2024-09-21T22:03:03.737358+0000","last_active":"2024-09-21T22:03:15.140990+0000","last_peered":"2024-09-21T22:03:15.140990+0000","last_clean":"2024-09-21T22:03:15.140990+0000","last_became_active":"2024-09-21T22:03:03.736151+0000","last_became_peered":"2024-09-21T22:03:03.736151+0000","last_unstale":"2024-09-21T22:03:15.140990+0000","last_undegraded":"2024-09-21T22:03:15.140990+0000","last_fullsized":"2024-09-21T22:03:15.140990+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:15:18.105335+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079671400000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":2522,"num_read_kb":15798,"num_write":339,"num_write_kb":10215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":1488605,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978247+0000","last_change":"2024-09-21T22:02:59.729883+0000","last_active":"2024-09-21T22:03:14.978247+0000","last_peered":"2024-09-21T22:03:14.978247+0000","last_clean":"2024-09-21T22:03:14.978247+0000","last_became_active":"2024-09-21T22:02:59.729555+0000","last_became_peered":"2024-09-21T22:02:59.729555+0000","last_unstale":"2024-09-21T22:03:14.978247+0000","last_undegraded":"2024-09-21T22:03:14.978247+0000","last_fullsized":"2024-09-21T22:03:14.978247+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:36:23.460064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"139'249","reported_seq":1737,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:02:56.872721+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:37:30.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013224700000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1014,"num_read_kb":21083,"num_write":213,"num_write_kb":9611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142085+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:03:15.142085+0000","last_peered":"2024-09-21T22:03:15.142085+0000","last_clean":"2024-09-21T22:03:15.142085+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:03:15.142085+0000","last_undegraded":"2024-09-21T22:03:15.142085+0000","last_fullsized":"2024-09-21T22:03:15.142085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"139'510","reported_seq":2654,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978715+0000","last_change":"2024-09-21T22:03:07.939621+0000","last_active":"2024-09-21T22:03:14.978715+0000","last_peered":"2024-09-21T22:03:14.978715+0000","last_clean":"2024-09-21T22:03:14.978715+0000","last_became_active":"2024-09-21T22:03:07.938172+0000","last_became_peered":"2024-09-21T22:03:07.938172+0000","last_unstale":"2024-09-21T22:03:14.978715+0000","last_undegraded":"2024-09-21T22:03:14.978715+0000","last_fullsized":"2024-09-21T22:03:14.978715+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:27:59.532011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077946799999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3658,"num_read_kb":17679,"num_write":432,"num_write_kb":10973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979215+0000","last_change":"2024-09-21T22:02:59.738182+0000","last_active":"2024-09-21T22:03:14.979215+0000","last_peered":"2024-09-21T22:03:14.979215+0000","last_clean":"2024-09-21T22:03:14.979215+0000","last_became_active":"2024-09-21T22:02:59.735519+0000","last_became_peered":"2024-09-21T22:02:59.735519+0000","last_unstale":"2024-09-21T22:03:14.979215+0000","last_undegraded":"2024-09-21T22:03:14.979215+0000","last_fullsized":"2024-09-21T22:03:14.979215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:19.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":445,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142117+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:03:15.142117+0000","last_peered":"2024-09-21T22:03:15.142117+0000","last_clean":"2024-09-21T22:03:15.142117+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:03:15.142117+0000","last_undegraded":"2024-09-21T22:03:15.142117+0000","last_fullsized":"2024-09-21T22:03:15.142117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"140'707","reported_seq":7393,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978567+0000","last_change":"2024-09-21T22:02:56.935303+0000","last_active":"2024-09-21T22:03:14.978567+0000","last_peered":"2024-09-21T22:03:14.978567+0000","last_clean":"2024-09-21T22:03:14.978567+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:03:14.978567+0000","last_undegraded":"2024-09-21T22:03:14.978567+0000","last_fullsized":"2024-09-21T22:03:14.978567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:33:00.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043807600000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":8848,"num_read_kb":26906,"num_write":745,"num_write_kb":11566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"139'572","reported_seq":4507,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141395+0000","last_change":"2024-09-21T22:03:02.734471+0000","last_active":"2024-09-21T22:03:15.141395+0000","last_peered":"2024-09-21T22:03:15.141395+0000","last_clean":"2024-09-21T22:03:15.141395+0000","last_became_active":"2024-09-21T22:03:02.733121+0000","last_became_peered":"2024-09-21T22:03:02.733121+0000","last_unstale":"2024-09-21T22:03:15.141395+0000","last_undegraded":"2024-09-21T22:03:15.141395+0000","last_fullsized":"2024-09-21T22:03:15.141395+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:19:14.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001727063,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":5483,"num_read_kb":33605,"num_write":573,"num_write_kb":16665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":3573432,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"140'554","reported_seq":2135,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.731202+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.729474+0000","last_became_peered":"2024-09-21T22:03:01.729474+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:08.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":3106,"num_read_kb":9483,"num_write":540,"num_write_kb":9066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"139'329","reported_seq":1878,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978627+0000","last_change":"2024-09-21T22:03:07.944339+0000","last_active":"2024-09-21T22:03:14.978627+0000","last_peered":"2024-09-21T22:03:14.978627+0000","last_clean":"2024-09-21T22:03:14.978627+0000","last_became_active":"2024-09-21T22:03:07.943220+0000","last_became_peered":"2024-09-21T22:03:07.943220+0000","last_unstale":"2024-09-21T22:03:14.978627+0000","last_undegraded":"2024-09-21T22:03:14.978627+0000","last_fullsized":"2024-09-21T22:03:14.978627+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:51.424190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081105489999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":1262,"num_read_kb":20198,"num_write":335,"num_write_kb":15448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"139'886","reported_seq":3512,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979195+0000","last_change":"2024-09-21T22:02:56.879719+0000","last_active":"2024-09-21T22:03:14.979195+0000","last_peered":"2024-09-21T22:03:14.979195+0000","last_clean":"2024-09-21T22:03:14.979195+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:03:14.979195+0000","last_undegraded":"2024-09-21T22:03:14.979195+0000","last_fullsized":"2024-09-21T22:03:14.979195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:18.500573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012138979999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4783,"num_read_kb":25125,"num_write":1089,"num_write_kb":15165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"139'330","reported_seq":4647,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142154+0000","last_change":"2024-09-21T22:02:56.892713+0000","last_active":"2024-09-21T22:03:15.142154+0000","last_peered":"2024-09-21T22:03:15.142154+0000","last_clean":"2024-09-21T22:03:15.142154+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:03:15.142154+0000","last_undegraded":"2024-09-21T22:03:15.142154+0000","last_fullsized":"2024-09-21T22:03:15.142154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:28.659826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016441019999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4476,"num_read_kb":19373,"num_write":277,"num_write_kb":6594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"138'786","reported_seq":2824,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142251+0000","last_change":"2024-09-21T22:02:56.891670+0000","last_active":"2024-09-21T22:03:15.142251+0000","last_peered":"2024-09-21T22:03:15.142251+0000","last_clean":"2024-09-21T22:03:15.142251+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:03:15.142251+0000","last_undegraded":"2024-09-21T22:03:15.142251+0000","last_fullsized":"2024-09-21T22:03:15.142251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:25:22.367301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070171700000000003,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4744,"num_read_kb":15768,"num_write":1138,"num_write_kb":6705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"138'909","reported_seq":2818,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142240+0000","last_change":"2024-09-21T22:02:56.892228+0000","last_active":"2024-09-21T22:03:15.142240+0000","last_peered":"2024-09-21T22:03:15.142240+0000","last_clean":"2024-09-21T22:03:15.142240+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:03:15.142240+0000","last_undegraded":"2024-09-21T22:03:15.142240+0000","last_fullsized":"2024-09-21T22:03:15.142240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:11.574320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562649999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4141,"num_read_kb":17774,"num_write":1199,"num_write_kb":13706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"139'302","reported_seq":1403,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.732935+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.731443+0000","last_became_peered":"2024-09-21T22:03:01.731443+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:06:01.781845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094293999999999997,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":784,"num_read_kb":16089,"num_write":270,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"139'769","reported_seq":3586,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142196+0000","last_change":"2024-09-21T22:02:56.891713+0000","last_active":"2024-09-21T22:03:15.142196+0000","last_peered":"2024-09-21T22:03:15.142196+0000","last_clean":"2024-09-21T22:03:15.142196+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:03:15.142196+0000","last_undegraded":"2024-09-21T22:03:15.142196+0000","last_fullsized":"2024-09-21T22:03:15.142196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:26.547168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071737500000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4762,"num_read_kb":48263,"num_write":1037,"num_write_kb":22105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"138'483","reported_seq":2394,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140920+0000","last_change":"2024-09-21T22:02:56.873784+0000","last_active":"2024-09-21T22:03:15.140920+0000","last_peered":"2024-09-21T22:03:15.140920+0000","last_clean":"2024-09-21T22:03:15.140920+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:03:15.140920+0000","last_undegraded":"2024-09-21T22:03:15.140920+0000","last_fullsized":"2024-09-21T22:03:15.140920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:09:19.068419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020803319999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2714,"num_read_kb":25997,"num_write":557,"num_write_kb":11325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"138'359","reported_seq":3012,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142234+0000","last_change":"2024-09-21T22:02:56.892151+0000","last_active":"2024-09-21T22:03:15.142234+0000","last_peered":"2024-09-21T22:03:15.142234+0000","last_clean":"2024-09-21T22:03:15.142234+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:03:15.142234+0000","last_undegraded":"2024-09-21T22:03:15.142234+0000","last_fullsized":"2024-09-21T22:03:15.142234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:42:48.152578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835350000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2638,"num_read_kb":34828,"num_write":289,"num_write_kb":13167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":110,"num_read":141040,"num_read_kb":761833,"num_write":21373,"num_write_kb":436099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1364,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18822,"ondisk_log_size":18822,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55260,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316580,"statfs":{"total":96636764160,"available":96580177920,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55248,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316592,"statfs":{"total":96636764160,"available":96580190208,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28884,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342956,"statfs":{"total":96636764160,"available":96607186944,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51096,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320744,"statfs":{"total":96636764160,"available":96584441856,"internally_reserved":0,"allocated":1904640,"data_stored":911731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33096,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338744,"statfs":{"total":96636764160,"available":96602873856,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:03:20.872 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T22:03:20.872 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:03:21.152 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:03:21.153 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:03:21.165 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-21T22:03:21.028882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":110,"num_read":141156,"num_read_kb":761933,"num_write":21534,"num_write_kb":438517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1366,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18942,"ondisk_log_size":18942,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376920,"kb_used_data":14944,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754597800,"statfs":{"total":773094113280,"available":772708147200,"internally_reserved":0,"allocated":15302656,"data_stored":8474356,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":370462258},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001439"},"pg_stats":[{"pgid":"3.1f","version":"140'425","reported_seq":2548,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140960+0000","last_change":"2024-09-21T22:02:56.873931+0000","last_active":"2024-09-21T22:03:15.140960+0000","last_peered":"2024-09-21T22:03:15.140960+0000","last_clean":"2024-09-21T22:03:15.140960+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:03:15.140960+0000","last_undegraded":"2024-09-21T22:03:15.140960+0000","last_fullsized":"2024-09-21T22:03:15.140960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:48:46.229881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842339999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3150,"num_read_kb":17993,"num_write":419,"num_write_kb":16614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"139'647","reported_seq":3149,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978817+0000","last_change":"2024-09-21T22:03:07.941715+0000","last_active":"2024-09-21T22:03:14.978817+0000","last_peered":"2024-09-21T22:03:14.978817+0000","last_clean":"2024-09-21T22:03:14.978817+0000","last_became_active":"2024-09-21T22:03:07.939807+0000","last_became_peered":"2024-09-21T22:03:07.939807+0000","last_unstale":"2024-09-21T22:03:14.978817+0000","last_undegraded":"2024-09-21T22:03:14.978817+0000","last_fullsized":"2024-09-21T22:03:14.978817+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:41:15.679849+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0059876790000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3617,"num_read_kb":17763,"num_write":805,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":5393987,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"140'1290","reported_seq":4549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979353+0000","last_change":"2024-09-21T22:02:56.880766+0000","last_active":"2024-09-21T22:03:14.979353+0000","last_peered":"2024-09-21T22:03:14.979353+0000","last_clean":"2024-09-21T22:03:14.979353+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:03:14.979353+0000","last_undegraded":"2024-09-21T22:03:14.979353+0000","last_fullsized":"2024-09-21T22:03:14.979353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:06:37.789236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020421839999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":9275,"num_read_kb":26039,"num_write":1594,"num_write_kb":17141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"140'539","reported_seq":6456,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142232+0000","last_change":"2024-09-21T22:02:56.893214+0000","last_active":"2024-09-21T22:03:15.142232+0000","last_peered":"2024-09-21T22:03:15.142232+0000","last_clean":"2024-09-21T22:03:15.142232+0000","last_became_active":"2024-09-21T22:02:27.724446+0000","last_became_peered":"2024-09-21T22:02:27.724446+0000","last_unstale":"2024-09-21T22:03:15.142232+0000","last_undegraded":"2024-09-21T22:03:15.142232+0000","last_fullsized":"2024-09-21T22:03:15.142232+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:24:18.215433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018963980000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":6312,"num_read_kb":34767,"num_write":622,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":4226464,"num_keys_recovered":52,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1b","version":"139'427","reported_seq":2493,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141358+0000","last_change":"2024-09-21T22:02:56.874277+0000","last_active":"2024-09-21T22:03:15.141358+0000","last_peered":"2024-09-21T22:03:15.141358+0000","last_clean":"2024-09-21T22:03:15.141358+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:03:15.141358+0000","last_undegraded":"2024-09-21T22:03:15.141358+0000","last_fullsized":"2024-09-21T22:03:15.141358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:15.061982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024247990000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2405,"num_read_kb":22208,"num_write":524,"num_write_kb":15129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"139'777","reported_seq":5986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141475+0000","last_change":"2024-09-21T22:02:56.872628+0000","last_active":"2024-09-21T22:03:15.141475+0000","last_peered":"2024-09-21T22:03:15.141475+0000","last_clean":"2024-09-21T22:03:15.141475+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:03:15.141475+0000","last_undegraded":"2024-09-21T22:03:15.141475+0000","last_fullsized":"2024-09-21T22:03:15.141475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:00:17.211762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086556399999999998,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9177,"num_read_kb":15032,"num_write":963,"num_write_kb":7279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"132'737","reported_seq":5383,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140929+0000","last_change":"2024-09-21T22:02:56.876587+0000","last_active":"2024-09-21T22:03:15.140929+0000","last_peered":"2024-09-21T22:03:15.140929+0000","last_clean":"2024-09-21T22:03:15.140929+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:03:15.140929+0000","last_undegraded":"2024-09-21T22:03:15.140929+0000","last_fullsized":"2024-09-21T22:03:15.140929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:39.590354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052006100000000005,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6528,"num_read_kb":21380,"num_write":923,"num_write_kb":11344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"139'420","reported_seq":3313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978553+0000","last_change":"2024-09-21T22:03:07.943880+0000","last_active":"2024-09-21T22:03:14.978553+0000","last_peered":"2024-09-21T22:03:14.978553+0000","last_clean":"2024-09-21T22:03:14.978553+0000","last_became_active":"2024-09-21T22:03:07.942754+0000","last_became_peered":"2024-09-21T22:03:07.942754+0000","last_unstale":"2024-09-21T22:03:14.978553+0000","last_undegraded":"2024-09-21T22:03:14.978553+0000","last_fullsized":"2024-09-21T22:03:14.978553+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:14:49.189417+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001417499,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3247,"num_read_kb":25203,"num_write":372,"num_write_kb":14568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"139'467","reported_seq":3606,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141060+0000","last_change":"2024-09-21T22:02:56.874306+0000","last_active":"2024-09-21T22:03:15.141060+0000","last_peered":"2024-09-21T22:03:15.141060+0000","last_clean":"2024-09-21T22:03:15.141060+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:03:15.141060+0000","last_undegraded":"2024-09-21T22:03:15.141060+0000","last_fullsized":"2024-09-21T22:03:15.141060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:00.084380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022694490000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4796,"num_read_kb":36988,"num_write":418,"num_write_kb":23161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"139'558","reported_seq":5502,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979246+0000","last_change":"2024-09-21T22:02:56.880020+0000","last_active":"2024-09-21T22:03:14.979246+0000","last_peered":"2024-09-21T22:03:14.979246+0000","last_clean":"2024-09-21T22:03:14.979246+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:03:14.979246+0000","last_undegraded":"2024-09-21T22:03:14.979246+0000","last_fullsized":"2024-09-21T22:03:14.979246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:33.890137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001422139,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5645,"num_read_kb":30705,"num_write":602,"num_write_kb":12146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"139'393","reported_seq":2422,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142448+0000","last_change":"2024-09-21T22:02:56.892611+0000","last_active":"2024-09-21T22:03:15.142448+0000","last_peered":"2024-09-21T22:03:15.142448+0000","last_clean":"2024-09-21T22:03:15.142448+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:03:15.142448+0000","last_undegraded":"2024-09-21T22:03:15.142448+0000","last_fullsized":"2024-09-21T22:03:15.142448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:06:05.808304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154411,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2451,"num_read_kb":16496,"num_write":423,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"138'482","reported_seq":2986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141495+0000","last_change":"2024-09-21T22:02:56.873157+0000","last_active":"2024-09-21T22:03:15.141495+0000","last_peered":"2024-09-21T22:03:15.141495+0000","last_clean":"2024-09-21T22:03:15.141495+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:03:15.141495+0000","last_undegraded":"2024-09-21T22:03:15.141495+0000","last_fullsized":"2024-09-21T22:03:15.141495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:41.327365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013256330000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3311,"num_read_kb":22849,"num_write":472,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141793+0000","last_change":"2024-09-21T22:02:58.886889+0000","last_active":"2024-09-21T22:03:15.141793+0000","last_peered":"2024-09-21T22:03:15.141793+0000","last_clean":"2024-09-21T22:03:15.141793+0000","last_became_active":"2024-09-21T22:02:58.886569+0000","last_became_peered":"2024-09-21T22:02:58.886569+0000","last_unstale":"2024-09-21T22:03:15.141793+0000","last_undegraded":"2024-09-21T22:03:15.141793+0000","last_fullsized":"2024-09-21T22:03:15.141793+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:25:13.011972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"140'669","reported_seq":3791,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140856+0000","last_change":"2024-09-21T22:02:56.872906+0000","last_active":"2024-09-21T22:03:15.140856+0000","last_peered":"2024-09-21T22:03:15.140856+0000","last_clean":"2024-09-21T22:03:15.140856+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:03:15.140856+0000","last_undegraded":"2024-09-21T22:03:15.140856+0000","last_fullsized":"2024-09-21T22:03:15.140856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:08:05.048385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014495230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4731,"num_read_kb":30235,"num_write":747,"num_write_kb":21390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141092+0000","last_change":"2024-09-21T22:03:03.795675+0000","last_active":"2024-09-21T22:03:15.141092+0000","last_peered":"2024-09-21T22:03:15.141092+0000","last_clean":"2024-09-21T22:03:15.141092+0000","last_became_active":"2024-09-21T22:03:03.795428+0000","last_became_peered":"2024-09-21T22:03:03.795428+0000","last_unstale":"2024-09-21T22:03:15.141092+0000","last_undegraded":"2024-09-21T22:03:15.141092+0000","last_fullsized":"2024-09-21T22:03:15.141092+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:17.673856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"139'427","reported_seq":2844,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978691+0000","last_change":"2024-09-21T22:03:07.938096+0000","last_active":"2024-09-21T22:03:14.978691+0000","last_peered":"2024-09-21T22:03:14.978691+0000","last_clean":"2024-09-21T22:03:14.978691+0000","last_became_active":"2024-09-21T22:03:07.937189+0000","last_became_peered":"2024-09-21T22:03:07.937189+0000","last_unstale":"2024-09-21T22:03:14.978691+0000","last_undegraded":"2024-09-21T22:03:14.978691+0000","last_fullsized":"2024-09-21T22:03:14.978691+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:53.667899+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001035935,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3573,"num_read_kb":18221,"num_write":381,"num_write_kb":12046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142304+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:03:15.142304+0000","last_peered":"2024-09-21T22:03:15.142304+0000","last_clean":"2024-09-21T22:03:15.142304+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:03:15.142304+0000","last_undegraded":"2024-09-21T22:03:15.142304+0000","last_fullsized":"2024-09-21T22:03:15.142304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"137'1229","reported_seq":6783,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141072+0000","last_change":"2024-09-21T22:03:03.738243+0000","last_active":"2024-09-21T22:03:15.141072+0000","last_peered":"2024-09-21T22:03:15.141072+0000","last_clean":"2024-09-21T22:03:15.141072+0000","last_became_active":"2024-09-21T22:03:03.736933+0000","last_became_peered":"2024-09-21T22:03:03.736933+0000","last_unstale":"2024-09-21T22:03:15.141072+0000","last_undegraded":"2024-09-21T22:03:15.141072+0000","last_fullsized":"2024-09-21T22:03:15.141072+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1229,"log_dups_size":0,"ondisk_log_size":1229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:42:15.915953+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00055570499999999998,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":11131,"num_read_kb":38962,"num_write":1701,"num_write_kb":13508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":2571463,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:03:04.524949+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:03:04.524729+0000","last_became_peered":"2024-09-21T22:03:04.524729+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:53:23.125596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"139'560","reported_seq":3448,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978853+0000","last_change":"2024-09-21T22:03:07.941051+0000","last_active":"2024-09-21T22:03:14.978853+0000","last_peered":"2024-09-21T22:03:14.978853+0000","last_clean":"2024-09-21T22:03:14.978853+0000","last_became_active":"2024-09-21T22:03:07.939773+0000","last_became_peered":"2024-09-21T22:03:07.939773+0000","last_unstale":"2024-09-21T22:03:14.978853+0000","last_undegraded":"2024-09-21T22:03:14.978853+0000","last_fullsized":"2024-09-21T22:03:14.978853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:16:26.184045+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079113100000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3777,"num_read_kb":20163,"num_write":683,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":6110205,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"140'648","reported_seq":3015,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141426+0000","last_change":"2024-09-21T22:02:56.873270+0000","last_active":"2024-09-21T22:03:15.141426+0000","last_peered":"2024-09-21T22:03:15.141426+0000","last_clean":"2024-09-21T22:03:15.141426+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:03:15.141426+0000","last_undegraded":"2024-09-21T22:03:15.141426+0000","last_fullsized":"2024-09-21T22:03:15.141426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:13:07.713841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013958779999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":2979,"num_read_kb":18860,"num_write":691,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":296,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979186+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:03:14.979186+0000","last_peered":"2024-09-21T22:03:14.979186+0000","last_clean":"2024-09-21T22:03:14.979186+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:03:14.979186+0000","last_undegraded":"2024-09-21T22:03:14.979186+0000","last_fullsized":"2024-09-21T22:03:14.979186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"139'382","reported_seq":2549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140990+0000","last_change":"2024-09-21T22:03:03.737358+0000","last_active":"2024-09-21T22:03:15.140990+0000","last_peered":"2024-09-21T22:03:15.140990+0000","last_clean":"2024-09-21T22:03:15.140990+0000","last_became_active":"2024-09-21T22:03:03.736151+0000","last_became_peered":"2024-09-21T22:03:03.736151+0000","last_unstale":"2024-09-21T22:03:15.140990+0000","last_undegraded":"2024-09-21T22:03:15.140990+0000","last_fullsized":"2024-09-21T22:03:15.140990+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:15:18.105335+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079671400000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":2522,"num_read_kb":15798,"num_write":339,"num_write_kb":10215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":1488605,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978247+0000","last_change":"2024-09-21T22:02:59.729883+0000","last_active":"2024-09-21T22:03:14.978247+0000","last_peered":"2024-09-21T22:03:14.978247+0000","last_clean":"2024-09-21T22:03:14.978247+0000","last_became_active":"2024-09-21T22:02:59.729555+0000","last_became_peered":"2024-09-21T22:02:59.729555+0000","last_unstale":"2024-09-21T22:03:14.978247+0000","last_undegraded":"2024-09-21T22:03:14.978247+0000","last_fullsized":"2024-09-21T22:03:14.978247+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:36:23.460064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"139'249","reported_seq":1737,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:02:56.872721+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:37:30.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013224700000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1014,"num_read_kb":21083,"num_write":213,"num_write_kb":9611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142085+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:03:15.142085+0000","last_peered":"2024-09-21T22:03:15.142085+0000","last_clean":"2024-09-21T22:03:15.142085+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:03:15.142085+0000","last_undegraded":"2024-09-21T22:03:15.142085+0000","last_fullsized":"2024-09-21T22:03:15.142085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"139'510","reported_seq":2654,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978715+0000","last_change":"2024-09-21T22:03:07.939621+0000","last_active":"2024-09-21T22:03:14.978715+0000","last_peered":"2024-09-21T22:03:14.978715+0000","last_clean":"2024-09-21T22:03:14.978715+0000","last_became_active":"2024-09-21T22:03:07.938172+0000","last_became_peered":"2024-09-21T22:03:07.938172+0000","last_unstale":"2024-09-21T22:03:14.978715+0000","last_undegraded":"2024-09-21T22:03:14.978715+0000","last_fullsized":"2024-09-21T22:03:14.978715+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:27:59.532011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077946799999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3658,"num_read_kb":17679,"num_write":432,"num_write_kb":10973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979215+0000","last_change":"2024-09-21T22:02:59.738182+0000","last_active":"2024-09-21T22:03:14.979215+0000","last_peered":"2024-09-21T22:03:14.979215+0000","last_clean":"2024-09-21T22:03:14.979215+0000","last_became_active":"2024-09-21T22:02:59.735519+0000","last_became_peered":"2024-09-21T22:02:59.735519+0000","last_unstale":"2024-09-21T22:03:14.979215+0000","last_undegraded":"2024-09-21T22:03:14.979215+0000","last_fullsized":"2024-09-21T22:03:14.979215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:19.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":445,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142117+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:03:15.142117+0000","last_peered":"2024-09-21T22:03:15.142117+0000","last_clean":"2024-09-21T22:03:15.142117+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:03:15.142117+0000","last_undegraded":"2024-09-21T22:03:15.142117+0000","last_fullsized":"2024-09-21T22:03:15.142117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"140'707","reported_seq":7393,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978567+0000","last_change":"2024-09-21T22:02:56.935303+0000","last_active":"2024-09-21T22:03:14.978567+0000","last_peered":"2024-09-21T22:03:14.978567+0000","last_clean":"2024-09-21T22:03:14.978567+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:03:14.978567+0000","last_undegraded":"2024-09-21T22:03:14.978567+0000","last_fullsized":"2024-09-21T22:03:14.978567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:33:00.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043807600000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":8848,"num_read_kb":26906,"num_write":745,"num_write_kb":11566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"139'572","reported_seq":4507,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141395+0000","last_change":"2024-09-21T22:03:02.734471+0000","last_active":"2024-09-21T22:03:15.141395+0000","last_peered":"2024-09-21T22:03:15.141395+0000","last_clean":"2024-09-21T22:03:15.141395+0000","last_became_active":"2024-09-21T22:03:02.733121+0000","last_became_peered":"2024-09-21T22:03:02.733121+0000","last_unstale":"2024-09-21T22:03:15.141395+0000","last_undegraded":"2024-09-21T22:03:15.141395+0000","last_fullsized":"2024-09-21T22:03:15.141395+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:19:14.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001727063,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":5483,"num_read_kb":33605,"num_write":573,"num_write_kb":16665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":3573432,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"140'554","reported_seq":2135,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.731202+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.729474+0000","last_became_peered":"2024-09-21T22:03:01.729474+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:08.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":3106,"num_read_kb":9483,"num_write":540,"num_write_kb":9066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"139'329","reported_seq":1878,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978627+0000","last_change":"2024-09-21T22:03:07.944339+0000","last_active":"2024-09-21T22:03:14.978627+0000","last_peered":"2024-09-21T22:03:14.978627+0000","last_clean":"2024-09-21T22:03:14.978627+0000","last_became_active":"2024-09-21T22:03:07.943220+0000","last_became_peered":"2024-09-21T22:03:07.943220+0000","last_unstale":"2024-09-21T22:03:14.978627+0000","last_undegraded":"2024-09-21T22:03:14.978627+0000","last_fullsized":"2024-09-21T22:03:14.978627+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:51.424190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081105489999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":1262,"num_read_kb":20198,"num_write":335,"num_write_kb":15448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"139'886","reported_seq":3512,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979195+0000","last_change":"2024-09-21T22:02:56.879719+0000","last_active":"2024-09-21T22:03:14.979195+0000","last_peered":"2024-09-21T22:03:14.979195+0000","last_clean":"2024-09-21T22:03:14.979195+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:03:14.979195+0000","last_undegraded":"2024-09-21T22:03:14.979195+0000","last_fullsized":"2024-09-21T22:03:14.979195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:18.500573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012138979999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4783,"num_read_kb":25125,"num_write":1089,"num_write_kb":15165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"139'330","reported_seq":4647,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142154+0000","last_change":"2024-09-21T22:02:56.892713+0000","last_active":"2024-09-21T22:03:15.142154+0000","last_peered":"2024-09-21T22:03:15.142154+0000","last_clean":"2024-09-21T22:03:15.142154+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:03:15.142154+0000","last_undegraded":"2024-09-21T22:03:15.142154+0000","last_fullsized":"2024-09-21T22:03:15.142154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:28.659826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016441019999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4476,"num_read_kb":19373,"num_write":277,"num_write_kb":6594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"138'786","reported_seq":2824,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142251+0000","last_change":"2024-09-21T22:02:56.891670+0000","last_active":"2024-09-21T22:03:15.142251+0000","last_peered":"2024-09-21T22:03:15.142251+0000","last_clean":"2024-09-21T22:03:15.142251+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:03:15.142251+0000","last_undegraded":"2024-09-21T22:03:15.142251+0000","last_fullsized":"2024-09-21T22:03:15.142251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:25:22.367301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070171700000000003,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4744,"num_read_kb":15768,"num_write":1138,"num_write_kb":6705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"138'909","reported_seq":2818,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142240+0000","last_change":"2024-09-21T22:02:56.892228+0000","last_active":"2024-09-21T22:03:15.142240+0000","last_peered":"2024-09-21T22:03:15.142240+0000","last_clean":"2024-09-21T22:03:15.142240+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:03:15.142240+0000","last_undegraded":"2024-09-21T22:03:15.142240+0000","last_fullsized":"2024-09-21T22:03:15.142240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:11.574320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562649999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4141,"num_read_kb":17774,"num_write":1199,"num_write_kb":13706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"139'302","reported_seq":1403,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.732935+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.731443+0000","last_became_peered":"2024-09-21T22:03:01.731443+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:06:01.781845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094293999999999997,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":784,"num_read_kb":16089,"num_write":270,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"139'769","reported_seq":3586,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142196+0000","last_change":"2024-09-21T22:02:56.891713+0000","last_active":"2024-09-21T22:03:15.142196+0000","last_peered":"2024-09-21T22:03:15.142196+0000","last_clean":"2024-09-21T22:03:15.142196+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:03:15.142196+0000","last_undegraded":"2024-09-21T22:03:15.142196+0000","last_fullsized":"2024-09-21T22:03:15.142196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:26.547168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071737500000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4762,"num_read_kb":48263,"num_write":1037,"num_write_kb":22105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"138'483","reported_seq":2394,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140920+0000","last_change":"2024-09-21T22:02:56.873784+0000","last_active":"2024-09-21T22:03:15.140920+0000","last_peered":"2024-09-21T22:03:15.140920+0000","last_clean":"2024-09-21T22:03:15.140920+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:03:15.140920+0000","last_undegraded":"2024-09-21T22:03:15.140920+0000","last_fullsized":"2024-09-21T22:03:15.140920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:09:19.068419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020803319999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2714,"num_read_kb":25997,"num_write":557,"num_write_kb":11325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"138'359","reported_seq":3012,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142234+0000","last_change":"2024-09-21T22:02:56.892151+0000","last_active":"2024-09-21T22:03:15.142234+0000","last_peered":"2024-09-21T22:03:15.142234+0000","last_clean":"2024-09-21T22:03:15.142234+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:03:15.142234+0000","last_undegraded":"2024-09-21T22:03:15.142234+0000","last_fullsized":"2024-09-21T22:03:15.142234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:42:48.152578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835350000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2638,"num_read_kb":34828,"num_write":289,"num_write_kb":13167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":110,"num_read":141040,"num_read_kb":761833,"num_write":21373,"num_write_kb":436099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1364,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18822,"ondisk_log_size":18822,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55260,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316580,"statfs":{"total":96636764160,"available":96580177920,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55248,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316592,"statfs":{"total":96636764160,"available":96580190208,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28884,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342956,"statfs":{"total":96636764160,"available":96607186944,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51096,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320744,"statfs":{"total":96636764160,"available":96584441856,"internally_reserved":0,"allocated":1904640,"data_stored":911731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33096,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338744,"statfs":{"total":96636764160,"available":96602873856,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:03:21.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T22:03:21.443 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:03:21.443 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":158,"fsid":"014f3ec5-afd0-4b18-9c74-de91f34d0760","created":"2024-09-21T22:00:24.916784+0000","modified":"2024-09-21T22:03:14.974504+0000","last_up_change":"2024-09-21T22:00:36.060631+0000","last_in_change":"2024-09-21T22:02:58.877270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T22:00:37.034134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T22:00:42.753049+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-21T22:00:52.269263+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":47,"snap_epoch":140,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ebc4f0b9-33fc-4301-b1c0-ac843b19095b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6809","nonce":3559797623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6811","nonce":3559797623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6815","nonce":3559797623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3559797623},{"type":"v1","addr":"172.21.15.102:6813","nonce":3559797623}]},"public_addr":"172.21.15.102:6809/3559797623","cluster_addr":"172.21.15.102:6811/3559797623","heartbeat_back_addr":"172.21.15.102:6815/3559797623","heartbeat_front_addr":"172.21.15.102:6813/3559797623","state":["exists","up"]},{"osd":1,"uuid":"1c8f54fe-439f-486e-8b8b-fe892332ada3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6825","nonce":428384344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6827","nonce":428384344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6831","nonce":428384344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":428384344},{"type":"v1","addr":"172.21.15.102:6829","nonce":428384344}]},"public_addr":"172.21.15.102:6825/428384344","cluster_addr":"172.21.15.102:6827/428384344","heartbeat_back_addr":"172.21.15.102:6831/428384344","heartbeat_front_addr":"172.21.15.102:6829/428384344","state":["exists","up"]},{"osd":2,"uuid":"b202159c-804c-4d22-9aa3-8f590dce8faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6817","nonce":4237051748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6819","nonce":4237051748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6823","nonce":4237051748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":4237051748},{"type":"v1","addr":"172.21.15.102:6821","nonce":4237051748}]},"public_addr":"172.21.15.102:6817/4237051748","cluster_addr":"172.21.15.102:6819/4237051748","heartbeat_back_addr":"172.21.15.102:6823/4237051748","heartbeat_front_addr":"172.21.15.102:6821/4237051748","state":["exists","up"]},{"osd":3,"uuid":"28a8c407-a445-4c76-8d7c-d5a249d13e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6801","nonce":3004236595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6803","nonce":3004236595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6807","nonce":3004236595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3004236595},{"type":"v1","addr":"172.21.15.102:6805","nonce":3004236595}]},"public_addr":"172.21.15.102:6801/3004236595","cluster_addr":"172.21.15.102:6803/3004236595","heartbeat_back_addr":"172.21.15.102:6807/3004236595","heartbeat_front_addr":"172.21.15.102:6805/3004236595","state":["exists","up"]},{"osd":4,"uuid":"cbc2e636-a2c6-4c06-9eae-4a2bf7ad4605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6825","nonce":743062291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6827","nonce":743062291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6831","nonce":743062291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":743062291},{"type":"v1","addr":"172.21.15.184:6829","nonce":743062291}]},"public_addr":"172.21.15.184:6825/743062291","cluster_addr":"172.21.15.184:6827/743062291","heartbeat_back_addr":"172.21.15.184:6831/743062291","heartbeat_front_addr":"172.21.15.184:6829/743062291","state":["exists","up"]},{"osd":5,"uuid":"7a0cc26e-a543-4647-bc53-fbecb69b2326","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6809","nonce":2410886219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6811","nonce":2410886219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6815","nonce":2410886219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2410886219},{"type":"v1","addr":"172.21.15.184:6813","nonce":2410886219}]},"public_addr":"172.21.15.184:6809/2410886219","cluster_addr":"172.21.15.184:6811/2410886219","heartbeat_back_addr":"172.21.15.184:6815/2410886219","heartbeat_front_addr":"172.21.15.184:6813/2410886219","state":["exists","up"]},{"osd":6,"uuid":"7768eeb7-c6d0-47d8-a400-c47a2154c590","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6801","nonce":2491178498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6803","nonce":2491178498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6807","nonce":2491178498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2491178498},{"type":"v1","addr":"172.21.15.184:6805","nonce":2491178498}]},"public_addr":"172.21.15.184:6801/2491178498","cluster_addr":"172.21.15.184:6803/2491178498","heartbeat_back_addr":"172.21.15.184:6807/2491178498","heartbeat_front_addr":"172.21.15.184:6805/2491178498","state":["exists","up"]},{"osd":7,"uuid":"30ed992b-2e99-4523-9fdd-8389f75940af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6817","nonce":1580142875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6819","nonce":1580142875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6823","nonce":1580142875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1580142875},{"type":"v1","addr":"172.21.15.184:6821","nonce":1580142875}]},"public_addr":"172.21.15.184:6817/1580142875","cluster_addr":"172.21.15.184:6819/1580142875","heartbeat_back_addr":"172.21.15.184:6823/1580142875","heartbeat_front_addr":"172.21.15.184:6821/1580142875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.652871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.866866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.859757+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:34.082180+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.844484+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.746321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.324821+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T22:00:33.093833+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.5","osds":[3,2]},{"pgid":"3.1c","osds":[7,3]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T22:03:22.456 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T22:03:22.456 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:03:22.587 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:03:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:03:22.587 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:03:22.598 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T22:03:22.874 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T22:03:22.887 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T22:03:22.887 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:03:23.009 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:03:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:03:23.009 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:03:23.020 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T22:03:23.298 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T22:03:23.310 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T22:03:23.311 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:03:23.434 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:03:23.434 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:03:23.434 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:03:23.444 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T22:03:23.725 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T22:03:23.738 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T22:03:23.738 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:03:23.860 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:03:23.861 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:03:23.861 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:03:23.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T22:03:24.152 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T22:03:24.165 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T22:03:24.165 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:03:24.287 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:03:24.287 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:03:24.287 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:03:24.298 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T22:03:24.573 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T22:03:24.585 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T22:03:24.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:03:24.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T22:03:24.888+0000 7fb246d9d640 0 --2- 172.21.15.102:0/857449460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb2480a8c60 0x7fb24813efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-21T22:03:24.910 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:03:24.910 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:03:24.910 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:03:24.921 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T22:03:25.196 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T22:03:25.209 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T22:03:25.210 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:03:25.334 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:03:25.334 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:03:25.334 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:03:25.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T22:03:25.620 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T22:03:25.633 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T22:03:25.633 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T22:03:25.757 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T22:03:25.757 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T22:03:25.757 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T22:03:25.768 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T22:03:26.049 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T22:03:26.062 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:03:26.339 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:03:26.340 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:03:26.351 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-21T22:03:25.029458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":110,"num_read":141156,"num_read_kb":761933,"num_write":21534,"num_write_kb":438517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1366,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18942,"ondisk_log_size":18942,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376920,"kb_used_data":14944,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754597800,"statfs":{"total":773094113280,"available":772708147200,"internally_reserved":0,"allocated":15302656,"data_stored":8474356,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":370462258},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.052479"},"pg_stats":[{"pgid":"3.1f","version":"140'425","reported_seq":2548,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140960+0000","last_change":"2024-09-21T22:02:56.873931+0000","last_active":"2024-09-21T22:03:15.140960+0000","last_peered":"2024-09-21T22:03:15.140960+0000","last_clean":"2024-09-21T22:03:15.140960+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:03:15.140960+0000","last_undegraded":"2024-09-21T22:03:15.140960+0000","last_fullsized":"2024-09-21T22:03:15.140960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:48:46.229881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842339999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3150,"num_read_kb":17993,"num_write":419,"num_write_kb":16614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"139'647","reported_seq":3149,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978817+0000","last_change":"2024-09-21T22:03:07.941715+0000","last_active":"2024-09-21T22:03:14.978817+0000","last_peered":"2024-09-21T22:03:14.978817+0000","last_clean":"2024-09-21T22:03:14.978817+0000","last_became_active":"2024-09-21T22:03:07.939807+0000","last_became_peered":"2024-09-21T22:03:07.939807+0000","last_unstale":"2024-09-21T22:03:14.978817+0000","last_undegraded":"2024-09-21T22:03:14.978817+0000","last_fullsized":"2024-09-21T22:03:14.978817+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:41:15.679849+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0059876790000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3617,"num_read_kb":17763,"num_write":805,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":5393987,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"140'1290","reported_seq":4549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979353+0000","last_change":"2024-09-21T22:02:56.880766+0000","last_active":"2024-09-21T22:03:14.979353+0000","last_peered":"2024-09-21T22:03:14.979353+0000","last_clean":"2024-09-21T22:03:14.979353+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:03:14.979353+0000","last_undegraded":"2024-09-21T22:03:14.979353+0000","last_fullsized":"2024-09-21T22:03:14.979353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:06:37.789236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020421839999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":9275,"num_read_kb":26039,"num_write":1594,"num_write_kb":17141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"140'539","reported_seq":6456,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142232+0000","last_change":"2024-09-21T22:02:56.893214+0000","last_active":"2024-09-21T22:03:15.142232+0000","last_peered":"2024-09-21T22:03:15.142232+0000","last_clean":"2024-09-21T22:03:15.142232+0000","last_became_active":"2024-09-21T22:02:27.724446+0000","last_became_peered":"2024-09-21T22:02:27.724446+0000","last_unstale":"2024-09-21T22:03:15.142232+0000","last_undegraded":"2024-09-21T22:03:15.142232+0000","last_fullsized":"2024-09-21T22:03:15.142232+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:24:18.215433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018963980000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":6312,"num_read_kb":34767,"num_write":622,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":4226464,"num_keys_recovered":52,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1b","version":"139'427","reported_seq":2493,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141358+0000","last_change":"2024-09-21T22:02:56.874277+0000","last_active":"2024-09-21T22:03:15.141358+0000","last_peered":"2024-09-21T22:03:15.141358+0000","last_clean":"2024-09-21T22:03:15.141358+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:03:15.141358+0000","last_undegraded":"2024-09-21T22:03:15.141358+0000","last_fullsized":"2024-09-21T22:03:15.141358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:15.061982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024247990000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2405,"num_read_kb":22208,"num_write":524,"num_write_kb":15129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"139'777","reported_seq":5986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141475+0000","last_change":"2024-09-21T22:02:56.872628+0000","last_active":"2024-09-21T22:03:15.141475+0000","last_peered":"2024-09-21T22:03:15.141475+0000","last_clean":"2024-09-21T22:03:15.141475+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:03:15.141475+0000","last_undegraded":"2024-09-21T22:03:15.141475+0000","last_fullsized":"2024-09-21T22:03:15.141475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:00:17.211762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086556399999999998,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9177,"num_read_kb":15032,"num_write":963,"num_write_kb":7279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"132'737","reported_seq":5384,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140984+0000","last_change":"2024-09-21T22:02:56.876587+0000","last_active":"2024-09-21T22:03:15.140984+0000","last_peered":"2024-09-21T22:03:15.140984+0000","last_clean":"2024-09-21T22:03:15.140984+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:03:15.140984+0000","last_undegraded":"2024-09-21T22:03:15.140984+0000","last_fullsized":"2024-09-21T22:03:15.140984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:39.590354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052006100000000005,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6528,"num_read_kb":21380,"num_write":923,"num_write_kb":11344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"139'420","reported_seq":3314,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978707+0000","last_change":"2024-09-21T22:03:07.943880+0000","last_active":"2024-09-21T22:03:14.978707+0000","last_peered":"2024-09-21T22:03:14.978707+0000","last_clean":"2024-09-21T22:03:14.978707+0000","last_became_active":"2024-09-21T22:03:07.942754+0000","last_became_peered":"2024-09-21T22:03:07.942754+0000","last_unstale":"2024-09-21T22:03:14.978707+0000","last_undegraded":"2024-09-21T22:03:14.978707+0000","last_fullsized":"2024-09-21T22:03:14.978707+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:14:49.189417+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001417499,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3247,"num_read_kb":25203,"num_write":372,"num_write_kb":14568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"139'467","reported_seq":3607,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141102+0000","last_change":"2024-09-21T22:02:56.874306+0000","last_active":"2024-09-21T22:03:15.141102+0000","last_peered":"2024-09-21T22:03:15.141102+0000","last_clean":"2024-09-21T22:03:15.141102+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:03:15.141102+0000","last_undegraded":"2024-09-21T22:03:15.141102+0000","last_fullsized":"2024-09-21T22:03:15.141102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:44:00.084380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022694490000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4796,"num_read_kb":36988,"num_write":418,"num_write_kb":23161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"139'558","reported_seq":5503,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979304+0000","last_change":"2024-09-21T22:02:56.880020+0000","last_active":"2024-09-21T22:03:14.979304+0000","last_peered":"2024-09-21T22:03:14.979304+0000","last_clean":"2024-09-21T22:03:14.979304+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:03:14.979304+0000","last_undegraded":"2024-09-21T22:03:14.979304+0000","last_fullsized":"2024-09-21T22:03:14.979304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:29:33.890137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001422139,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5645,"num_read_kb":30705,"num_write":602,"num_write_kb":12146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"139'393","reported_seq":2423,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142491+0000","last_change":"2024-09-21T22:02:56.892611+0000","last_active":"2024-09-21T22:03:15.142491+0000","last_peered":"2024-09-21T22:03:15.142491+0000","last_clean":"2024-09-21T22:03:15.142491+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:03:15.142491+0000","last_undegraded":"2024-09-21T22:03:15.142491+0000","last_fullsized":"2024-09-21T22:03:15.142491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:06:05.808304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154411,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2451,"num_read_kb":16496,"num_write":423,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"138'482","reported_seq":2986,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141495+0000","last_change":"2024-09-21T22:02:56.873157+0000","last_active":"2024-09-21T22:03:15.141495+0000","last_peered":"2024-09-21T22:03:15.141495+0000","last_clean":"2024-09-21T22:03:15.141495+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:03:15.141495+0000","last_undegraded":"2024-09-21T22:03:15.141495+0000","last_fullsized":"2024-09-21T22:03:15.141495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:41.327365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013256330000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3311,"num_read_kb":22849,"num_write":472,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141793+0000","last_change":"2024-09-21T22:02:58.886889+0000","last_active":"2024-09-21T22:03:15.141793+0000","last_peered":"2024-09-21T22:03:15.141793+0000","last_clean":"2024-09-21T22:03:15.141793+0000","last_became_active":"2024-09-21T22:02:58.886569+0000","last_became_peered":"2024-09-21T22:02:58.886569+0000","last_unstale":"2024-09-21T22:03:15.141793+0000","last_undegraded":"2024-09-21T22:03:15.141793+0000","last_fullsized":"2024-09-21T22:03:15.141793+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:25:13.011972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"140'669","reported_seq":3791,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140856+0000","last_change":"2024-09-21T22:02:56.872906+0000","last_active":"2024-09-21T22:03:15.140856+0000","last_peered":"2024-09-21T22:03:15.140856+0000","last_clean":"2024-09-21T22:03:15.140856+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:03:15.140856+0000","last_undegraded":"2024-09-21T22:03:15.140856+0000","last_fullsized":"2024-09-21T22:03:15.140856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:08:05.048385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014495230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4731,"num_read_kb":30235,"num_write":747,"num_write_kb":21390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141092+0000","last_change":"2024-09-21T22:03:03.795675+0000","last_active":"2024-09-21T22:03:15.141092+0000","last_peered":"2024-09-21T22:03:15.141092+0000","last_clean":"2024-09-21T22:03:15.141092+0000","last_became_active":"2024-09-21T22:03:03.795428+0000","last_became_peered":"2024-09-21T22:03:03.795428+0000","last_unstale":"2024-09-21T22:03:15.141092+0000","last_undegraded":"2024-09-21T22:03:15.141092+0000","last_fullsized":"2024-09-21T22:03:15.141092+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:17.673856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"139'427","reported_seq":2844,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978691+0000","last_change":"2024-09-21T22:03:07.938096+0000","last_active":"2024-09-21T22:03:14.978691+0000","last_peered":"2024-09-21T22:03:14.978691+0000","last_clean":"2024-09-21T22:03:14.978691+0000","last_became_active":"2024-09-21T22:03:07.937189+0000","last_became_peered":"2024-09-21T22:03:07.937189+0000","last_unstale":"2024-09-21T22:03:14.978691+0000","last_undegraded":"2024-09-21T22:03:14.978691+0000","last_fullsized":"2024-09-21T22:03:14.978691+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:53.667899+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001035935,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3573,"num_read_kb":18221,"num_write":381,"num_write_kb":12046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142304+0000","last_change":"2024-09-21T22:00:46.188341+0000","last_active":"2024-09-21T22:03:15.142304+0000","last_peered":"2024-09-21T22:03:15.142304+0000","last_clean":"2024-09-21T22:03:15.142304+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:03:15.142304+0000","last_undegraded":"2024-09-21T22:03:15.142304+0000","last_fullsized":"2024-09-21T22:03:15.142304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:50:57.484955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"137'1229","reported_seq":6783,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141072+0000","last_change":"2024-09-21T22:03:03.738243+0000","last_active":"2024-09-21T22:03:15.141072+0000","last_peered":"2024-09-21T22:03:15.141072+0000","last_clean":"2024-09-21T22:03:15.141072+0000","last_became_active":"2024-09-21T22:03:03.736933+0000","last_became_peered":"2024-09-21T22:03:03.736933+0000","last_unstale":"2024-09-21T22:03:15.141072+0000","last_undegraded":"2024-09-21T22:03:15.141072+0000","last_fullsized":"2024-09-21T22:03:15.141072+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":1229,"log_dups_size":0,"ondisk_log_size":1229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:42:15.915953+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00055570499999999998,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":11131,"num_read_kb":38962,"num_write":1701,"num_write_kb":13508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":2571463,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:03:04.524949+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:03:04.524729+0000","last_became_peered":"2024-09-21T22:03:04.524729+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:53:23.125596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"139'560","reported_seq":3448,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978853+0000","last_change":"2024-09-21T22:03:07.941051+0000","last_active":"2024-09-21T22:03:14.978853+0000","last_peered":"2024-09-21T22:03:14.978853+0000","last_clean":"2024-09-21T22:03:14.978853+0000","last_became_active":"2024-09-21T22:03:07.939773+0000","last_became_peered":"2024-09-21T22:03:07.939773+0000","last_unstale":"2024-09-21T22:03:14.978853+0000","last_undegraded":"2024-09-21T22:03:14.978853+0000","last_fullsized":"2024-09-21T22:03:14.978853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:16:26.184045+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079113100000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3777,"num_read_kb":20163,"num_write":683,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":6110205,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"140'648","reported_seq":3015,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141426+0000","last_change":"2024-09-21T22:02:56.873270+0000","last_active":"2024-09-21T22:03:15.141426+0000","last_peered":"2024-09-21T22:03:15.141426+0000","last_clean":"2024-09-21T22:03:15.141426+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:03:15.141426+0000","last_undegraded":"2024-09-21T22:03:15.141426+0000","last_fullsized":"2024-09-21T22:03:15.141426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:13:07.713841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013958779999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":2979,"num_read_kb":18860,"num_write":691,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":296,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979186+0000","last_change":"2024-09-21T22:00:46.122868+0000","last_active":"2024-09-21T22:03:14.979186+0000","last_peered":"2024-09-21T22:03:14.979186+0000","last_clean":"2024-09-21T22:03:14.979186+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:03:14.979186+0000","last_undegraded":"2024-09-21T22:03:14.979186+0000","last_fullsized":"2024-09-21T22:03:14.979186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:46.700549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"139'382","reported_seq":2549,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140990+0000","last_change":"2024-09-21T22:03:03.737358+0000","last_active":"2024-09-21T22:03:15.140990+0000","last_peered":"2024-09-21T22:03:15.140990+0000","last_clean":"2024-09-21T22:03:15.140990+0000","last_became_active":"2024-09-21T22:03:03.736151+0000","last_became_peered":"2024-09-21T22:03:03.736151+0000","last_unstale":"2024-09-21T22:03:15.140990+0000","last_undegraded":"2024-09-21T22:03:15.140990+0000","last_fullsized":"2024-09-21T22:03:15.140990+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:15:18.105335+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00079671400000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":2522,"num_read_kb":15798,"num_write":339,"num_write_kb":10215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":1488605,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978247+0000","last_change":"2024-09-21T22:02:59.729883+0000","last_active":"2024-09-21T22:03:14.978247+0000","last_peered":"2024-09-21T22:03:14.978247+0000","last_clean":"2024-09-21T22:03:14.978247+0000","last_became_active":"2024-09-21T22:02:59.729555+0000","last_became_peered":"2024-09-21T22:02:59.729555+0000","last_unstale":"2024-09-21T22:03:14.978247+0000","last_undegraded":"2024-09-21T22:03:14.978247+0000","last_fullsized":"2024-09-21T22:03:14.978247+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:36:23.460064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"139'249","reported_seq":1737,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141161+0000","last_change":"2024-09-21T22:02:56.872721+0000","last_active":"2024-09-21T22:03:15.141161+0000","last_peered":"2024-09-21T22:03:15.141161+0000","last_clean":"2024-09-21T22:03:15.141161+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:03:15.141161+0000","last_undegraded":"2024-09-21T22:03:15.141161+0000","last_fullsized":"2024-09-21T22:03:15.141161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:37:30.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013224700000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1014,"num_read_kb":21083,"num_write":213,"num_write_kb":9611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":294,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142085+0000","last_change":"2024-09-21T22:00:46.188368+0000","last_active":"2024-09-21T22:03:15.142085+0000","last_peered":"2024-09-21T22:03:15.142085+0000","last_clean":"2024-09-21T22:03:15.142085+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:03:15.142085+0000","last_undegraded":"2024-09-21T22:03:15.142085+0000","last_fullsized":"2024-09-21T22:03:15.142085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:27:36.279880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"139'510","reported_seq":2654,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978715+0000","last_change":"2024-09-21T22:03:07.939621+0000","last_active":"2024-09-21T22:03:14.978715+0000","last_peered":"2024-09-21T22:03:14.978715+0000","last_clean":"2024-09-21T22:03:14.978715+0000","last_became_active":"2024-09-21T22:03:07.938172+0000","last_became_peered":"2024-09-21T22:03:07.938172+0000","last_unstale":"2024-09-21T22:03:14.978715+0000","last_undegraded":"2024-09-21T22:03:14.978715+0000","last_fullsized":"2024-09-21T22:03:14.978715+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:27:59.532011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077946799999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3658,"num_read_kb":17679,"num_write":432,"num_write_kb":10973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":313,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979215+0000","last_change":"2024-09-21T22:02:59.738182+0000","last_active":"2024-09-21T22:03:14.979215+0000","last_peered":"2024-09-21T22:03:14.979215+0000","last_clean":"2024-09-21T22:03:14.979215+0000","last_became_active":"2024-09-21T22:02:59.735519+0000","last_became_peered":"2024-09-21T22:02:59.735519+0000","last_unstale":"2024-09-21T22:03:14.979215+0000","last_undegraded":"2024-09-21T22:03:14.979215+0000","last_fullsized":"2024-09-21T22:03:14.979215+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:43.084460+0000","last_clean_scrub_stamp":"2024-09-21T22:00:43.084460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:19.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":445,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142117+0000","last_change":"2024-09-21T22:00:38.319972+0000","last_active":"2024-09-21T22:03:15.142117+0000","last_peered":"2024-09-21T22:03:15.142117+0000","last_clean":"2024-09-21T22:03:15.142117+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:03:15.142117+0000","last_undegraded":"2024-09-21T22:03:15.142117+0000","last_fullsized":"2024-09-21T22:03:15.142117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:37.062358+0000","last_clean_scrub_stamp":"2024-09-21T22:00:37.062358+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:12.479311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"140'707","reported_seq":7393,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978567+0000","last_change":"2024-09-21T22:02:56.935303+0000","last_active":"2024-09-21T22:03:14.978567+0000","last_peered":"2024-09-21T22:03:14.978567+0000","last_clean":"2024-09-21T22:03:14.978567+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:03:14.978567+0000","last_undegraded":"2024-09-21T22:03:14.978567+0000","last_fullsized":"2024-09-21T22:03:14.978567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:33:00.646845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043807600000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":8848,"num_read_kb":26906,"num_write":745,"num_write_kb":11566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"139'572","reported_seq":4507,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141395+0000","last_change":"2024-09-21T22:03:02.734471+0000","last_active":"2024-09-21T22:03:15.141395+0000","last_peered":"2024-09-21T22:03:15.141395+0000","last_clean":"2024-09-21T22:03:15.141395+0000","last_became_active":"2024-09-21T22:03:02.733121+0000","last_became_peered":"2024-09-21T22:03:02.733121+0000","last_unstale":"2024-09-21T22:03:15.141395+0000","last_undegraded":"2024-09-21T22:03:15.141395+0000","last_fullsized":"2024-09-21T22:03:15.141395+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:19:14.363197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001727063,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":5483,"num_read_kb":33605,"num_write":573,"num_write_kb":16665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":3573432,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"140'554","reported_seq":2135,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.731202+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.729474+0000","last_became_peered":"2024-09-21T22:03:01.729474+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:08.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":3106,"num_read_kb":9483,"num_write":540,"num_write_kb":9066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"139'329","reported_seq":1878,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.978627+0000","last_change":"2024-09-21T22:03:07.944339+0000","last_active":"2024-09-21T22:03:14.978627+0000","last_peered":"2024-09-21T22:03:14.978627+0000","last_clean":"2024-09-21T22:03:14.978627+0000","last_became_active":"2024-09-21T22:03:07.943220+0000","last_became_peered":"2024-09-21T22:03:07.943220+0000","last_unstale":"2024-09-21T22:03:14.978627+0000","last_undegraded":"2024-09-21T22:03:14.978627+0000","last_fullsized":"2024-09-21T22:03:14.978627+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:58:51.424190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081105489999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":1262,"num_read_kb":20198,"num_write":335,"num_write_kb":15448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"139'886","reported_seq":3512,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:14.979195+0000","last_change":"2024-09-21T22:02:56.879719+0000","last_active":"2024-09-21T22:03:14.979195+0000","last_peered":"2024-09-21T22:03:14.979195+0000","last_clean":"2024-09-21T22:03:14.979195+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:03:14.979195+0000","last_undegraded":"2024-09-21T22:03:14.979195+0000","last_fullsized":"2024-09-21T22:03:14.979195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:18.500573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012138979999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4783,"num_read_kb":25125,"num_write":1089,"num_write_kb":15165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"139'330","reported_seq":4647,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142154+0000","last_change":"2024-09-21T22:02:56.892713+0000","last_active":"2024-09-21T22:03:15.142154+0000","last_peered":"2024-09-21T22:03:15.142154+0000","last_clean":"2024-09-21T22:03:15.142154+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:03:15.142154+0000","last_undegraded":"2024-09-21T22:03:15.142154+0000","last_fullsized":"2024-09-21T22:03:15.142154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:28.659826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016441019999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4476,"num_read_kb":19373,"num_write":277,"num_write_kb":6594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"138'786","reported_seq":2824,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142251+0000","last_change":"2024-09-21T22:02:56.891670+0000","last_active":"2024-09-21T22:03:15.142251+0000","last_peered":"2024-09-21T22:03:15.142251+0000","last_clean":"2024-09-21T22:03:15.142251+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:03:15.142251+0000","last_undegraded":"2024-09-21T22:03:15.142251+0000","last_fullsized":"2024-09-21T22:03:15.142251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:25:22.367301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070171700000000003,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4744,"num_read_kb":15768,"num_write":1138,"num_write_kb":6705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"138'909","reported_seq":2818,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142240+0000","last_change":"2024-09-21T22:02:56.892228+0000","last_active":"2024-09-21T22:03:15.142240+0000","last_peered":"2024-09-21T22:03:15.142240+0000","last_clean":"2024-09-21T22:03:15.142240+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:03:15.142240+0000","last_undegraded":"2024-09-21T22:03:15.142240+0000","last_fullsized":"2024-09-21T22:03:15.142240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:11.574320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012562649999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4141,"num_read_kb":17774,"num_write":1199,"num_write_kb":13706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"139'302","reported_seq":1403,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.141766+0000","last_change":"2024-09-21T22:03:01.732935+0000","last_active":"2024-09-21T22:03:15.141766+0000","last_peered":"2024-09-21T22:03:15.141766+0000","last_clean":"2024-09-21T22:03:15.141766+0000","last_became_active":"2024-09-21T22:03:01.731443+0000","last_became_peered":"2024-09-21T22:03:01.731443+0000","last_unstale":"2024-09-21T22:03:15.141766+0000","last_undegraded":"2024-09-21T22:03:15.141766+0000","last_fullsized":"2024-09-21T22:03:15.141766+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:06:01.781845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094293999999999997,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":784,"num_read_kb":16089,"num_write":270,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"139'769","reported_seq":3586,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142196+0000","last_change":"2024-09-21T22:02:56.891713+0000","last_active":"2024-09-21T22:03:15.142196+0000","last_peered":"2024-09-21T22:03:15.142196+0000","last_clean":"2024-09-21T22:03:15.142196+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:03:15.142196+0000","last_undegraded":"2024-09-21T22:03:15.142196+0000","last_fullsized":"2024-09-21T22:03:15.142196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:53:26.547168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071737500000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4762,"num_read_kb":48263,"num_write":1037,"num_write_kb":22105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"138'483","reported_seq":2394,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.140920+0000","last_change":"2024-09-21T22:02:56.873784+0000","last_active":"2024-09-21T22:03:15.140920+0000","last_peered":"2024-09-21T22:03:15.140920+0000","last_clean":"2024-09-21T22:03:15.140920+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:03:15.140920+0000","last_undegraded":"2024-09-21T22:03:15.140920+0000","last_fullsized":"2024-09-21T22:03:15.140920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:09:19.068419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020803319999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2714,"num_read_kb":25997,"num_write":557,"num_write_kb":11325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"138'359","reported_seq":3012,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:15.142234+0000","last_change":"2024-09-21T22:02:56.892151+0000","last_active":"2024-09-21T22:03:15.142234+0000","last_peered":"2024-09-21T22:03:15.142234+0000","last_clean":"2024-09-21T22:03:15.142234+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:03:15.142234+0000","last_undegraded":"2024-09-21T22:03:15.142234+0000","last_fullsized":"2024-09-21T22:03:15.142234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:00:53.138872+0000","last_clean_scrub_stamp":"2024-09-21T22:00:53.138872+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:42:48.152578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835350000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2638,"num_read_kb":34828,"num_write":289,"num_write_kb":13167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":110,"num_read":141040,"num_read_kb":761833,"num_write":21373,"num_write_kb":436099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1364,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18822,"ondisk_log_size":18822,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542181,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55260,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316580,"statfs":{"total":96636764160,"available":96580177920,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64984,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306856,"statfs":{"total":96636764160,"available":96570220544,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542181,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55248,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316592,"statfs":{"total":96636764160,"available":96580190208,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28884,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342956,"statfs":{"total":96636764160,"available":96607186944,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51096,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320744,"statfs":{"total":96636764160,"available":96584441856,"internally_reserved":0,"allocated":1904640,"data_stored":911731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33096,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338744,"statfs":{"total":96636764160,"available":96602873856,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:03:26.355 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.355 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.355 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.355 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.355 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.355 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.355 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.356 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.356 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.356 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.356 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.356 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.356 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T22:00:43.084460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.356 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.356 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T22:00:43.084460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.356 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.356 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T22:00:43.084460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.357 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.357 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T22:00:43.084460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.357 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.357 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.357 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T22:00:43.084460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.357 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.357 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T22:00:43.084460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.357 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.357 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T22:00:43.084460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.358 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.358 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T22:00:43.084460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.358 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T22:00:37.062358+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=37, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.358 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.358 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.358 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.358 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.358 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.358 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.359 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.359 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.359 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.359 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.359 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.359 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T22:00:53.138872+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=0, tm_sec=53, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=22, tm_min=3, tm_sec=21, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T22:03:26.359 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T22:03:46.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T22:03:46.649 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T22:03:46.650 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T22:03:46.662 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-09-21T22:03:45.033605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":110,"num_read":141156,"num_read_kb":761933,"num_write":21534,"num_write_kb":438517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1366,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19059,"ondisk_log_size":19059,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376864,"kb_used_data":14944,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754597856,"statfs":{"total":773094113280,"available":772708204544,"internally_reserved":0,"allocated":15302656,"data_stored":8474356,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":370462258},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002666"},"pg_stats":[{"pgid":"3.1f","version":"158'430","reported_seq":2562,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:24.348745+0000","last_change":"2024-09-21T22:03:24.348773+0000","last_active":"2024-09-21T22:03:24.348745+0000","last_peered":"2024-09-21T22:03:24.348745+0000","last_clean":"2024-09-21T22:03:24.348745+0000","last_became_active":"2024-09-21T22:00:54.157538+0000","last_became_peered":"2024-09-21T22:00:54.157538+0000","last_unstale":"2024-09-21T22:03:24.348745+0000","last_undegraded":"2024-09-21T22:03:24.348745+0000","last_fullsized":"2024-09-21T22:03:24.348745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'430","last_scrub_stamp":"2024-09-21T22:03:24.348677+0000","last_deep_scrub":"158'430","last_deep_scrub_stamp":"2024-09-21T22:03:24.348677+0000","last_clean_scrub_stamp":"2024-09-21T22:03:24.348677+0000","objects_scrubbed":5,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:18.109644+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.0020842339999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3150,"num_read_kb":17993,"num_write":419,"num_write_kb":16614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"158'649","reported_seq":3160,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:28.744778+0000","last_change":"2024-09-21T22:03:28.744825+0000","last_active":"2024-09-21T22:03:28.744778+0000","last_peered":"2024-09-21T22:03:28.744778+0000","last_clean":"2024-09-21T22:03:28.744778+0000","last_became_active":"2024-09-21T22:03:07.939807+0000","last_became_peered":"2024-09-21T22:03:07.939807+0000","last_unstale":"2024-09-21T22:03:28.744778+0000","last_undegraded":"2024-09-21T22:03:28.744778+0000","last_fullsized":"2024-09-21T22:03:28.744778+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'649","last_scrub_stamp":"2024-09-21T22:03:28.744696+0000","last_deep_scrub":"158'649","last_deep_scrub_stamp":"2024-09-21T22:03:28.744696+0000","last_clean_scrub_stamp":"2024-09-21T22:03:28.744696+0000","objects_scrubbed":2,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:44:25.449502+0000","scrub_duration":3,"objects_trimmed":2,"snaptrim_duration":0.0059876790000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3617,"num_read_kb":17763,"num_write":805,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":5393987,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"158'1292","reported_seq":4561,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:28.135825+0000","last_change":"2024-09-21T22:03:28.135855+0000","last_active":"2024-09-21T22:03:28.135825+0000","last_peered":"2024-09-21T22:03:28.135825+0000","last_clean":"2024-09-21T22:03:28.135825+0000","last_became_active":"2024-09-21T22:00:54.161153+0000","last_became_peered":"2024-09-21T22:00:54.161153+0000","last_unstale":"2024-09-21T22:03:28.135825+0000","last_undegraded":"2024-09-21T22:03:28.135825+0000","last_fullsized":"2024-09-21T22:03:28.135825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'1292","last_scrub_stamp":"2024-09-21T22:03:28.135732+0000","last_deep_scrub":"158'1292","last_deep_scrub_stamp":"2024-09-21T22:03:28.135732+0000","last_clean_scrub_stamp":"2024-09-21T22:03:28.135732+0000","objects_scrubbed":2,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:38.525909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020421839999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":9275,"num_read_kb":26039,"num_write":1594,"num_write_kb":17141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"158'544","reported_seq":6470,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:35.765987+0000","last_change":"2024-09-21T22:03:35.766050+0000","last_active":"2024-09-21T22:03:35.765987+0000","last_peered":"2024-09-21T22:03:35.765987+0000","last_clean":"2024-09-21T22:03:35.765987+0000","last_became_active":"2024-09-21T22:02:27.724446+0000","last_became_peered":"2024-09-21T22:02:27.724446+0000","last_unstale":"2024-09-21T22:03:35.765987+0000","last_undegraded":"2024-09-21T22:03:35.765987+0000","last_fullsized":"2024-09-21T22:03:35.765987+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'544","last_scrub_stamp":"2024-09-21T22:03:35.765882+0000","last_deep_scrub":"158'544","last_deep_scrub_stamp":"2024-09-21T22:03:35.765882+0000","last_clean_scrub_stamp":"2024-09-21T22:03:35.765882+0000","objects_scrubbed":5,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:45:44.570558+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0018963980000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":6312,"num_read_kb":34767,"num_write":622,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":4226464,"num_keys_recovered":52,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1b","version":"158'429","reported_seq":2505,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:28.370496+0000","last_change":"2024-09-21T22:03:28.370523+0000","last_active":"2024-09-21T22:03:28.370496+0000","last_peered":"2024-09-21T22:03:28.370496+0000","last_clean":"2024-09-21T22:03:28.370496+0000","last_became_active":"2024-09-21T22:00:54.161889+0000","last_became_peered":"2024-09-21T22:00:54.161889+0000","last_unstale":"2024-09-21T22:03:28.370496+0000","last_undegraded":"2024-09-21T22:03:28.370496+0000","last_fullsized":"2024-09-21T22:03:28.370496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'429","last_scrub_stamp":"2024-09-21T22:03:28.370404+0000","last_deep_scrub":"158'429","last_deep_scrub_stamp":"2024-09-21T22:03:28.370404+0000","last_clean_scrub_stamp":"2024-09-21T22:03:28.370404+0000","objects_scrubbed":2,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:11:39.778625+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0024247990000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2405,"num_read_kb":22208,"num_write":524,"num_write_kb":15129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"158'782","reported_seq":6001,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:25.364854+0000","last_change":"2024-09-21T22:03:25.364854+0000","last_active":"2024-09-21T22:03:25.364854+0000","last_peered":"2024-09-21T22:03:25.364854+0000","last_clean":"2024-09-21T22:03:25.364854+0000","last_became_active":"2024-09-21T22:00:54.157689+0000","last_became_peered":"2024-09-21T22:00:54.157689+0000","last_unstale":"2024-09-21T22:03:25.364854+0000","last_undegraded":"2024-09-21T22:03:25.364854+0000","last_fullsized":"2024-09-21T22:03:25.364854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'782","last_scrub_stamp":"2024-09-21T22:03:25.364723+0000","last_deep_scrub":"158'782","last_deep_scrub_stamp":"2024-09-21T22:03:25.364723+0000","last_clean_scrub_stamp":"2024-09-21T22:03:25.364723+0000","objects_scrubbed":5,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:10:18.228353+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0.00086556399999999998,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":9177,"num_read_kb":15032,"num_write":963,"num_write_kb":7279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"158'741","reported_seq":5397,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:23.673423+0000","last_change":"2024-09-21T22:03:23.673454+0000","last_active":"2024-09-21T22:03:23.673423+0000","last_peered":"2024-09-21T22:03:23.673423+0000","last_clean":"2024-09-21T22:03:23.673423+0000","last_became_active":"2024-09-21T22:00:54.159275+0000","last_became_peered":"2024-09-21T22:00:54.159275+0000","last_unstale":"2024-09-21T22:03:23.673423+0000","last_undegraded":"2024-09-21T22:03:23.673423+0000","last_fullsized":"2024-09-21T22:03:23.673423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'741","last_scrub_stamp":"2024-09-21T22:03:23.673354+0000","last_deep_scrub":"158'741","last_deep_scrub_stamp":"2024-09-21T22:03:23.673354+0000","last_clean_scrub_stamp":"2024-09-21T22:03:23.673354+0000","objects_scrubbed":4,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:54:45.474802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00052006100000000005,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":6528,"num_read_kb":21380,"num_write":923,"num_write_kb":11344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"158'423","reported_seq":3326,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:29.729154+0000","last_change":"2024-09-21T22:03:29.729193+0000","last_active":"2024-09-21T22:03:29.729154+0000","last_peered":"2024-09-21T22:03:29.729154+0000","last_clean":"2024-09-21T22:03:29.729154+0000","last_became_active":"2024-09-21T22:03:07.942754+0000","last_became_peered":"2024-09-21T22:03:07.942754+0000","last_unstale":"2024-09-21T22:03:29.729154+0000","last_undegraded":"2024-09-21T22:03:29.729154+0000","last_fullsized":"2024-09-21T22:03:29.729154+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'423","last_scrub_stamp":"2024-09-21T22:03:29.729065+0000","last_deep_scrub":"158'423","last_deep_scrub_stamp":"2024-09-21T22:03:29.729065+0000","last_clean_scrub_stamp":"2024-09-21T22:03:29.729065+0000","objects_scrubbed":3,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:55:07.758561+0000","scrub_duration":3,"objects_trimmed":2,"snaptrim_duration":0.001417499,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3247,"num_read_kb":25203,"num_write":372,"num_write_kb":14568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"158'471","reported_seq":3620,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:23.377241+0000","last_change":"2024-09-21T22:03:23.377268+0000","last_active":"2024-09-21T22:03:23.377241+0000","last_peered":"2024-09-21T22:03:23.377241+0000","last_clean":"2024-09-21T22:03:23.377241+0000","last_became_active":"2024-09-21T22:00:54.155515+0000","last_became_peered":"2024-09-21T22:00:54.155515+0000","last_unstale":"2024-09-21T22:03:23.377241+0000","last_undegraded":"2024-09-21T22:03:23.377241+0000","last_fullsized":"2024-09-21T22:03:23.377241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'471","last_scrub_stamp":"2024-09-21T22:03:23.377172+0000","last_deep_scrub":"158'471","last_deep_scrub_stamp":"2024-09-21T22:03:23.377172+0000","last_clean_scrub_stamp":"2024-09-21T22:03:23.377172+0000","objects_scrubbed":4,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:51:49.159512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022694490000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4796,"num_read_kb":36988,"num_write":418,"num_write_kb":23161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"158'561","reported_seq":5515,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:29.109315+0000","last_change":"2024-09-21T22:03:29.109349+0000","last_active":"2024-09-21T22:03:29.109315+0000","last_peered":"2024-09-21T22:03:29.109315+0000","last_clean":"2024-09-21T22:03:29.109315+0000","last_became_active":"2024-09-21T22:00:54.163633+0000","last_became_peered":"2024-09-21T22:00:54.163633+0000","last_unstale":"2024-09-21T22:03:29.109315+0000","last_undegraded":"2024-09-21T22:03:29.109315+0000","last_fullsized":"2024-09-21T22:03:29.109315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'561","last_scrub_stamp":"2024-09-21T22:03:29.109217+0000","last_deep_scrub":"158'561","last_deep_scrub_stamp":"2024-09-21T22:03:29.109217+0000","last_clean_scrub_stamp":"2024-09-21T22:03:29.109217+0000","objects_scrubbed":3,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:19:33.639519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001422139,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5645,"num_read_kb":30705,"num_write":602,"num_write_kb":12146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"158'394","reported_seq":2433,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:29.661567+0000","last_change":"2024-09-21T22:03:29.661595+0000","last_active":"2024-09-21T22:03:29.661567+0000","last_peered":"2024-09-21T22:03:29.661567+0000","last_clean":"2024-09-21T22:03:29.661567+0000","last_became_active":"2024-09-21T22:00:54.162133+0000","last_became_peered":"2024-09-21T22:00:54.162133+0000","last_unstale":"2024-09-21T22:03:29.661567+0000","last_undegraded":"2024-09-21T22:03:29.661567+0000","last_fullsized":"2024-09-21T22:03:29.661567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'394","last_scrub_stamp":"2024-09-21T22:03:29.661479+0000","last_deep_scrub":"158'394","last_deep_scrub_stamp":"2024-09-21T22:03:29.661479+0000","last_clean_scrub_stamp":"2024-09-21T22:03:29.661479+0000","objects_scrubbed":1,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:52:17.920751+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00154411,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2451,"num_read_kb":16496,"num_write":423,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"158'484","reported_seq":2997,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:27.382185+0000","last_change":"2024-09-21T22:03:27.382216+0000","last_active":"2024-09-21T22:03:27.382185+0000","last_peered":"2024-09-21T22:03:27.382185+0000","last_clean":"2024-09-21T22:03:27.382185+0000","last_became_active":"2024-09-21T22:00:54.162748+0000","last_became_peered":"2024-09-21T22:00:54.162748+0000","last_unstale":"2024-09-21T22:03:27.382185+0000","last_undegraded":"2024-09-21T22:03:27.382185+0000","last_fullsized":"2024-09-21T22:03:27.382185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'484","last_scrub_stamp":"2024-09-21T22:03:27.382080+0000","last_deep_scrub":"158'484","last_deep_scrub_stamp":"2024-09-21T22:03:27.382080+0000","last_clean_scrub_stamp":"2024-09-21T22:03:27.382080+0000","objects_scrubbed":2,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:41:53.688578+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0013256330000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3311,"num_read_kb":22849,"num_write":472,"num_write_kb":9983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:26.603361+0000","last_change":"2024-09-21T22:03:26.603402+0000","last_active":"2024-09-21T22:03:26.603361+0000","last_peered":"2024-09-21T22:03:26.603361+0000","last_clean":"2024-09-21T22:03:26.603361+0000","last_became_active":"2024-09-21T22:02:58.886569+0000","last_became_peered":"2024-09-21T22:02:58.886569+0000","last_unstale":"2024-09-21T22:03:26.603361+0000","last_undegraded":"2024-09-21T22:03:26.603361+0000","last_fullsized":"2024-09-21T22:03:26.603361+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:03:26.603243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:03:26.603243+0000","last_clean_scrub_stamp":"2024-09-21T22:03:26.603243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:48:38.539700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"158'670","reported_seq":3801,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:25.326952+0000","last_change":"2024-09-21T22:03:25.327002+0000","last_active":"2024-09-21T22:03:25.326952+0000","last_peered":"2024-09-21T22:03:25.326952+0000","last_clean":"2024-09-21T22:03:25.326952+0000","last_became_active":"2024-09-21T22:00:54.157554+0000","last_became_peered":"2024-09-21T22:00:54.157554+0000","last_unstale":"2024-09-21T22:03:25.326952+0000","last_undegraded":"2024-09-21T22:03:25.326952+0000","last_fullsized":"2024-09-21T22:03:25.326952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'670","last_scrub_stamp":"2024-09-21T22:03:25.326854+0000","last_deep_scrub":"158'670","last_deep_scrub_stamp":"2024-09-21T22:03:25.326854+0000","last_clean_scrub_stamp":"2024-09-21T22:03:25.326854+0000","objects_scrubbed":1,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:55:20.365910+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0014495230000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4731,"num_read_kb":30235,"num_write":747,"num_write_kb":21390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:26.634988+0000","last_change":"2024-09-21T22:03:26.635018+0000","last_active":"2024-09-21T22:03:26.634988+0000","last_peered":"2024-09-21T22:03:26.634988+0000","last_clean":"2024-09-21T22:03:26.634988+0000","last_became_active":"2024-09-21T22:03:03.795428+0000","last_became_peered":"2024-09-21T22:03:03.795428+0000","last_unstale":"2024-09-21T22:03:26.634988+0000","last_undegraded":"2024-09-21T22:03:26.634988+0000","last_fullsized":"2024-09-21T22:03:26.634988+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:03:26.634908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:03:26.634908+0000","last_clean_scrub_stamp":"2024-09-21T22:03:26.634908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:32:45.149867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"158'432","reported_seq":2858,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:25.823182+0000","last_change":"2024-09-21T22:03:25.823213+0000","last_active":"2024-09-21T22:03:25.823182+0000","last_peered":"2024-09-21T22:03:25.823182+0000","last_clean":"2024-09-21T22:03:25.823182+0000","last_became_active":"2024-09-21T22:03:07.937189+0000","last_became_peered":"2024-09-21T22:03:07.937189+0000","last_unstale":"2024-09-21T22:03:25.823182+0000","last_undegraded":"2024-09-21T22:03:25.823182+0000","last_fullsized":"2024-09-21T22:03:25.823182+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'432","last_scrub_stamp":"2024-09-21T22:03:25.823115+0000","last_deep_scrub":"158'432","last_deep_scrub_stamp":"2024-09-21T22:03:25.823115+0000","last_clean_scrub_stamp":"2024-09-21T22:03:25.823115+0000","objects_scrubbed":5,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:13:45.944432+0000","scrub_duration":5,"objects_trimmed":2,"snaptrim_duration":0.001035935,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":3573,"num_read_kb":18221,"num_write":381,"num_write_kb":12046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":303,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:28.702064+0000","last_change":"2024-09-21T22:03:28.702085+0000","last_active":"2024-09-21T22:03:28.702064+0000","last_peered":"2024-09-21T22:03:28.702064+0000","last_clean":"2024-09-21T22:03:28.702064+0000","last_became_active":"2024-09-21T22:00:44.221252+0000","last_became_peered":"2024-09-21T22:00:44.221252+0000","last_unstale":"2024-09-21T22:03:28.702064+0000","last_undegraded":"2024-09-21T22:03:28.702064+0000","last_fullsized":"2024-09-21T22:03:28.702064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:03:28.701975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:03:28.701975+0000","last_clean_scrub_stamp":"2024-09-21T22:03:28.701975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:54:43.504399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044302099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"158'1235","reported_seq":6798,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:25.647833+0000","last_change":"2024-09-21T22:03:25.647869+0000","last_active":"2024-09-21T22:03:25.647833+0000","last_peered":"2024-09-21T22:03:25.647833+0000","last_clean":"2024-09-21T22:03:25.647833+0000","last_became_active":"2024-09-21T22:03:03.736933+0000","last_became_peered":"2024-09-21T22:03:03.736933+0000","last_unstale":"2024-09-21T22:03:25.647833+0000","last_undegraded":"2024-09-21T22:03:25.647833+0000","last_fullsized":"2024-09-21T22:03:25.647833+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'1235","last_scrub_stamp":"2024-09-21T22:03:25.647749+0000","last_deep_scrub":"158'1235","last_deep_scrub_stamp":"2024-09-21T22:03:25.647749+0000","last_clean_scrub_stamp":"2024-09-21T22:03:25.647749+0000","objects_scrubbed":6,"log_size":1235,"log_dups_size":0,"ondisk_log_size":1235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:33.822776+0000","scrub_duration":8,"objects_trimmed":2,"snaptrim_duration":0.00055570499999999998,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":11131,"num_read_kb":38962,"num_write":1701,"num_write_kb":13508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":2571463,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:27.625224+0000","last_change":"2024-09-21T22:03:27.625276+0000","last_active":"2024-09-21T22:03:27.625224+0000","last_peered":"2024-09-21T22:03:27.625224+0000","last_clean":"2024-09-21T22:03:27.625224+0000","last_became_active":"2024-09-21T22:03:04.524729+0000","last_became_peered":"2024-09-21T22:03:04.524729+0000","last_unstale":"2024-09-21T22:03:27.625224+0000","last_undegraded":"2024-09-21T22:03:27.625224+0000","last_fullsized":"2024-09-21T22:03:27.625224+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:03:27.625115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:03:27.625115+0000","last_clean_scrub_stamp":"2024-09-21T22:03:27.625115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:38:20.657237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"158'563","reported_seq":3460,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:27.748812+0000","last_change":"2024-09-21T22:03:27.748850+0000","last_active":"2024-09-21T22:03:27.748812+0000","last_peered":"2024-09-21T22:03:27.748812+0000","last_clean":"2024-09-21T22:03:27.748812+0000","last_became_active":"2024-09-21T22:03:07.939773+0000","last_became_peered":"2024-09-21T22:03:07.939773+0000","last_unstale":"2024-09-21T22:03:27.748812+0000","last_undegraded":"2024-09-21T22:03:27.748812+0000","last_fullsized":"2024-09-21T22:03:27.748812+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'563","last_scrub_stamp":"2024-09-21T22:03:27.748723+0000","last_deep_scrub":"158'563","last_deep_scrub_stamp":"2024-09-21T22:03:27.748723+0000","last_clean_scrub_stamp":"2024-09-21T22:03:27.748723+0000","objects_scrubbed":3,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:20:02.389990+0000","scrub_duration":4,"objects_trimmed":2,"snaptrim_duration":0.00079113100000000004,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":3777,"num_read_kb":20163,"num_write":683,"num_write_kb":14133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":6110205,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"158'652","reported_seq":3028,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:26.352034+0000","last_change":"2024-09-21T22:03:26.352098+0000","last_active":"2024-09-21T22:03:26.352034+0000","last_peered":"2024-09-21T22:03:26.352034+0000","last_clean":"2024-09-21T22:03:26.352034+0000","last_became_active":"2024-09-21T22:00:54.160190+0000","last_became_peered":"2024-09-21T22:00:54.160190+0000","last_unstale":"2024-09-21T22:03:26.352034+0000","last_undegraded":"2024-09-21T22:03:26.352034+0000","last_fullsized":"2024-09-21T22:03:26.352034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'652","last_scrub_stamp":"2024-09-21T22:03:26.351923+0000","last_deep_scrub":"158'652","last_deep_scrub_stamp":"2024-09-21T22:03:26.351923+0000","last_clean_scrub_stamp":"2024-09-21T22:03:26.351923+0000","objects_scrubbed":5,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:52.764149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013958779999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":4,"num_read":2979,"num_read_kb":18860,"num_write":691,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"158'3","reported_seq":306,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:26.052287+0000","last_change":"2024-09-21T22:03:26.052317+0000","last_active":"2024-09-21T22:03:26.052287+0000","last_peered":"2024-09-21T22:03:26.052287+0000","last_clean":"2024-09-21T22:03:26.052287+0000","last_became_active":"2024-09-21T22:00:44.110879+0000","last_became_peered":"2024-09-21T22:00:44.110879+0000","last_unstale":"2024-09-21T22:03:26.052287+0000","last_undegraded":"2024-09-21T22:03:26.052287+0000","last_fullsized":"2024-09-21T22:03:26.052287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'3","last_scrub_stamp":"2024-09-21T22:03:26.052195+0000","last_deep_scrub":"158'3","last_deep_scrub_stamp":"2024-09-21T22:03:26.052195+0000","last_clean_scrub_stamp":"2024-09-21T22:03:26.052195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:56.477527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00094154600000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"158'386","reported_seq":2562,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:24.667328+0000","last_change":"2024-09-21T22:03:24.667356+0000","last_active":"2024-09-21T22:03:24.667328+0000","last_peered":"2024-09-21T22:03:24.667328+0000","last_clean":"2024-09-21T22:03:24.667328+0000","last_became_active":"2024-09-21T22:03:03.736151+0000","last_became_peered":"2024-09-21T22:03:03.736151+0000","last_unstale":"2024-09-21T22:03:24.667328+0000","last_undegraded":"2024-09-21T22:03:24.667328+0000","last_fullsized":"2024-09-21T22:03:24.667328+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'386","last_scrub_stamp":"2024-09-21T22:03:24.667260+0000","last_deep_scrub":"158'386","last_deep_scrub_stamp":"2024-09-21T22:03:24.667260+0000","last_clean_scrub_stamp":"2024-09-21T22:03:24.667260+0000","objects_scrubbed":4,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:51:48.746332+0000","scrub_duration":7,"objects_trimmed":2,"snaptrim_duration":0.00079671400000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":2522,"num_read_kb":15798,"num_write":339,"num_write_kb":10215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":1488605,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:24.633559+0000","last_change":"2024-09-21T22:03:24.633578+0000","last_active":"2024-09-21T22:03:24.633559+0000","last_peered":"2024-09-21T22:03:24.633559+0000","last_clean":"2024-09-21T22:03:24.633559+0000","last_became_active":"2024-09-21T22:02:59.729555+0000","last_became_peered":"2024-09-21T22:02:59.729555+0000","last_unstale":"2024-09-21T22:03:24.633559+0000","last_undegraded":"2024-09-21T22:03:24.633559+0000","last_fullsized":"2024-09-21T22:03:24.633559+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:03:24.633481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:03:24.633481+0000","last_clean_scrub_stamp":"2024-09-21T22:03:24.633481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:43:34.027763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"158'252","reported_seq":1749,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:27.345276+0000","last_change":"2024-09-21T22:03:27.345304+0000","last_active":"2024-09-21T22:03:27.345276+0000","last_peered":"2024-09-21T22:03:27.345276+0000","last_clean":"2024-09-21T22:03:27.345276+0000","last_became_active":"2024-09-21T22:00:54.161187+0000","last_became_peered":"2024-09-21T22:00:54.161187+0000","last_unstale":"2024-09-21T22:03:27.345276+0000","last_undegraded":"2024-09-21T22:03:27.345276+0000","last_fullsized":"2024-09-21T22:03:27.345276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'252","last_scrub_stamp":"2024-09-21T22:03:27.345197+0000","last_deep_scrub":"158'252","last_deep_scrub_stamp":"2024-09-21T22:03:27.345197+0000","last_clean_scrub_stamp":"2024-09-21T22:03:27.345197+0000","objects_scrubbed":3,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:38:10.260268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0013224700000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":1014,"num_read_kb":21083,"num_write":213,"num_write_kb":9611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":303,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:27.739569+0000","last_change":"2024-09-21T22:03:27.739618+0000","last_active":"2024-09-21T22:03:27.739569+0000","last_peered":"2024-09-21T22:03:27.739569+0000","last_clean":"2024-09-21T22:03:27.739569+0000","last_became_active":"2024-09-21T22:00:44.110886+0000","last_became_peered":"2024-09-21T22:00:44.110886+0000","last_unstale":"2024-09-21T22:03:27.739569+0000","last_undegraded":"2024-09-21T22:03:27.739569+0000","last_fullsized":"2024-09-21T22:03:27.739569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T22:03:27.739466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T22:03:27.739466+0000","last_clean_scrub_stamp":"2024-09-21T22:03:27.739466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:01:41.074221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000384733,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"158'517","reported_seq":2670,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:26.783403+0000","last_change":"2024-09-21T22:03:26.783473+0000","last_active":"2024-09-21T22:03:26.783403+0000","last_peered":"2024-09-21T22:03:26.783403+0000","last_clean":"2024-09-21T22:03:26.783403+0000","last_became_active":"2024-09-21T22:03:07.938172+0000","last_became_peered":"2024-09-21T22:03:07.938172+0000","last_unstale":"2024-09-21T22:03:26.783403+0000","last_undegraded":"2024-09-21T22:03:26.783403+0000","last_fullsized":"2024-09-21T22:03:26.783403+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'517","last_scrub_stamp":"2024-09-21T22:03:26.783294+0000","last_deep_scrub":"158'517","last_deep_scrub_stamp":"2024-09-21T22:03:26.783294+0000","last_clean_scrub_stamp":"2024-09-21T22:03:26.783294+0000","objects_scrubbed":7,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:29:17.352653+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.00077946799999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":3658,"num_read_kb":17679,"num_write":432,"num_write_kb":10973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"158'2","reported_seq":323,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:30.080468+0000","last_change":"2024-09-21T22:03:30.080497+0000","last_active":"2024-09-21T22:03:30.080468+0000","last_peered":"2024-09-21T22:03:30.080468+0000","last_clean":"2024-09-21T22:03:30.080468+0000","last_became_active":"2024-09-21T22:02:59.735519+0000","last_became_peered":"2024-09-21T22:02:59.735519+0000","last_unstale":"2024-09-21T22:03:30.080468+0000","last_undegraded":"2024-09-21T22:03:30.080468+0000","last_fullsized":"2024-09-21T22:03:30.080468+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'2","last_scrub_stamp":"2024-09-21T22:03:30.080383+0000","last_deep_scrub":"158'2","last_deep_scrub_stamp":"2024-09-21T22:03:30.080383+0000","last_clean_scrub_stamp":"2024-09-21T22:03:30.080383+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:46:24.647599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000432576,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"158'119","reported_seq":456,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:26.703717+0000","last_change":"2024-09-21T22:03:26.703782+0000","last_active":"2024-09-21T22:03:26.703717+0000","last_peered":"2024-09-21T22:03:26.703717+0000","last_clean":"2024-09-21T22:03:26.703717+0000","last_became_active":"2024-09-21T22:00:38.318919+0000","last_became_peered":"2024-09-21T22:00:38.318919+0000","last_unstale":"2024-09-21T22:03:26.703717+0000","last_undegraded":"2024-09-21T22:03:26.703717+0000","last_fullsized":"2024-09-21T22:03:26.703717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'119","last_scrub_stamp":"2024-09-21T22:03:26.703625+0000","last_deep_scrub":"158'119","last_deep_scrub_stamp":"2024-09-21T22:03:26.703625+0000","last_clean_scrub_stamp":"2024-09-21T22:03:26.703625+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:22:17.823519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"158'712","reported_seq":7407,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:24.782889+0000","last_change":"2024-09-21T22:03:24.782913+0000","last_active":"2024-09-21T22:03:24.782889+0000","last_peered":"2024-09-21T22:03:24.782889+0000","last_clean":"2024-09-21T22:03:24.782889+0000","last_became_active":"2024-09-21T22:00:54.158933+0000","last_became_peered":"2024-09-21T22:00:54.158933+0000","last_unstale":"2024-09-21T22:03:24.782889+0000","last_undegraded":"2024-09-21T22:03:24.782889+0000","last_fullsized":"2024-09-21T22:03:24.782889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'712","last_scrub_stamp":"2024-09-21T22:03:24.782817+0000","last_deep_scrub":"158'712","last_deep_scrub_stamp":"2024-09-21T22:03:24.782817+0000","last_clean_scrub_stamp":"2024-09-21T22:03:24.782817+0000","objects_scrubbed":5,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:48:27.158804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00043807600000000003,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":8848,"num_read_kb":26906,"num_write":745,"num_write_kb":11566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"158'573","reported_seq":4517,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:28.393139+0000","last_change":"2024-09-21T22:03:28.393167+0000","last_active":"2024-09-21T22:03:28.393139+0000","last_peered":"2024-09-21T22:03:28.393139+0000","last_clean":"2024-09-21T22:03:28.393139+0000","last_became_active":"2024-09-21T22:03:02.733121+0000","last_became_peered":"2024-09-21T22:03:02.733121+0000","last_unstale":"2024-09-21T22:03:28.393139+0000","last_undegraded":"2024-09-21T22:03:28.393139+0000","last_fullsized":"2024-09-21T22:03:28.393139+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'573","last_scrub_stamp":"2024-09-21T22:03:28.393049+0000","last_deep_scrub":"158'573","last_deep_scrub_stamp":"2024-09-21T22:03:28.393049+0000","last_clean_scrub_stamp":"2024-09-21T22:03:28.393049+0000","objects_scrubbed":1,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:51:00.266800+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001727063,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":5483,"num_read_kb":33605,"num_write":573,"num_write_kb":16665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":3573432,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"158'563","reported_seq":2153,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:27.645510+0000","last_change":"2024-09-21T22:03:27.645558+0000","last_active":"2024-09-21T22:03:27.645510+0000","last_peered":"2024-09-21T22:03:27.645510+0000","last_clean":"2024-09-21T22:03:27.645510+0000","last_became_active":"2024-09-21T22:03:01.729474+0000","last_became_peered":"2024-09-21T22:03:01.729474+0000","last_unstale":"2024-09-21T22:03:27.645510+0000","last_undegraded":"2024-09-21T22:03:27.645510+0000","last_fullsized":"2024-09-21T22:03:27.645510+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'563","last_scrub_stamp":"2024-09-21T22:03:27.645422+0000","last_deep_scrub":"158'563","last_deep_scrub_stamp":"2024-09-21T22:03:27.645422+0000","last_clean_scrub_stamp":"2024-09-21T22:03:27.645422+0000","objects_scrubbed":9,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:14:26.244365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":3106,"num_read_kb":9483,"num_write":540,"num_write_kb":9066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":3002300,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"158'333","reported_seq":1891,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:30.780748+0000","last_change":"2024-09-21T22:03:30.780781+0000","last_active":"2024-09-21T22:03:30.780748+0000","last_peered":"2024-09-21T22:03:30.780748+0000","last_clean":"2024-09-21T22:03:30.780748+0000","last_became_active":"2024-09-21T22:03:07.943220+0000","last_became_peered":"2024-09-21T22:03:07.943220+0000","last_unstale":"2024-09-21T22:03:30.780748+0000","last_undegraded":"2024-09-21T22:03:30.780748+0000","last_fullsized":"2024-09-21T22:03:30.780748+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'333","last_scrub_stamp":"2024-09-21T22:03:30.780652+0000","last_deep_scrub":"158'333","last_deep_scrub_stamp":"2024-09-21T22:03:30.780652+0000","last_clean_scrub_stamp":"2024-09-21T22:03:30.780652+0000","objects_scrubbed":4,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:52:42.663727+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0.0081105489999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":1262,"num_read_kb":20198,"num_write":335,"num_write_kb":15448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"158'887","reported_seq":3522,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:27.089067+0000","last_change":"2024-09-21T22:03:27.089120+0000","last_active":"2024-09-21T22:03:27.089067+0000","last_peered":"2024-09-21T22:03:27.089067+0000","last_clean":"2024-09-21T22:03:27.089067+0000","last_became_active":"2024-09-21T22:00:54.156736+0000","last_became_peered":"2024-09-21T22:00:54.156736+0000","last_unstale":"2024-09-21T22:03:27.089067+0000","last_undegraded":"2024-09-21T22:03:27.089067+0000","last_fullsized":"2024-09-21T22:03:27.089067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'887","last_scrub_stamp":"2024-09-21T22:03:27.088971+0000","last_deep_scrub":"158'887","last_deep_scrub_stamp":"2024-09-21T22:03:27.088971+0000","last_clean_scrub_stamp":"2024-09-21T22:03:27.088971+0000","objects_scrubbed":1,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:40:14.352051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0012138979999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4783,"num_read_kb":25125,"num_write":1089,"num_write_kb":15165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'332","reported_seq":4658,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:30.678006+0000","last_change":"2024-09-21T22:03:30.678054+0000","last_active":"2024-09-21T22:03:30.678006+0000","last_peered":"2024-09-21T22:03:30.678006+0000","last_clean":"2024-09-21T22:03:30.678006+0000","last_became_active":"2024-09-21T22:00:54.162809+0000","last_became_peered":"2024-09-21T22:00:54.162809+0000","last_unstale":"2024-09-21T22:03:30.678006+0000","last_undegraded":"2024-09-21T22:03:30.678006+0000","last_fullsized":"2024-09-21T22:03:30.678006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'332","last_scrub_stamp":"2024-09-21T22:03:30.677896+0000","last_deep_scrub":"158'332","last_deep_scrub_stamp":"2024-09-21T22:03:30.677896+0000","last_clean_scrub_stamp":"2024-09-21T22:03:30.677896+0000","objects_scrubbed":2,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:41:05.158474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0016441019999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":4476,"num_read_kb":19373,"num_write":277,"num_write_kb":6594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"158'790","reported_seq":2837,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:33.708114+0000","last_change":"2024-09-21T22:03:33.708150+0000","last_active":"2024-09-21T22:03:33.708114+0000","last_peered":"2024-09-21T22:03:33.708114+0000","last_clean":"2024-09-21T22:03:33.708114+0000","last_became_active":"2024-09-21T22:00:54.163808+0000","last_became_peered":"2024-09-21T22:00:54.163808+0000","last_unstale":"2024-09-21T22:03:33.708114+0000","last_undegraded":"2024-09-21T22:03:33.708114+0000","last_fullsized":"2024-09-21T22:03:33.708114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'790","last_scrub_stamp":"2024-09-21T22:03:33.708013+0000","last_deep_scrub":"158'790","last_deep_scrub_stamp":"2024-09-21T22:03:33.708013+0000","last_clean_scrub_stamp":"2024-09-21T22:03:33.708013+0000","objects_scrubbed":4,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:29:41.823307+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0.00070171700000000003,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4744,"num_read_kb":15768,"num_write":1138,"num_write_kb":6705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"158'912","reported_seq":2830,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:34.717556+0000","last_change":"2024-09-21T22:03:34.717599+0000","last_active":"2024-09-21T22:03:34.717556+0000","last_peered":"2024-09-21T22:03:34.717556+0000","last_clean":"2024-09-21T22:03:34.717556+0000","last_became_active":"2024-09-21T22:00:54.167902+0000","last_became_peered":"2024-09-21T22:00:54.167902+0000","last_unstale":"2024-09-21T22:03:34.717556+0000","last_undegraded":"2024-09-21T22:03:34.717556+0000","last_fullsized":"2024-09-21T22:03:34.717556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'912","last_scrub_stamp":"2024-09-21T22:03:34.717465+0000","last_deep_scrub":"158'912","last_deep_scrub_stamp":"2024-09-21T22:03:34.717465+0000","last_clean_scrub_stamp":"2024-09-21T22:03:34.717465+0000","objects_scrubbed":3,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:14:44.792391+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0.0012562649999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":4141,"num_read_kb":17774,"num_write":1199,"num_write_kb":13706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"158'306","reported_seq":1416,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:28.608792+0000","last_change":"2024-09-21T22:03:28.608838+0000","last_active":"2024-09-21T22:03:28.608792+0000","last_peered":"2024-09-21T22:03:28.608792+0000","last_clean":"2024-09-21T22:03:28.608792+0000","last_became_active":"2024-09-21T22:03:01.731443+0000","last_became_peered":"2024-09-21T22:03:01.731443+0000","last_unstale":"2024-09-21T22:03:28.608792+0000","last_undegraded":"2024-09-21T22:03:28.608792+0000","last_fullsized":"2024-09-21T22:03:28.608792+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'306","last_scrub_stamp":"2024-09-21T22:03:28.608713+0000","last_deep_scrub":"158'306","last_deep_scrub_stamp":"2024-09-21T22:03:28.608713+0000","last_clean_scrub_stamp":"2024-09-21T22:03:28.608713+0000","objects_scrubbed":4,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:17:41.789772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00094293999999999997,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":784,"num_read_kb":16089,"num_write":270,"num_write_kb":17323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":17902610,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"158'773","reported_seq":3599,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:32.692591+0000","last_change":"2024-09-21T22:03:32.692631+0000","last_active":"2024-09-21T22:03:32.692591+0000","last_peered":"2024-09-21T22:03:32.692591+0000","last_clean":"2024-09-21T22:03:32.692591+0000","last_became_active":"2024-09-21T22:00:54.163489+0000","last_became_peered":"2024-09-21T22:00:54.163489+0000","last_unstale":"2024-09-21T22:03:32.692591+0000","last_undegraded":"2024-09-21T22:03:32.692591+0000","last_fullsized":"2024-09-21T22:03:32.692591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'773","last_scrub_stamp":"2024-09-21T22:03:32.692503+0000","last_deep_scrub":"158'773","last_deep_scrub_stamp":"2024-09-21T22:03:32.692503+0000","last_clean_scrub_stamp":"2024-09-21T22:03:32.692503+0000","objects_scrubbed":4,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:39:54.613852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00071737500000000002,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4762,"num_read_kb":48263,"num_write":1037,"num_write_kb":22105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"158'485","reported_seq":2405,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:26.319323+0000","last_change":"2024-09-21T22:03:26.319347+0000","last_active":"2024-09-21T22:03:26.319323+0000","last_peered":"2024-09-21T22:03:26.319323+0000","last_clean":"2024-09-21T22:03:26.319323+0000","last_became_active":"2024-09-21T22:00:54.160246+0000","last_became_peered":"2024-09-21T22:00:54.160246+0000","last_unstale":"2024-09-21T22:03:26.319323+0000","last_undegraded":"2024-09-21T22:03:26.319323+0000","last_fullsized":"2024-09-21T22:03:26.319323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'485","last_scrub_stamp":"2024-09-21T22:03:26.319252+0000","last_deep_scrub":"158'485","last_deep_scrub_stamp":"2024-09-21T22:03:26.319252+0000","last_clean_scrub_stamp":"2024-09-21T22:03:26.319252+0000","objects_scrubbed":2,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:06:49.404587+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0020803319999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2714,"num_read_kb":25997,"num_write":557,"num_write_kb":11325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"158'362","reported_seq":3024,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-21T22:03:31.695598+0000","last_change":"2024-09-21T22:03:31.695651+0000","last_active":"2024-09-21T22:03:31.695598+0000","last_peered":"2024-09-21T22:03:31.695598+0000","last_clean":"2024-09-21T22:03:31.695598+0000","last_became_active":"2024-09-21T22:00:54.163328+0000","last_became_peered":"2024-09-21T22:00:54.163328+0000","last_unstale":"2024-09-21T22:03:31.695598+0000","last_undegraded":"2024-09-21T22:03:31.695598+0000","last_fullsized":"2024-09-21T22:03:31.695598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"158'362","last_scrub_stamp":"2024-09-21T22:03:31.695475+0000","last_deep_scrub":"158'362","last_deep_scrub_stamp":"2024-09-21T22:03:31.695475+0000","last_clean_scrub_stamp":"2024-09-21T22:03:31.695475+0000","objects_scrubbed":3,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:50:35.805926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011835350000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":2638,"num_read_kb":34828,"num_write":289,"num_write_kb":13167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":110,"num_read":141040,"num_read_kb":761833,"num_write":21373,"num_write_kb":436099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1364,"num_bytes_recovered":44269066,"num_keys_recovered":204,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18935,"ondisk_log_size":18935,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9864,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55300,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316540,"statfs":{"total":96636764160,"available":96580136960,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542186,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33036,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338804,"statfs":{"total":96636764160,"available":96602935296,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55248,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316592,"statfs":{"total":96636764160,"available":96580190208,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64976,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306864,"statfs":{"total":96636764160,"available":96570228736,"internally_reserved":0,"allocated":1900544,"data_stored":911712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55244,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316596,"statfs":{"total":96636764160,"available":96580194304,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28876,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342964,"statfs":{"total":96636764160,"available":96607195136,"internally_reserved":0,"allocated":1896448,"data_stored":911693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51092,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320748,"statfs":{"total":96636764160,"available":96584445952,"internally_reserved":0,"allocated":1904640,"data_stored":911731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33092,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338748,"statfs":{"total":96636764160,"available":96602877952,"internally_reserved":0,"allocated":1953792,"data_stored":1502061,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4932,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T22:03:46.665 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T22:03:46.959 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T22:03:46.959 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T22:03:46.959 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T22:03:46.959 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.006 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T22:03:47.006 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T22:03:47.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.036 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T22:03:47.036 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T22:03:47.036 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.105 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T22:03:47.105 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T22:03:47.106 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.185 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T22:03:47.185 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T22:03:47.185 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.224 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T22:03:47.224 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T22:03:47.224 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.299 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T22:03:47.299 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T22:03:47.299 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.373 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T22:03:47.373 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T22:03:47.373 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.446 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T22:03:47.447 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T22:03:47.447 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T22:03:47.447 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.473 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T22:03:47.473 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T22:03:47.473 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.513 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T22:03:47.514 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T22:03:47.514 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T22:03:47.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.525 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T22:03:47.526 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T22:03:47.526 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.577 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T22:03:47.578 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T22:03:47.578 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T22:03:47.590 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T22:03:47.590 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T22:03:47.590 DEBUG:teuthology.orchestra.run.smithi102:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-21T22:03:47.651 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T22:03:47.651 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T22:03:47.812 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T22:03:47.813 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T22:03:47.935 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T22:03:47.935 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T22:03:48.000 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T22:03:48.001 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T22:03:48.052 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T22:03:48.052 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T22:03:48.172 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T22:03:48.172 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T22:03:48.260 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T22:03:48.260 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T22:03:48.314 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T22:03:48.314 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T22:03:48.366 INFO:tasks.ceph:Archiving mon data... 2024-09-21T22:03:48.367 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450/data/mon.a.tgz 2024-09-21T22:03:48.367 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-21T22:03:48.383 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.JlLLsOSBpI 2024-09-21T22:03:48.383 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JlLLsOSBpI 2024-09-21T22:03:48.536 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.JlLLsOSBpI 2024-09-21T22:03:48.618 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.JlLLsOSBpI is 375KB 2024-09-21T22:03:48.714 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.JlLLsOSBpI 2024-09-21T22:03:48.729 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450/data/mon.c.tgz 2024-09-21T22:03:48.729 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-21T22:03:48.782 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.CNJ0Ru3JJV 2024-09-21T22:03:48.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.CNJ0Ru3JJV 2024-09-21T22:03:48.949 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.CNJ0Ru3JJV 2024-09-21T22:03:49.031 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.CNJ0Ru3JJV is 503KB 2024-09-21T22:03:49.128 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.CNJ0Ru3JJV 2024-09-21T22:03:49.143 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450/data/mon.b.tgz 2024-09-21T22:03:49.143 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-09-21T22:03:49.161 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.h9MAmQ57Br 2024-09-21T22:03:49.162 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.h9MAmQ57Br 2024-09-21T22:03:49.342 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.h9MAmQ57Br 2024-09-21T22:03:49.425 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.h9MAmQ57Br is 503KB 2024-09-21T22:03:49.494 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.h9MAmQ57Br 2024-09-21T22:03:49.509 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T22:03:49.509 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T22:03:49.511 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T22:03:49.589 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T22:03:49.629 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T22:03:49.629 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T22:03:49.630 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450/remote/smithi102/crash 2024-09-21T22:03:49.631 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T22:03:49.655 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450/remote/smithi184/crash 2024-09-21T22:03:49.656 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T22:03:49.692 INFO:tasks.ceph:Compressing logs... 2024-09-21T22:03:49.692 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T22:03:49.699 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T22:03:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T22:03:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49472.log 2024-09-21T22:03:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39316.log 2024-09-21T22:03:49.776 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33502.log 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:gzip/var/log/ceph/ceph-client.admin.33502.log: -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33502.log.gz 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33544.log 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33462.log 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33422.log 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33544.log.gz 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33462.log.gz 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33382.log 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33593.log 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33422.log.gz 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33382.log.gz 2024-09-21T22:03:49.777 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33593.log.gz 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33302.log 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33302.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33302.log.gz 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr: --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33342.log 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.b.log: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33342.log.gz 2024-09-21T22:03:49.778 INFO:teuthology.orchestra.run.smithi184.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T22:03:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.49472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39655.log 2024-09-21T22:03:49.820 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49472.log.gz 2024-09-21T22:03:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46144.log 2024-09-21T22:03:49.820 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39316.log.gz 2024-09-21T22:03:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54958.log 2024-09-21T22:03:49.820 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39655.log.gz 2024-09-21T22:03:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52585.log 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46144.log.gz 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41211.log 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54958.log.gz 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55887.log 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52585.log.gz 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41211.log.gz 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55887.log.gz 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55719.log 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48782.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.57567.log 2024-09-21T22:03:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38526.log 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55719.log.gz 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57567.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.37728.log 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57567.log.gz 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46897.log 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38526.log.gz 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40176.log 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37728.log.gz 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46813.log 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46897.log.gz 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53641.log 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40176.log.gz 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55215.log 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46813.log.gz 2024-09-21T22:03:49.822 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58113.log 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53641.log.gz 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57903.log 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55215.log.gz 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.58113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37981.log 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58113.log.gz 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39114.log 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57903.log.gz 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37981.log.gz 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43891.log 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39114.log.gz 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56305.log 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52348.log 2024-09-21T22:03:49.823 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43891.log.gz 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55677.log 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56305.log.gz 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47398.log 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52348.log.gz 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45148.log 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55677.log.gz 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50608.log 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47398.log.gz 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57735.log 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45148.log.gz 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.50608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57525.log 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50608.log.gz 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46722.log 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57735.log.gz 2024-09-21T22:03:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57525.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57525.log.gz 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42691.log 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46722.log.gz 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57189.log 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38329.log 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42691.log.gz 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57189.log.gz 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47760.log 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57231.log 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38329.log.gz 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56720.log 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47760.log.gz 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57315.log 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57231.log.gz 2024-09-21T22:03:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42253.log 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56720.log.gz 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57315.log.gz 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57273.log 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38647.log 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42253.log.gz 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56937.log 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57273.log.gz 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38647.log.gz 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56601.log 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56937.log.gz 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56601.log.gz 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39712.log 2024-09-21T22:03:49.826 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54619.log 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gz 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39712.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.39712.log.gz 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.38272.log 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38290.log 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54619.log.gz 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44187.log 0.0% 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38272.log.gz 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57357.log 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38290.log.gz 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44187.log.gz 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49631.log 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47276.log 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57357.log.gz 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.49631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49631.log.gz 2024-09-21T22:03:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42853.log 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57651.log 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47276.log.gz 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42853.log.gz 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49167.log 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55040.log 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57651.log.gz 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.49167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49167.log.gz 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57987.log 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33865.log 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55040.log.gz 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57987.log.gz 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56405.log 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38946.log 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33865.log.gz 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56405.log.gz 2024-09-21T22:03:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53722.log 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45583.log 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38946.log.gz 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53722.log.gz 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40054.log 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50913.log 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45583.log.gz 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40054.log.gz 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39313.log 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.50913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57483.log 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50913.log.gz 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39313.log.gz 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51510.log 2024-09-21T22:03:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39937.log 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57483.log.gz 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.51510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51510.log.gz 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47940.log 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51708.log 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39937.log.gz 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47940.log.gz 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44725.log 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.51708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51708.log.gz 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55593.log 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38605.log 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44725.log.gz 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55593.log.gz 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38288.log 2024-09-21T22:03:49.830 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40930.log 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38605.log.gz 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54562.log 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38288.log.gz 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56706.log 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40930.log.gz 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54562.log.gz 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41395.log 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51710.log 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56706.log.gz 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49146.log 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41395.log.gz 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.51710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51710.log.gz 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57861.log 2024-09-21T22:03:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.49146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45990.log 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr: 28.5% -- replaced with /var/log/ceph/ceph-client.admin.49146.log.gz 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57861.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.57441.log 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57861.log.gz 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38289.log 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45990.log.gz 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57441.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.38602.log 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57441.log.gz 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37992.log 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38289.log.gz 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38602.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38602.log.gz 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.49554.log 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56404.log 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37992.log.gz 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.49554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33472.log 2024-09-21T22:03:49.832 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49554.log.gz 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57609.log 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56404.log.gz 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53783.log 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33472.log.gz 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41209.log 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57609.log.gz 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53783.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.53783.log.gz -- 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.37987.log 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55509.log 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41209.log.gz 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37987.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37987.log.gz -5 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46700.log 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55509.log.gz 2024-09-21T22:03:49.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55299.log 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46700.log.gz 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39176.log 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56067.log 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55299.log.gz 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41032.log 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39176.log.gz 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56067.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56067.log.gz 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38689.log 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52168.log 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41032.log.gz 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38689.log.gz 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52288.log 2024-09-21T22:03:49.834 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37652.log 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52168.log.gz 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53362.log 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52288.log.gz 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37652.log.gz 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56959.log 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44329.log 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53362.log.gz 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56959.log.gz 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47475.log 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50151.log 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44329.log.gz 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47475.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.47475.log.gz 2024-09-21T22:03:49.835 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56066.log 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.50151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50151.log.gz 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42169.log 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54700.log 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56066.log.gz 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38601.log 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42169.log.gz 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54700.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.54700.log.gz 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49288.log 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53022.log 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38601.log.gz 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.49288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49288.log.gz 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46978.log 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52389.log 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53022.log.gz 2024-09-21T22:03:49.836 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46978.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.46978.log.gz 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41851.log 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57777.log 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52389.log.gz 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41851.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.41851.log.gz -- 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.48356.log 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38606.log 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57777.log.gz 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48356.log.gzgzip 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44110.log 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.38606.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43648.log 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38606.log.gz 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44110.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44110.log.gz -- 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.37677.log 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37991.log 2024-09-21T22:03:49.837 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43648.log.gz 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58029.log 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37677.log.gz 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37991.log.gz 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46821.log 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.58029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55171.log 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58029.log.gz 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46821.log.gz 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39072.log 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54181.log 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55171.log.gz 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39072.log.gz 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37812.log 2024-09-21T22:03:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57693.log 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54181.log.gz 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37812.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37812.log.gz 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46937.log 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57693.log.gz 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52006.log 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46937.log.gz 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40454.log 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49430.log 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52006.log.gz 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40454.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.40454.log.gz /var/log/ceph/ceph-client.admin.55425.log 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.49430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49430.log.gz 2024-09-21T22:03:49.839 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52464.log 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41758.log 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55425.log.gz 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57819.log 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52464.log.gz 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41758.log.gz 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40972.log 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52944.log 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57819.log: 28.3% -- replaced with /var/log/ceph/ceph-client.admin.57819.log.gz 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40972.log.gz 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44370.log 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42085.log 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52944.log.gz 2024-09-21T22:03:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38646.log 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44370.log.gz 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42085.log.gz 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55635.log 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47920.log 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38646.log.gz 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55635.log.gz 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43072.log 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57016.log 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47920.log.gz 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55103.log 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43072.log.gz 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57016.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.57016.log.gz 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56069.log 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50651.log 2024-09-21T22:03:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55103.log.gz 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50790.log 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56069.log.gz 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.50651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50651.log.gz 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43948.log 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.50790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50790.log.gz 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44767.log 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43948.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43948.log.gz /var/log/ceph/ceph-client.admin.47699.log 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27647.log 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44767.log.gz 2024-09-21T22:03:49.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47699.log.gz 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56402.log 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46639.log 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.tmp-client.admin.27647.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27647.log.gz 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57105.log 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56402.log.gz 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52545.log 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46639.log.gz 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55383.log 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57105.log.gz 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52545.log.gz 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45657.log 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42001.log 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55383.log.gz 2024-09-21T22:03:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45657.log.gz 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41939.log 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42001.log.gz 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53978.log 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41939.log.gz 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48259.log 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56764.log 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53978.log.gz 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50269.log 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48259.log.gz 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39314.log 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56764.log.gz 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.50269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37596.log 2024-09-21T22:03:49.844 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50269.log.gz 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42043.log 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39314.log.gz 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57945.log 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37596.log.gz 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50748.log 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42043.log.gz 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48985.log 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57945.log.gz 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.50748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55257.log 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50748.log.gz 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40788.log 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48985.log.gz 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56403.log 2024-09-21T22:03:49.845 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55257.log.gz 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38988.log 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40788.log.gz 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38862.log 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56403.log.gz 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53205.log 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38988.log.gz 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38862.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38862.log.gz 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51369.log 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53205.log.gz 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37986.log 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.51369.log: gzip -5 0.0% --verbose -- /var/log/ceph/ceph-client.admin.51568.log 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51369.log.gz 2024-09-21T22:03:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37986.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37986.log.gz 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51949.log 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.51568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51568.log.gz 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56721.log 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.51949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51949.log.gz 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58153.log 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56721.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56721.log.gz 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48401.log 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.58153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58153.log.gz 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41596.log 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48401.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48401.log.gz 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56062.log 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41596.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41596.log.gz 2024-09-21T22:03:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56062.log.gz 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57147.log 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40455.log 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57147.log.gz 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44648.log 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55803.log 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40455.log.gz 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44648.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56068.log 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55803.log.gz 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47119.log 2024-09-21T22:03:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56068.log.gz 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47119.log.gz 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37993.log 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55467.log 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37770.log 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37993.log.gz 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41436.log 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0%/var/log/ceph/ceph-client.admin.37770.log: -- replaced with /var/log/ceph/ceph-client.admin.55467.log.gz 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37770.log.gz 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42211.log 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41436.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38279.log 2024-09-21T22:03:49.849 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42211.log.gz 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58071.log 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55341.log 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38279.log.gz 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.58071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58071.log.gz 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57399.log 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55341.log.gz 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57399.log.gz 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40074.log 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38904.log 2024-09-21T22:03:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48906.log 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40074.log.gz 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38904.log.gz 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51172.log 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48906.log.gz 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56641.log 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51110.log 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.51172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51172.log.gz 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56641.log.gz 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42833.log 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.51110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51110.log.gz 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54999.log 2024-09-21T22:03:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56395.log 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42833.log.gz 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54999.log.gz 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55845.log 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56395.log.gz 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42335.log 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40886.log 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55845.log.gz 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42335.log.gz 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41616.log 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42295.log 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40886.log.gz 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41616.log.gz 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52228.log 2024-09-21T22:03:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42295.log.gz 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50310.log 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46382.log 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52228.log.gz 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.50310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50310.log.gz 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56304.log 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46382.log.gz 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47018.log 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39229.log 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56304.log.gz 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47018.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49910.log 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47018.log.gz 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.39229.log: 94.5% -- replaced with /var/log/ceph/ceph-client.0.39229.log.gz 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56299.log 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52626.log 2024-09-21T22:03:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.49910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49910.log.gz 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56299.log.gz 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45960.log 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43114.log 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52626.log.gz 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45960.log.gz 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40846.log 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43114.log.gz 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56640.log 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42127.log 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40846.log.gz 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56640.log.gz 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45345.log 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39030.log 2024-09-21T22:03:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42127.log: /var/log/ceph/ceph-client.admin.45345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42127.log.gz 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45345.log.gz 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57017.log 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37990.log 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39030.log.gz 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57017.log.gz 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46341.log 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37990.log.gz 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56065.log 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38330.log 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46341.log.gz 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56065.log.gz 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56765.log 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33774.log 2024-09-21T22:03:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38330.log.gz 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56765.log.gz 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43391.log 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55104.log 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33774.log.gz 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43391.log.gz 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54298.log 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55104.log.gz 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50705.log 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38278.log 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54298.log.gz 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.50705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50705.log.gz 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53982.log 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56063.log 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38278.log.gz 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53982.log.gz 2024-09-21T22:03:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47614.log 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56063.log.gz 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49853.log 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48502.log 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47614.log.gz 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.49853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49853.log.gz 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43331.log 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48502.log.gz 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41494.log 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48574.log 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43331.log.gz 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41494.log.gz 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47554.log 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48574.log.gz 2024-09-21T22:03:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48316.log 2024-09-21T22:03:49.858 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T22:03:49.858 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47554.log.gz 2024-09-21T22:03:49.858 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48316.log.gz 2024-09-21T22:03:49.858 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52924.log 2024-09-21T22:03:49.864 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53404.log 2024-09-21T22:03:49.864 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.52924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52924.log.gz 2024-09-21T22:03:49.864 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45446.log 2024-09-21T22:03:49.864 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53404.log.gz 2024-09-21T22:03:49.864 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45066.log 2024-09-21T22:03:49.864 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45446.log.gz 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49388.log 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45066.log.gz 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55551.log 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.49388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49388.log.gz 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55761.log 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55551.log.gz 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54238.log 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55761.log.gz 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56061.log 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54238.log.gz 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56061.log.gz 2024-09-21T22:03:49.865 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-21T22:03:49.883 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T22:03:49.913 INFO:teuthology.orchestra.run.smithi184.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T22:03:50.042 INFO:teuthology.orchestra.run.smithi184.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T22:03:50.090 INFO:teuthology.orchestra.run.smithi102.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T22:03:50.847 INFO:teuthology.orchestra.run.smithi102.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T22:03:50.919 INFO:teuthology.orchestra.run.smithi102.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T22:03:51.691 INFO:teuthology.orchestra.run.smithi102.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T22:03:51.963 INFO:teuthology.orchestra.run.smithi184.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T22:03:52.076 INFO:teuthology.orchestra.run.smithi184.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T22:03:52.171 INFO:teuthology.orchestra.run.smithi102.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T22:03:52.173 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-21T22:03:52.173 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m2.462s 2024-09-21T22:03:52.173 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m6.885s 2024-09-21T22:03:52.173 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.424s 2024-09-21T22:03:52.299 INFO:teuthology.orchestra.run.smithi184.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T22:03:52.301 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-21T22:03:52.302 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m2.547s 2024-09-21T22:03:52.302 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m7.187s 2024-09-21T22:03:52.302 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m0.300s 2024-09-21T22:03:52.302 INFO:tasks.ceph:Archiving logs... 2024-09-21T22:03:52.302 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450/remote/smithi102/log 2024-09-21T22:03:52.305 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T22:03:53.344 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450/remote/smithi184/log 2024-09-21T22:03:53.345 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T22:03:54.216 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T22:03:54.224 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T22:03:54.224 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T22:03:54.227 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T22:03:54.312 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T22:03:54.320 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T22:03:54.321 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T22:03:54.323 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T22:03:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-21T22:03:54.339 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-09-21T22:03:54.342 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T22:03:54.342 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-21T22:03:54.342 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +395us[ +394us] +/- 50ms 2024-09-21T22:03:54.342 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -1376us[-1378us] +/- 62ms 2024-09-21T22:03:54.342 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +1143us[+1142us] +/- 80ms 2024-09-21T22:03:54.342 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:03:54.346 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T22:03:54.346 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-09-21T22:03:54.346 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +392us[ +389us] +/- 50ms 2024-09-21T22:03:54.346 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -1369us[-1373us] +/- 62ms 2024-09-21T22:03:54.346 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +1141us[+1137us] +/- 80ms 2024-09-21T22:03:54.346 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T22:03:54.347 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T22:03:54.355 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T22:03:54.355 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T22:03:54.363 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T22:03:54.463 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T22:03:54.535 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T22:03:54.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:03:54.564 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-21T22:03:54.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:03:54.593 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T22:03:54.601 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T22:03:54.609 INFO:teuthology.task.internal:Duration was 602.784610 seconds 2024-09-21T22:03:54.610 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T22:03:54.617 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T22:03:54.617 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T22:03:54.620 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T22:03:54.657 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T22:03:54.672 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T22:03:55.054 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T22:03:55.054 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T22:03:55.054 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T22:03:55.114 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-09-21T22:03:55.115 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T22:03:55.140 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T22:03:55.140 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T22:03:55.157 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T22:03:55.206 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T22:03:55.206 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T22:03:55.225 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T22:03:55.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T22:03:55.368 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T22:03:55.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T22:03:55.393 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T22:03:55.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T22:03:55.428 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T22:03:55.436 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T22:03:55.457 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-21T22:03:55.481 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-09-21T22:03:55.511 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T22:03:55.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:03:55.553 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T22:03:55.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T22:03:55.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T22:03:55.578 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T22:03:55.579 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450/remote/smithi102 2024-09-21T22:03:55.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T22:03:55.633 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914450/remote/smithi184 2024-09-21T22:03:55.633 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T22:03:55.666 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T22:03:55.666 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T22:03:55.669 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T22:03:55.716 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T22:03:55.727 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T22:03:55.727 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T22:03:55.736 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T22:03:55.736 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T22:03:55.739 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T22:03:55.751 INFO:teuthology.orchestra.run.smithi102.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 22:03 /home/ubuntu/cephtest 2024-09-21T22:03:55.771 INFO:teuthology.orchestra.run.smithi184.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 22:03 /home/ubuntu/cephtest 2024-09-21T22:03:55.773 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T22:03:55.783 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T22:03:55.803 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read} duration: 602.7846097946167 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-21T22:03:55.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T22:03:55.881 INFO:teuthology.run:pass